-- Logs begin at Tue 2021-05-25 16:51:17 UTC, end at Tue 2021-05-25 18:12:58 UTC. --
May 25 17:34:01.094436 dv-cinder-789564-2-iscsi systemd[1]: Started Devstack devstack@q-svc.service.
May 25 17:34:02.065672 dv-cinder-789564-2-iscsi neutron-server[98883]: Beware of the coming changes in the project packaging
May 25 17:34:02.067133 dv-cinder-789564-2-iscsi neutron-server[98883]: https://github.com/svinota/pyroute2/discussions/786
May 25 17:34:03.542763 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.common.config [-] Logging enabled!
May 25 17:34:03.543364 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 18.1.0.dev240
May 25 17:34:03.543448 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=98883) setup_logging /opt/stack/neutron/neutron/common/config.py:112}}
May 25 17:34:03.546698 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.common.config [-] Logging enabled!
May 25 17:34:03.546957 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 18.1.0.dev240
May 25 17:34:03.547273 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=98883) setup_logging /opt/stack/neutron/neutron/common/config.py:112}}
May 25 17:34:03.548211 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}}
May 25 17:34:03.548447 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] Configuration options gathered from: {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}}
May 25 17:34:03.548815 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}}
May 25 17:34:03.549065 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}}
May 25 17:34:03.549319 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] ================================================================================ {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}}
May 25 17:34:03.549641 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] allow_bulk                     = True {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:03.549938 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] allow_overlapping_ips          = True {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:03.550237 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] api_extensions_path            =  {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:03.550469 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] api_paste_config               = api-paste.ini {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:03.550768 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] api_workers                    = 2 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:03.551060 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] auth_strategy                  = keystone {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:03.551345 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] backlog                        = 4096 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:03.551634 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] base_mac                       = fa:16:3e:00:00:00 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:03.551930 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] bind_host                      = 0.0.0.0 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:03.552215 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] bind_port                      = 9696 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:03.552497 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] client_socket_timeout          = 900 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:03.552783 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] config_dir                     = [] {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:03.553015 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] config_file                    = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:03.553327 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] config_source                  = [] {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:03.553617 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] control_exchange               = neutron {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:03.553905 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] core_plugin                    = ml2 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:03.554130 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] debug                          = True {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:03.554419 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] default_availability_zones     = [] {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:03.554845 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:03.555258 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] dhcp_agent_notification        = True {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:03.555542 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] dhcp_lease_duration            = 86400 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:03.555835 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] dns_domain                     = openstacklocal {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:03.556117 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] enable_traditional_dhcp        = True {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:03.556392 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] external_dns_driver            = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:03.556671 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] filter_validation              = True {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:03.556958 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] global_physnet_mtu             = 1500 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:03.557317 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] host                           = dv-cinder-789564-2-iscsi {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:03.557599 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] http_retries                   = 3 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:03.558529 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] instance_format                = [instance: %(uuid)s]  {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:03.559166 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:03.559166 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] ipam_driver                    = internal {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:03.559560 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] ipv6_pd_enabled                = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:03.559734 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] log_config_append              = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:03.560013 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:03.560291 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] log_dir                        = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:03.560567 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] log_file                       = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:03.560857 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] log_rotate_interval            = 1 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:03.561167 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] log_rotate_interval_type       = days {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:03.561462 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] log_rotation_type              = none {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:03.561762 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:03.561992 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:03.562215 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:03.562505 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:03.562794 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] logging_user_identity_format   = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:03.563074 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] max_dns_nameservers            = 5 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:03.563352 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] max_header_line                = 16384 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:03.563627 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] max_logfile_count              = 30 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:03.563905 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] max_logfile_size_mb            = 200 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:03.564184 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] max_subnet_host_routes         = 20 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:03.564452 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] network_link_prefix            = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:03.564740 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] notify_nova_on_port_data_changes = True {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:03.565031 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] notify_nova_on_port_status_changes = True {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:03.565350 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] pagination_max_limit           = -1 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:03.565629 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] periodic_fuzzy_delay           = 5 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:03.565906 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] periodic_interval              = 40 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:03.566183 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] publish_errors                 = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:03.566478 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] rate_limit_burst               = 0 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:03.566745 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] rate_limit_except_level        = CRITICAL {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:03.567022 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] rate_limit_interval            = 0 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:03.567300 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] retry_until_window             = 30 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:03.567575 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] rpc_response_max_timeout       = 600 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:03.567866 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] rpc_state_report_workers       = 0 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:03.568137 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] rpc_workers                    = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:03.568412 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] send_events_interval           = 2 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:03.568721 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] service_plugins                = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:03.569011 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] setproctitle                   = on {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:03.569322 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] state_path                     = /opt/stack/data/neutron {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:03.569614 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] syslog_log_facility            = LOG_USER {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:03.569893 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] tcp_keepidle                   = 600 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:03.570181 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] transport_url                  = **** {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:03.570496 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] use_eventlog                   = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:03.570732 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] use_journal                    = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:03.571008 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] use_json                       = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:03.571285 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] use_ssl                        = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:03.571559 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] use_stderr                     = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:03.571846 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] use_syslog                     = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:03.572125 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] vlan_transparent               = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:03.572401 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] watch_log_file                 = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:03.572680 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] wsgi_default_pool_size         = 100 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:03.572951 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] wsgi_keep_alive                = True {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:03.573263 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] wsgi_log_format                = %(client_ip)s "%(request_line)s" status: %(status_code)s  len: %(body_length)s time: %(wall_seconds).7f {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:03.573593 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] oslo_concurrency.disable_process_locking = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.573893 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] oslo_concurrency.lock_path     = /opt/stack/data/neutron/lock {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.574197 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] profiler.connection_string     = messaging:// {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.574486 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] profiler.enabled               = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.574784 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] profiler.es_doc_type           = notification {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.575067 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] profiler.es_scroll_size        = 10000 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.575360 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] profiler.es_scroll_time        = 2m {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.575642 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] profiler.filter_error_trace    = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.575933 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] profiler.hmac_keys             = SECRET_KEY {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.576224 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] profiler.sentinel_service_name = mymaster {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.576516 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] profiler.socket_timeout        = 0.1 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.576799 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] profiler.trace_sqlalchemy      = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.577119 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] oslo_policy.enforce_new_defaults = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.577401 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] oslo_policy.enforce_scope      = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.577700 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] oslo_policy.policy_default_rule = default {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.578009 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.578383 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] oslo_policy.policy_file        = /etc/neutron/policy.json {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.578611 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.578888 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.579167 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.579445 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.579729 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.580018 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] nova.auth_section              = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.580315 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] nova.auth_type                 = password {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.580607 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] nova.cafile                    = /opt/stack/data/ca-bundle.pem {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.580883 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] nova.certfile                  = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.581197 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] nova.collect_timing            = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.581497 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] nova.endpoint_type             = public {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.581781 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] nova.insecure                  = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.582058 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] nova.keyfile                   = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.582339 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] nova.live_migration_events     = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.582632 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] nova.region_name               = RegionOne {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.582916 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] nova.split_loggers             = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.583188 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] nova.timeout                   = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.583473 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] placement.auth_section         = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.583756 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] placement.auth_type            = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.584032 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] placement.cafile               = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.584309 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] placement.certfile             = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.584595 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] placement.collect_timing       = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.584891 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] placement.endpoint_type        = public {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.585204 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] placement.insecure             = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.585485 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] placement.keyfile              = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.585760 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] placement.region_name          = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.586041 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] placement.split_loggers        = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.586315 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] placement.timeout              = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.586602 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] ironic.auth_section            = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.586882 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] ironic.auth_type               = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.587158 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] ironic.cafile                  = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.587434 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] ironic.certfile                = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.587719 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] ironic.collect_timing          = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.587994 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] ironic.connect_retries         = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.588269 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] ironic.connect_retry_delay     = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.588555 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] ironic.enable_notifications    = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.588830 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] ironic.endpoint_override       = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.589159 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] ironic.insecure                = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.589446 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] ironic.interface               = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.589758 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] ironic.keyfile                 = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.590036 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] ironic.max_version             = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.590312 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] ironic.min_version             = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.590588 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] ironic.region_name             = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.590860 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] ironic.service_name            = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.591135 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] ironic.service_type            = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.591415 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] ironic.split_loggers           = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.591692 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] ironic.status_code_retries     = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.591968 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] ironic.status_code_retry_delay = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.592244 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] ironic.timeout                 = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.592522 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] ironic.valid_interfaces        = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.592799 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] ironic.version                 = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.593120 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] service_providers.service_provider = [] {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.593413 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.593698 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.593996 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.594289 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.594572 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.594853 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.595133 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.595414 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.595696 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.595973 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.596268 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.596555 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.596844 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.597220 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.597505 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.597804 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.598084 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.598369 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.598655 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.598935 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.599224 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.599508 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl      = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.599805 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.600101 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.600395 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_key_file =  {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.600689 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_version =  {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.600982 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] oslo_messaging_notifications.driver = [] {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.601286 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] oslo_messaging_notifications.retry = -1 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.601598 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.601881 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] oslo_messaging_notifications.transport_url = **** {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:03.602101 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}}
May 25 17:34:03.602345 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo.service.wsgi [-] Loading app neutron from /etc/neutron/api-paste.ini {{(pid=98883) load_app /usr/local/lib/python3.8/dist-packages/oslo_service/wsgi.py:349}}
May 25 17:34:03.957780 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" acquired by "neutron_lib.plugins.directory._create_plugin_directory" :: waited 0.000s {{(pid=98883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:34:03.958256 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" released by "neutron_lib.plugins.directory._create_plugin_directory" :: held 0.001s {{(pid=98883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:34:03.958369 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_concurrency.lockutils [-] Lock "manager" acquired by "neutron.manager.NeutronManager._create_instance" :: waited 0.000s {{(pid=98883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:34:03.958806 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.manager [-] Loading core plugin: ml2
May 25 17:34:04.353341 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.securitygroup.SecurityGroup'>> rbac-policy before_create 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:04.353626 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.securitygroup.SecurityGroup'>> rbac-policy before_update 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:04.353903 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.securitygroup.SecurityGroup'>> rbac-policy before_delete 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:04.355546 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_group.AddressGroup'>> rbac-policy before_create 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:04.355827 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_group.AddressGroup'>> rbac-policy before_update 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:04.356089 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_group.AddressGroup'>> rbac-policy before_delete 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:04.391247 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.network.Network'>> rbac-policy before_create 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:04.391521 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.network.Network'>> rbac-policy before_update 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:04.391791 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.network.Network'>> rbac-policy before_delete 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:04.405282 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.qos.policy.QosPolicy'>> rbac-policy before_create 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:04.405567 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.qos.policy.QosPolicy'>> rbac-policy before_update 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:04.405843 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.qos.policy.QosPolicy'>> rbac-policy before_delete 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:04.434977 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.subnetpool.SubnetPool'>> rbac-policy before_create 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:04.435254 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.subnetpool.SubnetPool'>> rbac-policy before_update 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:04.435528 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.subnetpool.SubnetPool'>> rbac-policy before_delete 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:04.472466 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_scope.AddressScope'>> rbac-policy before_create 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:04.472742 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_scope.AddressScope'>> rbac-policy before_update 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:04.473009 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_scope.AddressScope'>> rbac-policy before_delete 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:04.709598 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _update_segment_host_mapping_for_agent at 0x7fcae86f4ee0> agent after_create 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:04.710209 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _update_segment_host_mapping_for_agent at 0x7fcae86f4ee0> agent after_update 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:04.710209 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _add_segment_host_mapping_for_segment at 0x7fcae86f4e50> segment precommit_create 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:04.710584 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _delete_segments_for_network at 0x7fcae86f4dc0> network precommit_delete 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:04.711144 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _prevent_segment_delete_with_port_bound at 0x7fcae87199d0> segment before_delete 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:04.841159 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._before_network_delete_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fcae9032ca0>> network before_delete 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:04.841482 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function DVRDbMixin._delete_mac_associated_with_agent at 0x7fcae878a0d0> agent before_delete 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:04.841767 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupDbMixin._ensure_default_security_group_handler_net of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fcae9032ca0>> network before_create 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:04.842046 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupDbMixin._ensure_default_security_group_handler_port of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fcae9032ca0>> port before_create 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:04.842320 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupDbMixin._ensure_default_security_group_handler_port of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fcae9032ca0>> port before_update 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:04.842631 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._handle_segment_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fcae9032ca0>> segment precommit_create 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:04.842892 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._handle_segment_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fcae9032ca0>> segment precommit_delete 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:04.843151 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._handle_segment_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fcae9032ca0>> segment after_create 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:04.843406 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._handle_segment_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fcae9032ca0>> segment after_delete 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:04.843689 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._network_delete_after_delete_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fcae9032ca0>> network after_delete 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:04.843948 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._network_delete_precommit_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fcae9032ca0>> network precommit_delete 0 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:04.844213 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._port_provisioned of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fcae9032ca0>> port provisioning_complete 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:04.844477 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._process_ext_policy_create of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fcae9032ca0>> rbac-policy before_create 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:04.844734 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._process_ext_policy_delete of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fcae9032ca0>> rbac-policy after_delete 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:04.845015 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._retry_binding_revived_agents of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fcae9032ca0>> agent after_update 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:04.845298 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._subnet_delete_after_delete_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fcae9032ca0>> subnet after_delete 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:04.846668 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._subnet_delete_precommit_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fcae9032ca0>> subnet precommit_delete 0 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:04.846961 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._validate_ext_not_in_use_by_tenant of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fcae9032ca0>> rbac-policy before_update 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:04.847233 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._validate_ext_not_in_use_by_tenant of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fcae9032ca0>> rbac-policy before_delete 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:04.847528 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method DhcpAgentSchedulerDbMixin.auto_schedule_new_network_segments of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fcae9032ca0>> segment_host_mapping after_create 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:04.847891 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fcae9032ca0>> port after_create 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:04.848155 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fcae9032ca0>> port after_update 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:04.848413 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fcae9032ca0>> port after_delete 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:04.848703 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fcae9032ca0>> rbac-policy before_create 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:04.848962 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fcae9032ca0>> rbac-policy before_update 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:04.849244 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fcae9032ca0>> rbac-policy before_delete 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:04.849636 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: network configured {{(pid=98883) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
May 25 17:34:04.849881 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: port configured {{(pid=98883) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
May 25 17:34:04.850124 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnet configured {{(pid=98883) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
May 25 17:34:04.850364 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnetpool configured {{(pid=98883) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
May 25 17:34:04.850602 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group configured {{(pid=98883) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
May 25 17:34:04.850839 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group_rule configured {{(pid=98883) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
May 25 17:34:04.851211 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.plugins.ml2.managers [-] Configured type driver names: ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve']
May 25 17:34:04.854332 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.plugins.ml2.drivers.type_flat [-] Allowable flat physical_network names: ['physnet1']
May 25 17:34:04.858573 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.plugins.ml2.drivers.type_local [-] ML2 LocalTypeDriver initialization complete
May 25 17:34:04.862339 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.plugins.ml2.drivers.type_vlan [-] Network VLAN ranges: OrderedDict([('physnet1', [(1300, 1349)])])
May 25 17:34:04.863956 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.plugins.ml2.managers [-] Loaded type driver names: ['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan']
May 25 17:34:04.864408 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.plugins.ml2.managers [-] Registered types: dict_keys(['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan'])
May 25 17:34:04.864748 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.plugins.ml2.managers [-] Tenant network_types: ['vlan']
May 25 17:34:04.865165 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.plugins.ml2.managers [-] Configured extension driver names: ['port_security']
May 25 17:34:04.868103 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.plugins.ml2.managers [-] Loaded extension driver names: ['port_security']
May 25 17:34:04.868358 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.plugins.ml2.managers [-] Registered extension drivers: ['port_security']
May 25 17:34:04.868789 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.plugins.ml2.managers [-] Configured mechanism driver names: ['openvswitch', 'hyperv']
May 25 17:34:04.896894 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.plugins.ml2.drivers.openvswitch.mech_driver.mech_openvswitch [-] Open vSwitch agent's supported_vnic_types: ['normal', 'direct', 'smart-nic', 'vdpa']
May 25 17:34:04.897377 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method DriverBase._register of <neutron.services.qos.drivers.openvswitch.driver.OVSDriver object at 0x7fcae887ea30>> qos_plugin after_init 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:04.897681 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.services.qos.drivers.openvswitch.driver [-] Open vSwitch QoS driver registered {{(pid=98883) register /opt/stack/neutron/neutron/services/qos/drivers/openvswitch/driver.py:82}}
May 25 17:34:04.898043 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method DriverBase._register of <neutron.services.logapi.drivers.openvswitch.driver.OVSDriver object at 0x7fcae887e4c0>> logging-plugin after_init 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:04.899388 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.services.logapi.drivers.openvswitch.driver [-] Open vSwitch logging driver registered {{(pid=98883) register /opt/stack/neutron/neutron/services/logapi/drivers/openvswitch/driver.py:69}}
May 25 17:34:04.899675 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.plugins.ml2.managers [-] Loaded mechanism driver names: ['openvswitch', 'hyperv']
May 25 17:34:04.899925 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.plugins.ml2.managers [-] Registered mechanism drivers: ['openvswitch', 'hyperv']
May 25 17:34:04.903208 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Notifier._send_nova_notification of <neutron.notifiers.nova.Notifier object at 0x7fcae86591f0>> floatingip before_response 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:04.903492 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Notifier._send_nova_notification of <neutron.notifiers.nova.Notifier object at 0x7fcae86591f0>> port before_response 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:04.979346 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'flat'
May 25 17:34:04.979524 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.plugins.ml2.drivers.type_flat [-] ML2 FlatTypeDriver initialization complete
May 25 17:34:04.979802 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'geneve'
May 25 17:34:04.980538 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.plugins.ml2.drivers.type_tunnel [-] geneve ID ranges: [(1, 1000)]
May 25 17:34:05.010762 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_db.sqlalchemy.engines [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=98883) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
May 25 17:34:05.505387 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.plugins.ml2.managers [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Initializing driver for type 'gre'
May 25 17:34:05.505968 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] gre ID ranges: [(1, 1000)]
May 25 17:34:05.714676 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.plugins.ml2.managers [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Initializing driver for type 'local'
May 25 17:34:05.715673 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.plugins.ml2.managers [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Initializing driver for type 'vlan'
May 25 17:34:05.812059 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.plugins.ml2.drivers.type_vlan [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] VlanTypeDriver initialization complete
May 25 17:34:05.812331 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.plugins.ml2.managers [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Initializing driver for type 'vxlan'
May 25 17:34:05.812861 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] vxlan ID ranges: [(1, 1000)]
May 25 17:34:06.074515 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.plugins.ml2.managers [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Initializing extension driver 'port_security'
May 25 17:34:06.074781 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.plugins.ml2.extensions.port_security [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] PortSecurityExtensionDriver initialization complete
May 25 17:34:06.075125 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.plugins.ml2.managers [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Initializing mechanism driver 'openvswitch'
May 25 17:34:06.075456 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.plugins.ml2.managers [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Initializing mechanism driver 'hyperv'
May 25 17:34:06.082037 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.plugins.ml2.plugin [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] neutron.plugins.ml2.plugin.Ml2Plugin method _start_rpc_notifiers called with arguments () {} {{(pid=98883) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:34:06.082817 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fcae8609460>> port after_create 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:06.083194 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fcae8609460>> port after_update 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:06.083551 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fcae8609460>> port after_delete 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:06.083942 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fcae8609340>> subnet after_create 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:06.084301 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fcae8609340>> subnet after_update 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:06.084649 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fcae8609340>> subnet after_delete 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:06.085032 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Subscribe: <bound method _ObjectChangeHandler.handle_payload_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fcae80b42e0>> network after_create 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:06.085405 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Subscribe: <bound method _ObjectChangeHandler.handle_payload_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fcae80b42e0>> network after_update 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:06.085747 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Subscribe: <bound method _ObjectChangeHandler.handle_payload_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fcae80b42e0>> network after_delete 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:06.086127 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fcae80b4550>> security_group after_create 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:06.086473 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fcae80b4550>> security_group after_update 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:06.086816 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fcae80b4550>> security_group after_delete 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:06.087196 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fcae80b47f0>> security_group_rule after_create 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:06.087543 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fcae80b47f0>> security_group_rule after_update 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:06.087882 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fcae80b47f0>> security_group_rule after_delete 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:06.088265 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fcae80b4a60>> address_group after_create 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:06.088604 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fcae80b4a60>> address_group after_update 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:06.088972 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fcae80b4a60>> address_group after_delete 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:06.089331 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.plugins.ml2.ovo_rpc [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] ML2 OVO RPC backend initialized. {{(pid=98883) __init__ /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:160}}
May 25 17:34:06.090049 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Subscribe: <bound method DhcpAgentNotifyAPI._after_router_interface_created of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fcae80b4e50>> router_interface after_create 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:06.090406 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Subscribe: <bound method DhcpAgentNotifyAPI._after_router_interface_deleted of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fcae80b4e50>> router_interface after_delete 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:06.090825 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Subscribe: <bound method DhcpAgentNotifyAPI._send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fcae80b4e50>> network before_response 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:06.091175 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Subscribe: <bound method DhcpAgentNotifyAPI._send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fcae80b4e50>> networks before_response 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:06.091523 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Subscribe: <bound method DhcpAgentNotifyAPI._send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fcae80b4e50>> port before_response 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:06.091866 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Subscribe: <bound method DhcpAgentNotifyAPI._send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fcae80b4e50>> ports before_response 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:06.092211 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Subscribe: <bound method DhcpAgentNotifyAPI._send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fcae80b4e50>> subnet before_response 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:06.092557 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Subscribe: <bound method DhcpAgentNotifyAPI._send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fcae80b4e50>> subnets before_response 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:06.092908 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fcae80b4e50>> network after_create 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:06.093368 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fcae80b4e50>> network after_update 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:06.093625 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fcae80b4e50>> network after_delete 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:06.093963 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fcae80b4e50>> port after_create 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:06.095252 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fcae80b4e50>> port after_update 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:06.095531 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fcae80b4e50>> port after_delete 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:06.095878 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fcae80b4e50>> subnet after_create 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:06.096223 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fcae80b4e50>> subnet after_update 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:06.096565 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fcae80b4e50>> subnet after_delete 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:06.097177 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.plugins.ml2.plugin [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Modular L2 Plugin initialization complete
May 25 17:34:06.097512 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading services supported by the core plugin {{(pid=98883) _load_services_from_core_plugin /opt/stack/neutron/neutron/manager.py:168}}
May 25 17:34:06.098714 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.plugins.ml2.managers [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Got port-security extension from driver 'port_security'
May 25 17:34:06.098714 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.extensions.vlantransparent [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Disabled vlantransparent extension.
May 25 17:34:06.098884 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading service plugins: ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin', 'auto_allocate', 'tag', 'timestamp', 'network_ip_availability', 'flavors', 'revisions'] {{(pid=98883) _load_service_plugins /opt/stack/neutron/neutron/manager.py:194}}
May 25 17:34:06.099091 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading Plugin: router
May 25 17:34:06.137423 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Subscribe: <bound method DVRResourceOperationHandler._add_csnat_on_interface_create of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fcae80b4f70>> router_interface before_create 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:06.137828 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Subscribe: <bound method L3_HA_NAT_db_mixin._after_router_create of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fcae80b4f70>> router after_create 55549900 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:06.138206 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Subscribe: <bound method L3_HA_NAT_db_mixin._before_router_create of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fcae80b4f70>> router before_create 55549900 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:06.138576 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Subscribe: <bound method DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fcae80b4f70>> router_interface before_delete 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:06.138950 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Subscribe: <bound method DVRResourceOperationHandler._cleanup_after_interface_removal of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fcae80b4f70>> router_interface after_delete 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:06.139310 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Subscribe: <bound method L3_HA_NAT_db_mixin._cleanup_ha_network of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fcae80b4f70>> router after_delete 55549900 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:06.139670 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Subscribe: <bound method DVRResourceOperationHandler._create_dvr_floating_gw_port of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fcae80b4f70>> floatingip after_update 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:06.140031 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Subscribe: <bound method DVRResourceOperationHandler._create_snat_interfaces_after_change of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fcae80b4f70>> router after_create 55549900 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:06.140380 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Subscribe: <bound method DVRResourceOperationHandler._create_snat_interfaces_after_change of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fcae80b4f70>> router after_update 55549900 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:06.140729 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Subscribe: <bound method DVRResourceOperationHandler._delete_distributed_port_bindings_after_change of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fcae80b4f70>> router after_update 55549900 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:06.141098 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Subscribe: <bound method DVRResourceOperationHandler._delete_dvr_internal_ports of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fcae80b4f70>> router_gateway after_delete 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:06.141460 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Subscribe: <bound method DVRResourceOperationHandler._delete_snat_interfaces_after_change of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fcae80b4f70>> router after_update 55549900 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:06.141874 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Subscribe: <bound method DVRResourceOperationHandler._handle_distributed_migration of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fcae80b4f70>> router precommit_update 55549900 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:06.142246 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Subscribe: <function L3RpcNotifierMixin._notify_gateway_port_ip_changed at 0x7fcae86cb940> port after_update 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:06.142590 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Subscribe: <function L3RpcNotifierMixin._notify_routers_callback at 0x7fcae86cba60> port after_delete 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:06.142934 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Subscribe: <function L3RpcNotifierMixin._notify_subnet_gateway_ip_update at 0x7fcae86cb9d0> subnet after_update 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:06.143278 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Subscribe: <function L3RpcNotifierMixin._notify_subnetpool_address_scope_update at 0x7fcae86cb820> subnetpool_address_scope after_update 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:06.143649 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Subscribe: <bound method L3_NAT_dbonly_mixin._precommit_delete_port_callback of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fcae80b4f70>> port precommit_delete 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:06.143976 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Subscribe: <bound method L3_HA_NAT_db_mixin._precommit_router_create of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fcae80b4f70>> router precommit_create 55549900 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:06.144318 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Subscribe: <function L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback at 0x7fcae86c3430> port before_delete 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:06.144661 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Subscribe: <bound method RouterAvailabilityZoneMixin._process_az_request of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fcae80b4f70>> router precommit_create 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:06.145017 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Subscribe: <bound method L3_HA_NAT_db_mixin._reconfigure_ha_resources of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fcae80b4f70>> router after_update 55549900 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:06.145396 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Subscribe: <bound method L3_HA_NAT_db_mixin._release_router_vr_id of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fcae80b4f70>> router precommit_delete 55549900 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:06.145739 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Subscribe: <bound method DVRResourceOperationHandler._set_distributed_flag of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fcae80b4f70>> router precommit_create 55549900 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:06.146101 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Subscribe: <bound method DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fcae80b4f70>> router_interface after_create 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:06.146446 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Subscribe: <bound method L3_HA_NAT_db_mixin._validate_migration of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fcae80b4f70>> router precommit_update 55549900 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:06.146817 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Subscribe: <bound method DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fcae80b4f70>> network after_delete 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:06.147675 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.quota.resource_registry [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Tracking information for resource: router configured {{(pid=98883) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
May 25 17:34:06.148006 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.quota.resource_registry [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Tracking information for resource: floatingip configured {{(pid=98883) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
May 25 17:34:06.153455 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.db.l3_agentschedulers_db [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Skipping period L3 agent status check because automatic router rescheduling is disabled.
May 25 17:34:06.154046 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Subscribe: <function _notify_l3_agent_port_update at 0x7fcae802ae50> port after_update 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:06.154412 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Subscribe: <function _notify_l3_agent_new_port at 0x7fcae802ad30> port after_create 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:06.154769 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Subscribe: <function _notify_port_delete at 0x7fcae802adc0> port after_delete 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:06.155131 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Subscribe: <function _notify_l3_agent_ha_port_update at 0x7fcae8030160> port after_update 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:06.155932 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Subscribe: <bound method DriverController._check_router_request of <neutron.services.l3_router.service_providers.driver_controller.DriverController object at 0x7fcae8052760>> router before_create 55550100 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:06.156303 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Subscribe: <bound method DriverController._clear_router_provider of <neutron.services.l3_router.service_providers.driver_controller.DriverController object at 0x7fcae8052760>> router precommit_delete 55550100 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:06.156672 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Subscribe: <bound method DriverController._set_router_provider of <neutron.services.l3_router.service_providers.driver_controller.DriverController object at 0x7fcae8052760>> router precommit_create 55550100 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:06.157035 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Subscribe: <bound method DriverController._update_router_provider of <neutron.services.l3_router.service_providers.driver_controller.DriverController object at 0x7fcae8052760>> router precommit_update 55550100 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:06.161615 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.services.provider_configuration [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Service providers = [] {{(pid=98883) parse_service_provider_opt /opt/stack/neutron/neutron/services/provider_configuration.py:171}}
May 25 17:34:06.161983 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.db.servicetype_db [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Adding provider configuration for service L3_ROUTER_NAT {{(pid=98883) add_provider_configuration /opt/stack/neutron/neutron/db/servicetype_db.py:42}}
May 25 17:34:06.164899 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.services.service_base [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loaded 'neutron.services.l3_router.service_providers.dvrha.DvrHaDriver' provider for service L3_ROUTER_NAT {{(pid=98883) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}}
May 25 17:34:06.165291 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.services.service_base [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loaded 'neutron.services.l3_router.service_providers.dvr.DvrDriver' provider for service L3_ROUTER_NAT {{(pid=98883) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}}
May 25 17:34:06.165640 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.services.service_base [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loaded 'neutron.services.l3_router.service_providers.ha.HaDriver' provider for service L3_ROUTER_NAT {{(pid=98883) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}}
May 25 17:34:06.166525 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.services.service_base [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loaded 'neutron.services.l3_router.service_providers.single_node.SingleNodeDriver' provider for service L3_ROUTER_NAT {{(pid=98883) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}}
May 25 17:34:06.166900 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.services.service_base [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Default provider is not specified for service type L3_ROUTER_NAT
May 25 17:34:06.168025 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Successfully loaded L3_ROUTER_NAT plugin. Description: L3 Router Service Plugin for basic L3 forwarding between (L2) Neutron networks and access to external networks via a NAT gateway. {{(pid=98883) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
May 25 17:34:06.168354 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading Plugin: neutron.services.metering.metering_plugin.MeteringPlugin
May 25 17:34:06.178886 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Successfully loaded METERING plugin. Description: METERING {{(pid=98883) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
May 25 17:34:06.179224 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading Plugin: auto_allocate
May 25 17:34:06.185001 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Subscribe: <function _ensure_external_network_default_value_callback at 0x7fcae8074550> network precommit_update 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:06.185408 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Subscribe: <function _ensure_external_network_default_value_callback at 0x7fcae8074550> network precommit_create 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:06.185937 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Successfully loaded auto-allocated-topology plugin. Description: Auto Allocated Topology - aka get me a network. {{(pid=98883) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
May 25 17:34:06.186256 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading Plugin: tag
May 25 17:34:06.198541 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Successfully loaded TAG plugin. Description: Tag support {{(pid=98883) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
May 25 17:34:06.198874 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading Plugin: timestamp
May 25 17:34:06.202653 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Successfully loaded timestamp plugin. Description: Adds timestamps to Neutron resources with standard attributes {{(pid=98883) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
May 25 17:34:06.202989 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading Plugin: network_ip_availability
May 25 17:34:06.208188 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.services.network_ip_availability.plugin.NetworkIPAvailabilityPlugin object at 0x7fcae8071dc0>> rbac-policy before_create 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:06.208569 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.services.network_ip_availability.plugin.NetworkIPAvailabilityPlugin object at 0x7fcae8071dc0>> rbac-policy before_update 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:06.208933 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.services.network_ip_availability.plugin.NetworkIPAvailabilityPlugin object at 0x7fcae8071dc0>> rbac-policy before_delete 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:06.209678 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Successfully loaded network-ip-availability plugin. Description: Provides IP availability data for each network and subnet. {{(pid=98883) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
May 25 17:34:06.210002 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading Plugin: flavors
May 25 17:34:06.215438 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Successfully loaded FLAVORS plugin. Description: Neutron Flavors and Service Profiles manager plugin {{(pid=98883) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
May 25 17:34:06.215769 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading Plugin: revisions
May 25 17:34:06.220022 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Successfully loaded revision_plugin plugin. Description: Adds revision numbers to resources. {{(pid=98883) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
May 25 17:34:06.220413 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_concurrency.lockutils [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Lock "manager" released by "neutron.manager.NeutronManager._create_instance" :: held 2.262s {{(pid=98883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:34:06.221173 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] get_extension_paths = OrderedDict([('/opt/stack/neutron/neutron/extensions', 1)]) {{(pid=98883) get_extensions_path /opt/stack/neutron/neutron/api/extensions.py:635}}
May 25 17:34:06.221510 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Initializing extension manager.
May 25 17:34:06.222014 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: __init__.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.222357 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: __pycache__ {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.222694 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: _standard_attr_segment_lib.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.223028 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: address_group.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.223780 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="Address group" alias="address-group" description="Support address group" updated="2020-07-15T10:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.224357 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loaded extension: address-group
May 25 17:34:06.224677 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: address_scope.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.225429 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="Address scope" alias="address-scope" description="Address scopes extension." updated="2015-07-26T10:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.225942 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loaded extension: address-scope
May 25 17:34:06.226266 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: admin_state_down_before_update.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.227180 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="Enforce Router's Admin State Down Before Update Extension" alias="router-admin-state-down-before-update" description="Ensure that the admin state of a router is DOWN (admin_state_up=False) before updating the distributed attribute" updated="2019-07-02T15:56:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.227694 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loaded extension: router-admin-state-down-before-update
May 25 17:34:06.228019 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: agent.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.228719 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="agent" alias="agent" description="The agent management extension." updated="2013-02-03T10:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.229272 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loaded extension: agent
May 25 17:34:06.230495 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: agent_resources_synced.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.234946 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="Agent's Resource View Synced to Placement" alias="agent-resources-synced" description="Stores success/failure of last sync to Placement" updated="2018-12-19T00:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.235473 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loaded extension: agent-resources-synced
May 25 17:34:06.235801 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: allowedaddresspairs.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.237626 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="Allowed Address Pairs" alias="allowed-address-pairs" description="Provides allowed address pairs" updated="2013-07-23T10:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.238148 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loaded extension: allowed-address-pairs
May 25 17:34:06.238476 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: auto_allocated_topology.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.239555 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="Auto Allocated Topology Services" alias="auto-allocated-topology" description="Auto Allocated Topology Services." updated="2016-01-01T00:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.240072 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loaded extension: auto-allocated-topology
May 25 17:34:06.240399 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: availability_zone.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.241099 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="Availability Zone" alias="availability_zone" description="The availability zone extension." updated="2015-01-01T10:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.241637 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loaded extension: availability_zone
May 25 17:34:06.241960 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: availability_zone_filter.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.242867 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="Availability Zone Filter Extension" alias="availability_zone_filter" description="Add filter parameters to AvailabilityZone resource" updated="2018-06-22T10:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.243378 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loaded extension: availability_zone_filter
May 25 17:34:06.243700 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: data_plane_status.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.244594 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="Port data plane status extension" alias="data-plane-status" description="Expose status of underlying data plane" updated="2017-01-24T10:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.245122 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Extension data-plane-status not supported by any of loaded plugins
May 25 17:34:06.245472 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: default_subnetpools.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.246370 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="Default Subnetpools" alias="default-subnetpools" description="Provides ability to mark and use a subnetpool as the default." updated="2016-02-18T18:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.246879 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loaded extension: default-subnetpools
May 25 17:34:06.247202 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: dhcpagentscheduler.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.248011 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="DHCP Agent Scheduler" alias="dhcp_agent_scheduler" description="Schedule networks among dhcp agents" updated="2013-02-07T10:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.248523 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loaded extension: dhcp_agent_scheduler
May 25 17:34:06.248878 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: dns.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.249782 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="DNS Integration" alias="dns-integration" description="Provides integration with DNS." updated="2015-08-15T18:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.250286 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Extension dns-integration not supported by any of loaded plugins
May 25 17:34:06.250609 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: dns_domain_ports.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.251522 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="dns_domain for ports" alias="dns-domain-ports" description="Allows the DNS domain to be specified for a network port." updated="2017-04-24T10:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.252033 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Extension dns-domain-ports not supported by any of loaded plugins
May 25 17:34:06.252362 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: dvr.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.253042 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="Distributed Virtual Router" alias="dvr" description="Enables configuration of Distributed Virtual Routers." updated="2014-06-1T10:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.253574 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loaded extension: dvr
May 25 17:34:06.253899 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: empty_string_filtering.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.254802 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="Empty String Filtering Extension" alias="empty-string-filtering" description="Allow filtering by attributes with empty string value" updated="2018-05-01T10:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.255312 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loaded extension: empty-string-filtering
May 25 17:34:06.256046 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: expose_l3_conntrack_helper.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.256522 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="Expose CT target rules for conntrack helper" alias="expose-l3-conntrack-helper" description="Expose allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.257033 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Extension expose-l3-conntrack-helper not supported by any of loaded plugins
May 25 17:34:06.257389 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: expose_port_forwarding_in_fip.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.258282 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="Expose Floating IP port forwardings" alias="expose-port-forwarding-in-fip" description="Expose port forwarding fields in floating IP response" updated="2018-06-28T16:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.258788 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Extension expose-port-forwarding-in-fip not supported by any of loaded plugins
May 25 17:34:06.259107 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: external_net.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.260014 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="Neutron external network" alias="external-net" description="Adds external network attribute to network resource." updated="2013-01-14T10:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.260524 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loaded extension: external-net
May 25 17:34:06.260870 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: extra_dhcp_opt.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.261878 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="Neutron Extra DHCP options" alias="extra_dhcp_opt" description="Extra options configuration for DHCP. For example PXE boot options to DHCP clients can be specified (e.g. tftp-server, server-ip-address, bootfile-name)" updated="2013-03-17T12:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.262396 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loaded extension: extra_dhcp_opt
May 25 17:34:06.262718 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: extraroute.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.263626 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="Neutron Extra Route" alias="extraroute" description="Extra routes configuration for L3 router" updated="2013-02-01T10:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.264138 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loaded extension: extraroute
May 25 17:34:06.264460 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: extraroute_atomic.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.265526 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="Atomically add/remove extra routes" alias="extraroute-atomic" description="Edit extra routes of a router on server side by atomically adding/removing extra routes" updated="2019-07-10T00:00:00+00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.266038 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loaded extension: extraroute-atomic
May 25 17:34:06.266356 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: filter_validation.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.267023 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="Filter parameters validation" alias="filter-validation" description="Provides validation on filter parameters." updated="2018-07-04T10:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.267526 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loaded extension: filter-validation
May 25 17:34:06.267842 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: fip_pf_description.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.268959 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="Floating IP Port Forwarding new attribute description" alias="floating-ip-port-forwarding-description" description="Add a description field to Port Forwarding rules" updated="2019-11-01T10:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.269500 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Extension floating-ip-port-forwarding-description not supported by any of loaded plugins
May 25 17:34:06.269824 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: fip_port_details.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.270738 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="Floating IP Port Details Extension" alias="fip-port-details" description="Add port_details attribute to Floating IP resource" updated="2018-04-09T10:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.271251 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loaded extension: fip-port-details
May 25 17:34:06.271696 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: flavors.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.275763 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="Neutron Service Flavors" alias="flavors" description="Flavor specification for Neutron advanced services." updated="2015-09-17T10:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.276279 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loaded extension: flavors
May 25 17:34:06.277179 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: floating_ip_port_forwarding.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.279061 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="Floating IP Port Forwarding" alias="floating-ip-port-forwarding" description="Allow port forwarding from floating IP port to an internal port" updated="2018-01-19T10:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.279584 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Extension floating-ip-port-forwarding not supported by any of loaded plugins
May 25 17:34:06.279915 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: floatingip_pools.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.280613 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="Floating IP Pools Extension" alias="floatingip-pools" description="Provides a floating IP pools API." updated="2018-03-21T10:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.281151 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loaded extension: floatingip-pools
May 25 17:34:06.281481 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: ip_allocation.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.282396 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="IP Allocation" alias="ip_allocation" description="IP allocation extension." updated="2016-06-10T23:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.282908 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Extension ip_allocation not supported by any of loaded plugins
May 25 17:34:06.283233 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: ip_substring_port_filtering.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.284142 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="IP address substring filtering" alias="ip-substring-filtering" description="Provides IP address substring filtering when listing ports" updated="2017-11-28T09:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.284659 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loaded extension: ip-substring-filtering
May 25 17:34:06.284986 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: l2_adjacency.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.286028 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="L2 Adjacency" alias="l2_adjacency" description="Display L2 Adjacency for Neutron Networks." updated="2016-04-12T16:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.286540 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Extension l2_adjacency not supported by any of loaded plugins
May 25 17:34:06.286861 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: l3.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.287859 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="Neutron L3 Router" alias="router" description="Router abstraction for basic L3 forwarding between L2 Neutron networks and access to external networks via a NAT gateway." updated="2012-07-20T10:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.288377 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loaded extension: router
May 25 17:34:06.288702 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: l3_conntrack_helper.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.290965 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="L3 Conntrack helper" alias="l3-conntrack-helper" description="Allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.291501 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Extension l3-conntrack-helper not supported by any of loaded plugins
May 25 17:34:06.291834 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: l3_ext_gw_mode.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.293461 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="Neutron L3 Configurable external gateway mode" alias="ext-gw-mode" description="Extension of the router abstraction for specifying whether SNAT should occur on the external gateway" updated="2013-03-28T10:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.293993 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loaded extension: ext-gw-mode
May 25 17:34:06.294317 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: l3_ext_ha_mode.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.295260 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="HA Router extension" alias="l3-ha" description="Adds HA capability to routers." updated="2014-04-26T00:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.295769 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loaded extension: l3-ha
May 25 17:34:06.296092 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: l3_flavors.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.297005 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="Router Flavor Extension" alias="l3-flavors" description="Flavor support for routers." updated="2016-05-17T00:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.297555 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loaded extension: l3-flavors
May 25 17:34:06.297882 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: l3_port_ip_change_not_allowed.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.298783 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="Prevent L3 router ports IP address change extension" alias="l3-port-ip-change-not-allowed" description="Prevent change of IP address for some L3 router ports" updated="2018-10-09T10:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.299298 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loaded extension: l3-port-ip-change-not-allowed
May 25 17:34:06.299623 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: l3agentscheduler.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.300663 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="L3 Agent Scheduler" alias="l3_agent_scheduler" description="Schedule routers among l3 agents" updated="2013-02-07T10:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.301217 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loaded extension: l3_agent_scheduler
May 25 17:34:06.301546 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: logging.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.303051 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="Logging API Extension" alias="logging" description="Provides a logging API for resources such as security group and firewall." updated="2017-01-01T10:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.303578 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Extension logging not supported by any of loaded plugins
May 25 17:34:06.303914 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: metering.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.304657 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="Neutron Metering" alias="metering" description="Neutron Metering extension." updated="2013-06-12T10:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.305335 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loaded extension: metering
May 25 17:34:06.305619 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: metering_source_and_destination_fields.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.306772 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="Neutron Metering with source and destination filtering" alias="metering_source_and_destination_fields" description="Neutron Metering extension that enables the use of source and destination IP prefixes to create metering label rules." updated="2020-08-21T08:12:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.307250 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loaded extension: metering_source_and_destination_fields
May 25 17:34:06.307583 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: multiprovidernet.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.308649 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="Multi Provider Network" alias="multi-provider" description="Expose mapping of virtual networks to multiple physical networks" updated="2013-06-27T10:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.309203 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loaded extension: multi-provider
May 25 17:34:06.309541 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: netmtu.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.310449 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="Network MTU" alias="net-mtu" description="Provides MTU attribute for a network resource." updated="2015-03-25T10:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.310967 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loaded extension: net-mtu
May 25 17:34:06.311295 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: netmtu_writable.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.312199 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="Network MTU (writable)" alias="net-mtu-writable" description="Provides a writable MTU attribute for a network resource." updated="2017-07-12T00:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.312750 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loaded extension: net-mtu-writable
May 25 17:34:06.313036 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: network_availability_zone.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.313726 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="Network Availability Zone" alias="network_availability_zone" description="Availability zone support for network." updated="2015-01-01T10:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.314236 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loaded extension: network_availability_zone
May 25 17:34:06.314575 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: network_ip_availability.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.315648 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="Network IP Availability" alias="network-ip-availability" description="Provides IP availability data for each network and subnet." updated="2015-09-24T00:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.316168 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loaded extension: network-ip-availability
May 25 17:34:06.316497 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: network_segment_range.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.317288 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="Neutron Network Segment Range" alias="network-segment-range" description="Provides support for the network segment range management" updated="2018-11-29T00:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.317822 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Extension network-segment-range not supported by any of loaded plugins
May 25 17:34:06.318152 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: pagination.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.319113 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="Pagination support" alias="pagination" description="Extension that indicates that pagination is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.319449 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loaded extension: pagination
May 25 17:34:06.319772 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: port_device_profile.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.320724 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="Port device profile" alias="port-device-profile" description="Expose the port device profile (Cyborg)" updated="2020-12-17T10:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.321213 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loaded extension: port-device-profile
May 25 17:34:06.321544 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: port_mac_address_regenerate.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.327299 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="Neutron Port MAC address regenerate" alias="port-mac-address-regenerate" description="Network port MAC address regenerate" updated="2018-05-03T10:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.327751 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loaded extension: port-mac-address-regenerate
May 25 17:34:06.328074 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: port_numa_affinity_policy.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.328987 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="Port NUMA affinity policy" alias="port-numa-affinity-policy" description="Expose the port NUMA affinity policy" updated="2020-07-08T10:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.329530 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loaded extension: port-numa-affinity-policy
May 25 17:34:06.329859 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: port_resource_request.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.330756 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="Port Resource Request" alias="port-resource-request" description="Expose resource request to Port" updated="2018-05-08T10:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.331262 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Extension port-resource-request not supported by any of loaded plugins
May 25 17:34:06.331583 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: portbindings.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.332497 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="Port Binding" alias="binding" description="Expose port bindings of a virtual port to external application" updated="2014-02-03T10:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.333007 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loaded extension: binding
May 25 17:34:06.333360 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: portbindings_extended.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.334637 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="Port Bindings Extended" alias="binding-extended" description="Expose port bindings of a virtual port to external application" updated="2017-07-17T10:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.335165 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loaded extension: binding-extended
May 25 17:34:06.335493 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: portsecurity.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.336395 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="Port Security" alias="port-security" description="Provides port security" updated="2012-07-23T10:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.336910 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loaded extension: port-security
May 25 17:34:06.337274 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: project_id.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.338270 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="project_id field enabled" alias="project-id" description="Extension that indicates that project_id field is enabled." updated="2016-09-09T09:09:09-09:09" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.338601 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loaded extension: project-id
May 25 17:34:06.339459 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: providernet.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.340439 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="Provider Network" alias="provider" description="Expose mapping of virtual networks to physical networks" updated="2012-09-07T10:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.340955 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loaded extension: provider
May 25 17:34:06.341313 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: qos.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.344864 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="Quality of Service" alias="qos" description="The Quality of Service extension." updated="2015-06-08T10:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.345424 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Extension qos not supported by any of loaded plugins
May 25 17:34:06.345760 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: qos_bw_limit_direction.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.346997 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="Direction for QoS bandwidth limit rule" alias="qos-bw-limit-direction" description="Allow to configure QoS bandwidth limit rule with specific direction: ingress or egress" updated="2017-04-10T10:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.347519 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Extension qos-bw-limit-direction not supported by any of loaded plugins
May 25 17:34:06.347850 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: qos_bw_minimum_ingress.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.348764 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="Ingress direction for QoS minimum bandwidth rule" alias="qos-bw-minimum-ingress" description="Allow to configure QoS minumum bandwidth rule with ingress direction." updated="2018-07-09T10:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.349308 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Extension qos-bw-minimum-ingress not supported by any of loaded plugins
May 25 17:34:06.349635 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: qos_default.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.350545 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="QoS default policy" alias="qos-default" description="Expose the QoS default policy per project" updated="2017-041-06T10:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.351060 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Extension qos-default not supported by any of loaded plugins
May 25 17:34:06.351386 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: qos_fip.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.352035 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="Floating IP QoS" alias="qos-fip" description="The floating IP Quality of Service extension" updated="2017-07-20T00:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.352541 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Extension qos-fip not supported by any of loaded plugins
May 25 17:34:06.352866 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: qos_gateway_ip.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.353819 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="Router gateway IP QoS" alias="qos-gateway-ip" description="The Router gateway IP Quality of Service extension" updated="2018-02-24T00:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.354330 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Extension qos-gateway-ip not supported by any of loaded plugins
May 25 17:34:06.355501 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: qos_port_network_policy.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.356499 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="QoS port network policy ID" alias="qos-port-network-policy" description="Adds a the QoS network ID to the port definition" updated="2019-11-01T10:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.357016 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Extension qos-port-network-policy not supported by any of loaded plugins
May 25 17:34:06.357365 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: qos_rule_type_details.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.358272 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="Details of QoS rule types" alias="qos-rule-type-details" description="Expose details about QoS rule types supported by loaded backend drivers" updated="2017-06-22T10:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.358784 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Extension qos-rule-type-details not supported by any of loaded plugins
May 25 17:34:06.359111 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: qos_rules_alias.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.360176 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="Quality of Service rules alias API" alias="qos-rules-alias" description="API to enable GET, PUT and DELETE operations on QoS policy rules without specifying policy ID" updated="2018-10-07T10:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.360692 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Extension qos-rules-alias not supported by any of loaded plugins
May 25 17:34:06.361019 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: quotasv2.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.362109 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="Quota management support" alias="quotas" description="Expose functions for quotas management per tenant" updated="2012-07-29T10:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.362442 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loaded extension: quotas
May 25 17:34:06.362768 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: quotasv2_detail.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.364370 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="Quota details management support" alias="quota_details" description="Expose functions for quotas usage statistics per project" updated="2017-02-10T10:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.364709 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loaded extension: quota_details
May 25 17:34:06.365039 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: rbac.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.366124 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="RBAC Policies" alias="rbac-policies" description="Allows creation and modification of policies that control tenant access to resources." updated="2015-06-17T12:15:12-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.366645 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loaded extension: rbac-policies
May 25 17:34:06.366976 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: rbac_address_group.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.367892 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="Add address_group type to RBAC" alias="rbac-address-group" description="Add address_group type to network RBAC" updated="2021-01-20T00:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.368415 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loaded extension: rbac-address-group
May 25 17:34:06.368738 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: rbac_address_scope.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.369680 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="Add address_scope type to RBAC" alias="rbac-address-scope" description="Add address_scope type to RBAC" updated="2020-02-12T00:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.370245 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loaded extension: rbac-address-scope
May 25 17:34:06.370976 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: rbac_security_groups.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.372135 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="Add security_group type to network RBAC" alias="rbac-security-groups" description="Add security_group type to network RBAC" updated="2019-02-14T00:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.372651 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loaded extension: rbac-security-groups
May 25 17:34:06.372976 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: rbac_subnetpool.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.373916 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="Add subnetpool type to RBAC" alias="rbac-subnetpool" description="Add subnetpool type to RBAC" updated="2020-02-05T00:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.374430 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loaded extension: rbac-subnetpool
May 25 17:34:06.374755 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: revisionifmatch.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.375665 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="If-Match constraints based on revision_number" alias="revision-if-match" description="Extension indicating that If-Match based on revision_number is supported." updated="2016-12-11T00:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.376196 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loaded extension: revision-if-match
May 25 17:34:06.376503 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: revisions.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.377642 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="Resource revision numbers" alias="standard-attr-revisions" description="This extension will display the revision number of neutron resources." updated="2016-04-11T10:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.378154 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loaded extension: standard-attr-revisions
May 25 17:34:06.378483 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: router_availability_zone.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.379152 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="Router Availability Zone" alias="router_availability_zone" description="Availability zone support for router." updated="2015-01-01T10:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.379669 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loaded extension: router_availability_zone
May 25 17:34:06.379993 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: routerservicetype.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.380910 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="Router Service Type" alias="router-service-type" description="Provides router service type" updated="2013-01-29T00:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.381454 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Extension router-service-type not supported by any of loaded plugins
May 25 17:34:06.381781 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: security_groups_normalized_cidr.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.382691 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="Normalized CIDR field for security group rules" alias="security-groups-normalized-cidr" description="Add new field with normalized remote_ip_prefix cidr in SG rule" updated="2020-07-28T10:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.383213 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loaded extension: security-groups-normalized-cidr
May 25 17:34:06.383539 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: security_groups_port_filtering.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.393627 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="Port filtering on security groups" alias="port-security-groups-filtering" description="Provides security groups filtering when listing ports" updated="2018-01-09T09:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.394144 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loaded extension: port-security-groups-filtering
May 25 17:34:06.394471 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: security_groups_remote_address_group.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.395381 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="Remote address group id field for security group rules" alias="security-groups-remote-address-group" description="Add new field of remote address group id in SG rules" updated="2020-08-25T10:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.395898 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loaded extension: security-groups-remote-address-group
May 25 17:34:06.396222 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: securitygroup.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.406379 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="security-group" alias="security-group" description="The security groups extension." updated="2012-10-05T10:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.406912 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loaded extension: security-group
May 25 17:34:06.407244 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: segment.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.408028 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="Segment" alias="segment" description="Segments extension." updated="2016-02-24T17:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.408540 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Extension segment not supported by any of loaded plugins
May 25 17:34:06.408867 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: segments_peer_subnet_host_routes.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.409824 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="Segments peer-subnet host routes" alias="segments-peer-subnet-host-routes" description="Add host routes to subnets on a routed network (segments)" updated="2018-06-12T10:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.410335 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Extension segments-peer-subnet-host-routes not supported by any of loaded plugins
May 25 17:34:06.410661 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: servicetype.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.411759 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="Neutron Service Type Management" alias="service-type" description="API for retrieving service providers for Neutron advanced services" updated="2013-01-20T00:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.412284 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loaded extension: service-type
May 25 17:34:06.412614 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: sorting.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.413607 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="Sorting support" alias="sorting" description="Extension that indicates that sorting is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.413940 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loaded extension: sorting
May 25 17:34:06.414262 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: standard_attr_segment.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.415162 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="Standard Attribute Segment Extension" alias="standard-attr-segment" description="Add standard attributes to Segment resource" updated="2018-04-09T10:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.415676 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Extension standard-attr-segment not supported by any of loaded plugins
May 25 17:34:06.416001 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: standardattrdescription.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.416639 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="standard-attr-description" alias="standard-attr-description" description="Extension to add descriptions to standard attributes" updated="2016-02-10T10:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.417769 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loaded extension: standard-attr-description
May 25 17:34:06.418091 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: stateful_security_group.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.419004 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="Stateful security group" alias="stateful-security-group" description="Indicates if the security group is stateful or not" updated="2019-11-26T09:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.419522 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loaded extension: stateful-security-group
May 25 17:34:06.419848 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: stdattrs_common.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.420428 dv-cinder-789564-2-iscsi neutron-server[98883]: WARNING neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Did not find expected name "Stdattrs_common" in /opt/stack/neutron/neutron/extensions/stdattrs_common.py
May 25 17:34:06.420749 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: subnet_dns_publish_fixed_ip.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.421818 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="Subnet DNS publish fixed IP" alias="subnet-dns-publish-fixed-ip" description="Support choosing to publish DNS records for IPs from a subnet" updated="2019-05-24T10:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.422335 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Extension subnet-dns-publish-fixed-ip not supported by any of loaded plugins
May 25 17:34:06.422659 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: subnet_onboard.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.423801 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="Subnet Onboard" alias="subnet_onboard" description="Provides support for onboarding subnets into subnet pools" updated="2018-12-18T09:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.424320 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loaded extension: subnet_onboard
May 25 17:34:06.424649 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: subnet_segmentid_writable.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.425717 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="Subnet SegmentID (writable)" alias="subnet-segmentid-writable" description="Provides a writable segment_id attribute for a subnet resource." updated="2018-03-12T00:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.426275 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Extension subnet-segmentid-writable not supported by any of loaded plugins
May 25 17:34:06.426818 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: subnet_service_types.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.427585 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="Subnet service types" alias="subnet-service-types" description="Provides ability to set the subnet service_types field" updated="2016-03-15T18:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.428115 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loaded extension: subnet-service-types
May 25 17:34:06.428448 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: subnetallocation.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.429568 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="Subnet Allocation" alias="subnet_allocation" description="Enables allocation of subnets from a subnet pool" updated="2015-03-30T10:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.430098 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loaded extension: subnet_allocation
May 25 17:34:06.430428 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: subnetpool_prefix_ops.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.431093 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="Subnet Pool Prefix Operations" alias="subnetpool-prefix-ops" description="Provides support for adjusting the prefix list of subnet pools" updated="2019-02-08T10:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.431608 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loaded extension: subnetpool-prefix-ops
May 25 17:34:06.431932 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: tag_ports_during_bulk_creation.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.432983 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="Tag Ports During Bulk Creation" alias="tag-ports-during-bulk-creation" description="Allow to tag ports during bulk creation" updated="2019-12-29T19:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.433524 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Extension tag-ports-during-bulk-creation not supported by any of loaded plugins
May 25 17:34:06.433852 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: tagging.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.434927 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="Tag support for resources with standard attribute: port, subnet, subnetpool, network, security_group, router, floatingip, policy, trunk, network_segment_range" alias="standard-attr-tag" description="Enables to set tag on resources with standard attribute." updated="2017-01-01T00:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.435445 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loaded extension: standard-attr-tag
May 25 17:34:06.435774 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: timestamp.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.436984 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="Resource timestamps" alias="standard-attr-timestamp" description="Adds created_at and updated_at fields to all Neutron resources that have Neutron standard attributes." updated="2016-09-12T10:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.437537 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loaded extension: standard-attr-timestamp
May 25 17:34:06.438005 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: trunk.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.438901 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="Trunk Extension" alias="trunk" description="Provides support for trunk ports" updated="2016-01-01T10:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.439418 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Extension trunk not supported by any of loaded plugins
May 25 17:34:06.439745 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: trunk_details.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.440657 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="Trunk port details" alias="trunk-details" description="Expose trunk port details" updated="2016-01-01T10:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.441207 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Extension trunk-details not supported by any of loaded plugins
May 25 17:34:06.441535 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: uplink_status_propagation.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.442443 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="Uplink status propagation extension" alias="uplink-status-propagation" description="Provides ability to propagate port uplink status." updated="2018-05-31T18:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.442958 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Extension uplink-status-propagation not supported by any of loaded plugins
May 25 17:34:06.443284 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Loading extension file: vlantransparent.py {{(pid=98883) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 25 17:34:06.443952 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Ext name="Vlantransparent" alias="vlan-transparent" description="Provides Vlan Transparent Networks" updated="2015-03-23T09:00:00-00:00" {{(pid=98883) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 25 17:34:06.444462 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Extension vlan-transparent not supported by any of loaded plugins
May 25 17:34:06.446995 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.quota.resource_registry [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Creating instance of TrackedResource for resource:network
May 25 17:34:06.447747 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.quota.resource_registry [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Creating instance of TrackedResource for resource:subnet
May 25 17:34:06.449726 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.quota.resource_registry [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Creating instance of TrackedResource for resource:subnetpool
May 25 17:34:06.450388 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.quota.resource_registry [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Creating instance of TrackedResource for resource:port
May 25 17:34:06.451690 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.v2.resource_helper [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Service L3_ROUTER_NAT assigned prefix:  {{(pid=98883) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 25 17:34:06.452128 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.v2.resource_helper [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Service FLAVORS assigned prefix:  {{(pid=98883) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 25 17:34:06.452759 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.v2.resource_helper [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Service L3_ROUTER_NAT assigned prefix:  {{(pid=98883) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 25 17:34:06.453234 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.v2.resource_helper [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Service L3_ROUTER_NAT assigned prefix:  {{(pid=98883) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 25 17:34:06.453572 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.quota.resource_registry [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Creating instance of TrackedResource for resource:router
May 25 17:34:06.454249 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.quota.resource_registry [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Creating instance of TrackedResource for resource:floatingip
May 25 17:34:06.454960 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.v2.resource_helper [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Service METERING assigned prefix: /metering {{(pid=98883) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 25 17:34:06.456405 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.services.network_ip_availability.plugin.NetworkIPAvailabilityPlugin object at 0x7fcae7f50310>> rbac-policy before_create 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:06.456774 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.services.network_ip_availability.plugin.NetworkIPAvailabilityPlugin object at 0x7fcae7f50310>> rbac-policy before_update 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:06.457157 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.services.network_ip_availability.plugin.NetworkIPAvailabilityPlugin object at 0x7fcae7f50310>> rbac-policy before_delete 55550000 {{(pid=98883) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:34:06.458293 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.quota.resource_registry [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Creating instance of CountableResource for resource:rbac_policy
May 25 17:34:06.458747 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.quota.resource_registry [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Creating instance of TrackedResource for resource:security_group
May 25 17:34:06.459427 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.quota.resource_registry [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Creating instance of TrackedResource for resource:security_group_rule
May 25 17:34:06.460168 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.v2.resource_helper [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Service CORE assigned prefix:  {{(pid=98883) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 25 17:34:06.460501 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.quota.resource_registry [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Creating instance of TrackedResource for resource:subnetpool
May 25 17:34:06.460839 dv-cinder-789564-2-iscsi neutron-server[98883]: WARNING neutron.quota.resource_registry [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] subnetpool is already registered
May 25 17:34:06.461480 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.v2.resource_helper [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Service CORE assigned prefix:  {{(pid=98883) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 25 17:34:06.461813 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.quota.resource_registry [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Creating instance of TrackedResource for resource:subnetpool
May 25 17:34:06.462150 dv-cinder-789564-2-iscsi neutron-server[98883]: WARNING neutron.quota.resource_registry [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] subnetpool is already registered
May 25 17:34:06.465274 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.v2.resource_helper [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Service L3_ROUTER_NAT assigned prefix:  {{(pid=98883) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 25 17:34:06.465716 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.v2.resource_helper [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Service FLAVORS assigned prefix:  {{(pid=98883) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 25 17:34:06.466312 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.v2.resource_helper [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Service L3_ROUTER_NAT assigned prefix:  {{(pid=98883) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 25 17:34:06.466735 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.v2.resource_helper [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Service L3_ROUTER_NAT assigned prefix:  {{(pid=98883) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 25 17:34:06.467068 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.quota.resource_registry [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Creating instance of TrackedResource for resource:router
May 25 17:34:06.467397 dv-cinder-789564-2-iscsi neutron-server[98883]: WARNING neutron.quota.resource_registry [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] router is already registered
May 25 17:34:06.467996 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.quota.resource_registry [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Creating instance of TrackedResource for resource:floatingip
May 25 17:34:06.468325 dv-cinder-789564-2-iscsi neutron-server[98883]: WARNING neutron.quota.resource_registry [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] floatingip is already registered
May 25 17:34:06.468962 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.v2.resource_helper [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Service METERING assigned prefix: /metering {{(pid=98883) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 25 17:34:06.469661 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.quota.resource_registry [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Creating instance of CountableResource for resource:rbac_policy
May 25 17:34:06.469991 dv-cinder-789564-2-iscsi neutron-server[98883]: WARNING neutron.quota.resource_registry [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] rbac_policy is already registered
May 25 17:34:06.470539 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.quota.resource_registry [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Creating instance of TrackedResource for resource:security_group
May 25 17:34:06.470866 dv-cinder-789564-2-iscsi neutron-server[98883]: WARNING neutron.quota.resource_registry [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] security_group is already registered
May 25 17:34:06.471465 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.quota.resource_registry [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Creating instance of TrackedResource for resource:security_group_rule
May 25 17:34:06.471804 dv-cinder-789564-2-iscsi neutron-server[98883]: WARNING neutron.quota.resource_registry [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] security_group_rule is already registered
May 25 17:34:06.472485 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.v2.resource_helper [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Service CORE assigned prefix:  {{(pid=98883) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 25 17:34:06.472817 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.quota.resource_registry [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Creating instance of TrackedResource for resource:subnetpool
May 25 17:34:06.473172 dv-cinder-789564-2-iscsi neutron-server[98883]: WARNING neutron.quota.resource_registry [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] subnetpool is already registered
May 25 17:34:06.473782 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.v2.resource_helper [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Service CORE assigned prefix:  {{(pid=98883) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 25 17:34:06.474109 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.quota.resource_registry [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Creating instance of TrackedResource for resource:subnetpool
May 25 17:34:06.474432 dv-cinder-789564-2-iscsi neutron-server[98883]: WARNING neutron.quota.resource_registry [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] subnetpool is already registered
May 25 17:34:06.475087 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Extended resource: extensions {{(pid=98883) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 25 17:34:06.476641 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Extended resource: address-groups {{(pid=98883) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 25 17:34:06.478336 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Extended resource: address-scopes {{(pid=98883) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 25 17:34:06.479629 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Extended resource: agents {{(pid=98883) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 25 17:34:06.481607 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Extended resource: auto-allocated-topology {{(pid=98883) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 25 17:34:06.482885 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Extended resource: availability_zones {{(pid=98883) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 25 17:34:06.484208 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Extended resource: dhcp-networks {{(pid=98883) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 25 17:34:06.485683 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Extended resource: dhcp-agents {{(pid=98883) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 25 17:34:06.487109 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Extended resource: routers {{(pid=98883) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 25 17:34:06.488928 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Extended resource: flavors {{(pid=98883) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 25 17:34:06.490145 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Extended resource: service_profiles {{(pid=98883) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 25 17:34:06.491377 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Extended resource: next_providers {{(pid=98883) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 25 17:34:06.492912 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Extended resource: service_profiles {{(pid=98883) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 25 17:34:06.494407 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Extended resource: floatingip-pools {{(pid=98883) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 25 17:34:06.495790 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Extended resource: routers {{(pid=98883) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 25 17:34:06.497651 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Extended resource: floatingips {{(pid=98883) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 25 17:34:06.498858 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Extended resource: l3-routers {{(pid=98883) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 25 17:34:06.500259 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Extended resource: l3-agents {{(pid=98883) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 25 17:34:06.501707 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Extended resource: metering-labels {{(pid=98883) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 25 17:34:06.503063 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Extended resource: metering-label-rules {{(pid=98883) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 25 17:34:06.504417 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Extended resource: network-ip-availabilities {{(pid=98883) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 25 17:34:06.505719 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Extended resource: bindings {{(pid=98883) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 25 17:34:06.507409 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Extended resource: quotas {{(pid=98883) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 25 17:34:06.508872 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Extended resource: quotas {{(pid=98883) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 25 17:34:06.510348 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Extended resource: rbac-policies {{(pid=98883) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 25 17:34:06.512181 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Extended resource: security-groups {{(pid=98883) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 25 17:34:06.513448 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Extended resource: security-group-rules {{(pid=98883) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 25 17:34:06.514686 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Extended resource: service-providers {{(pid=98883) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 25 17:34:06.515924 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Extended resource: subnetpools {{(pid=98883) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 25 17:34:06.518361 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Extended resource: subnetpools {{(pid=98883) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 25 17:34:06.519824 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Extended resource: tags {{(pid=98883) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 25 17:34:06.521598 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Extended resource: tags {{(pid=98883) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 25 17:34:06.634519 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Extended resource: tags {{(pid=98883) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 25 17:34:06.636818 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Extended resource: tags {{(pid=98883) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 25 17:34:06.638632 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Extended resource: tags {{(pid=98883) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 25 17:34:06.640607 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Extended resource: tags {{(pid=98883) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 25 17:34:06.642366 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Extended resource: tags {{(pid=98883) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 25 17:34:06.644303 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Extended resource: tags {{(pid=98883) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 25 17:34:06.646119 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Extended resource: tags {{(pid=98883) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 25 17:34:06.648010 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron.api.extensions [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Extended resource: tags {{(pid=98883) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 25 17:34:06.654566 dv-cinder-789564-2-iscsi neutron-server[98883]: WARNING keystonemiddleware.auth_token [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True.
May 25 17:34:06.659295 dv-cinder-789564-2-iscsi neutron-server[98883]: WARNING keystonemiddleware.auth_token [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
May 25 17:34:06.667829 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_concurrency.lockutils [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Acquired lock "singleton_lock" {{(pid=98883) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}}
May 25 17:34:06.668310 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_concurrency.lockutils [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Releasing lock "singleton_lock" {{(pid=98883) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}}
May 25 17:34:06.668951 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO oslo_service.service [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Starting 2 workers
May 25 17:34:06.673728 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Started child 99026 {{(pid=98883) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}}
May 25 17:34:06.678158 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Started child 99027 {{(pid=98883) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}}
May 25 17:34:06.678966 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:34:06.679743 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO neutron.service [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Neutron service started, listening on 0.0.0.0:9696
May 25 17:34:06.680382 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Notify callbacks [] for process, before_spawn {{(pid=98883) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:34:06.680552 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [-] (99026) wsgi starting up on http://0.0.0.0:9696
May 25 17:34:06.683002 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:34:06.683526 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO oslo_service.service [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Starting 1 workers
May 25 17:34:06.684332 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [-] (99027) wsgi starting up on http://0.0.0.0:9696
May 25 17:34:06.688333 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Started child 99028 {{(pid=98883) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}}
May 25 17:34:06.688858 dv-cinder-789564-2-iscsi neutron-server[98883]: INFO oslo_service.service [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Starting 1 workers
May 25 17:34:06.691748 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.service [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] calling RpcWorker wait() {{(pid=99028) _wait /opt/stack/neutron/neutron/service.py:128}}
May 25 17:34:06.692310 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.service [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] returning from RpcWorker wait() {{(pid=99028) _wait /opt/stack/neutron/neutron/service.py:135}}
May 25 17:34:06.693381 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Started child 99029 {{(pid=98883) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}}
May 25 17:34:06.693669 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:34:06.694150 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG neutron_lib.callbacks.manager [None req-67689ff4-2339-4f35-b4c7-3edd6a0e37cb None None] Notify callbacks [] for process, after_spawn {{(pid=98883) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:34:06.694245 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.plugin [-] neutron.plugins.ml2.plugin.Ml2Plugin method start_rpc_listeners called with arguments () {} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:34:06.696103 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=98883) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:650}}
May 25 17:34:06.696343 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}}
May 25 17:34:06.696533 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}}
May 25 17:34:06.696751 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}}
May 25 17:34:06.697125 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}}
May 25 17:34:06.697296 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}}
May 25 17:34:06.697788 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] agent_down_time                = 75 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.698068 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover  = True {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.698883 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=99029) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:34:06.699541 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.699541 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] allow_bulk                     = True {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.699541 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] allow_overlapping_ips          = True {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.700007 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=99029) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:34:06.700160 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] allowed_conntrack_helpers      = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.700345 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] api_extensions_path            =  {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.700603 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] api_paste_config               = api-paste.ini {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.700885 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] api_workers                    = 2 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.701177 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] auth_strategy                  = keystone {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.701359 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] backdoor_port                  = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.701528 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] backdoor_socket                = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.701953 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] backlog                        = 4096 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.702207 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] base_mac                       = fa:16:3e:00:00:00 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.702550 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] bind_host                      = 0.0.0.0 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.702836 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] bind_port                      = 9696 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.703088 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] client_socket_timeout          = 900 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.703383 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] config_dir                     = [] {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.703567 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] config_file                    = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.703796 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] config_source                  = [] {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.704103 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] control_exchange               = neutron {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.704292 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] core_plugin                    = ml2 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.704562 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] debug                          = True {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.704808 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] default_availability_zones     = [] {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.705323 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.705558 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] dhcp_agent_notification        = True {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.705839 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] dhcp_agents_per_network        = 1 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.706063 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] dhcp_lease_duration            = 86400 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.706332 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] dhcp_load_type                 = networks {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.706584 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] dns_domain                     = openstacklocal {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.706884 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] dvr_base_mac                   = fa:16:3f:00:00:00 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.707121 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] enable_dvr                     = True {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.707340 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] enable_new_agents              = True {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.707581 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.707833 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] enable_snat_by_default         = True {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.708092 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] enable_traditional_dhcp        = True {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.708324 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] external_dns_driver            = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.708561 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] filter_validation              = True {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.708824 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] global_physnet_mtu             = 1500 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.709122 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] graceful_shutdown_timeout      = 60 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.709588 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] host                           = dv-cinder-789564-2-iscsi {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.709814 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] host_dvr_for_dhcp              = True {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.710045 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] http_retries                   = 3 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.710302 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] instance_format                = [instance: %(uuid)s]  {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.710556 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.710812 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] ipam_driver                    = internal {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.711054 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] ipv6_pd_enabled                = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.711315 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] l3_ha                          = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.711566 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] l3_ha_net_cidr                 = 169.254.192.0/18 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.711825 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] l3_ha_network_physical_name    =  {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.712077 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] l3_ha_network_type             =  {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.712327 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] log_config_append              = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.712578 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.712826 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] log_dir                        = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.713107 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] log_file                       = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.713252 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] log_options                    = True {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.713479 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] log_rotate_interval            = 1 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.713754 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] log_rotate_interval_type       = days {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.714643 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] log_rotation_type              = none {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.714847 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.715722 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.715722 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.715722 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.715722 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] logging_user_identity_format   = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.716259 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] max_allowed_address_pair       = 10 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.716259 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] max_dns_nameservers            = 5 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.716259 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] max_header_line                = 16384 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.716641 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] max_l3_agents_per_router       = 3 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.716641 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] max_logfile_count              = 30 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.716915 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] max_logfile_size_mb            = 200 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.717189 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] max_routes                     = 30 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.717367 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] max_subnet_host_routes         = 20 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.717617 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] network_auto_schedule          = True {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.717832 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] network_link_prefix            = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.718084 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] network_scheduler_driver       = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.718314 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.718543 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.718774 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] pagination_max_limit           = -1 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.718994 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] periodic_fuzzy_delay           = 5 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.719245 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] periodic_interval              = 40 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.719440 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] publish_errors                 = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.719661 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] rate_limit_burst               = 0 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.719893 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] rate_limit_except_level        = CRITICAL {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.720111 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] rate_limit_interval            = 0 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.720324 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] retry_until_window             = 30 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.720567 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] router_auto_schedule           = True {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.720784 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] router_distributed             = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.721044 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] router_scheduler_driver        = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.721330 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] rpc_response_max_timeout       = 600 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.721576 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] rpc_response_timeout           = 60 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.721808 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] rpc_state_report_workers       = 0 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.722039 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] rpc_workers                    = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.722260 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] send_events_interval           = 2 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.723423 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] service_plugins                = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.723423 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] setproctitle                   = on {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.723423 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] state_path                     = /opt/stack/data/neutron {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.723674 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] syslog_log_facility            = LOG_USER {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.723753 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] tcp_keepidle                   = 600 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.723971 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] transport_url                  = **** {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.724813 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] use_eventlog                   = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.725354 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] use_journal                    = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.725558 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] use_json                       = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.725804 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] use_ssl                        = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.726042 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] use_stderr                     = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.726319 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] use_syslog                     = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.726552 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] vlan_transparent               = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.726798 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] watch_log_file                 = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.727026 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] wsgi_default_pool_size         = 100 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.727284 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] wsgi_keep_alive                = True {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.727531 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] wsgi_log_format                = %(client_ip)s "%(request_line)s" status: %(status_code)s  len: %(body_length)s time: %(wall_seconds).7f {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.727972 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.728273 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path     = /opt/stack/data/neutron/lock {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.728579 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] profiler.connection_string     = messaging:// {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.728832 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] profiler.enabled               = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.729073 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] profiler.es_doc_type           = notification {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.729353 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] profiler.es_scroll_size        = 10000 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.730241 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] profiler.es_scroll_time        = 2m {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.730495 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] profiler.filter_error_trace    = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.730737 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] profiler.hmac_keys             = SECRET_KEY {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.730978 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.731305 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] profiler.socket_timeout        = 0.1 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.731536 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy      = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.731838 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.732071 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope      = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.732350 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.732688 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.732954 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] oslo_policy.policy_file        = /etc/neutron/policy.json {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.733265 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.733509 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.733750 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.738195 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.738195 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.738195 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] nova.auth_section              = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.738195 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] nova.auth_type                 = password {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.738195 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] nova.auth_url                  = http://10.222.0.122/identity {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.738195 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] nova.cafile                    = /opt/stack/data/ca-bundle.pem {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.738195 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] nova.certfile                  = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.738195 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] nova.collect_timing            = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.739433 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] nova.default_domain_id         = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.739433 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] nova.default_domain_name       = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.739433 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] nova.domain_id                 = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.739433 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] nova.domain_name               = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.739433 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] nova.endpoint_type             = public {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.739433 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] nova.insecure                  = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.739433 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] nova.keyfile                   = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.739433 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] nova.live_migration_events     = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.739433 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] nova.password                  = **** {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.740622 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] nova.project_domain_id         = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.740622 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] nova.project_domain_name       = Default {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.740622 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] nova.project_id                = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.740622 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] nova.project_name              = service {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.740622 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] nova.region_name               = RegionOne {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.740622 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] nova.split_loggers             = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.740622 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] nova.system_scope              = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.740622 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] nova.timeout                   = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.740622 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] nova.trust_id                  = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.742037 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] nova.user_domain_id            = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.742037 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] nova.user_domain_name          = Default {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.742037 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] nova.user_id                   = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.742037 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] nova.username                  = nova {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.742037 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] placement.auth_section         = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.742037 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] placement.auth_type            = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.742037 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] placement.cafile               = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.742037 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] placement.certfile             = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.742037 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] placement.collect_timing       = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.744518 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] placement.endpoint_type        = public {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.744518 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] placement.insecure             = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.744518 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] placement.keyfile              = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.744518 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] placement.region_name          = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.744518 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] placement.split_loggers        = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.744518 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] placement.timeout              = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.744518 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] ironic.auth_section            = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.744518 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] ironic.auth_type               = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.744518 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] ironic.cafile                  = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.745279 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] ironic.certfile                = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.745279 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] ironic.collect_timing          = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.745279 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] ironic.connect_retries         = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.745279 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] ironic.connect_retry_delay     = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.745279 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] ironic.enable_notifications    = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.745279 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] ironic.endpoint_override       = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.745279 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] ironic.insecure                = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.745937 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] ironic.interface               = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.745937 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] ironic.keyfile                 = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.745937 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] ironic.max_version             = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.746154 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] ironic.min_version             = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.746406 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] ironic.region_name             = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.746649 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] ironic.service_name            = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.747659 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] ironic.service_type            = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.747659 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] ironic.split_loggers           = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.747659 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] ironic.status_code_retries     = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.747659 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.751098 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] ironic.timeout                 = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.751098 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] ironic.valid_interfaces        = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.751098 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] ironic.version                 = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.751098 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.751098 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.751098 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.751098 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.751098 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.751663 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.751663 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.751663 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.751663 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.751663 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.751663 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.751663 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.751663 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.752224 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.752224 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.752224 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.752224 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.752827 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.752827 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.753071 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.753071 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.753354 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.753626 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl      = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.755048 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.755048 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.755048 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file =  {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.755048 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version =  {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.755048 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.756451 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.756451 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.756451 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.757178 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.757476 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] QUOTAS.default_quota           = -1 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.759174 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] QUOTAS.quota_driver            = neutron.db.quota.driver.DbQuotaDriver {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.759174 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip        = 50 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.759174 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] QUOTAS.quota_network           = 100 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.759174 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] QUOTAS.quota_port              = 500 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.759710 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy       = 10 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.759710 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] QUOTAS.quota_router            = 100 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.759965 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group    = 100 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.760102 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.760324 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet            = 100 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.760574 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage       = True {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.761400 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.761969 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] healthcheck.backends           = ['disable_by_file'] {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.762134 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] healthcheck.detailed           = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.762261 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.762453 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] healthcheck.path               = /healthcheck {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.762763 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.762992 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.764377 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.764377 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user  = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.764377 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix =  {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.764377 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.764377 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port   = 35357 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.765109 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.765109 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.765109 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type   = password {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.765481 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri    = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.765481 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url    = http://10.222.0.122/identity {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.765721 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.766796 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.cache       = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.766796 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.766796 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.certfile    = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.766796 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.767355 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.767355 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.767639 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id   = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.767824 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.768075 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.768298 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.768518 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.768752 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.768970 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.769228 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.insecure    = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.769477 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.interface   = public {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.769689 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile     = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.769908 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.770143 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.770448 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.770680 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.770896 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.770985 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 38322) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:34:06.771112 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.771371 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.771589 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.771858 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.772108 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.password    = **** {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.772326 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.772572 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.772816 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.project_id  = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.773230 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.773594 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.773841 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.774065 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.774279 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.774514 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.774752 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.774967 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id    = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.775209 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.775437 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.775652 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.user_id     = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.776054 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.username    = neutron {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.776289 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.777223 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] cache.backend                  = dogpile.cache.null {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.777502 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] cache.backend_argument         = **** {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.777697 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] cache.config_prefix            = cache.oslo {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.777948 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] cache.debug_cache_backend      = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.778166 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] cache.enabled                  = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.778400 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] cache.expiration_time          = 600 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.778643 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] cache.memcache_dead_retry      = 300 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.778867 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.779070 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.779287 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize    = 10 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.779499 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.779752 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] cache.memcache_servers         = ['localhost:11211'] {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.780006 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout  = 1.0 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.780242 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] cache.proxies                  = [] {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.780454 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers      = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.780663 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] cache.tls_cafile               = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.780869 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] cache.tls_certfile             = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.781119 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] cache.tls_enabled              = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.781345 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] cache.tls_keyfile              = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.781648 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] privsep.capabilities           = [21, 12, 1, 2, 19] {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.781872 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] privsep.group                  = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.782117 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] privsep.helper_command         = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.782352 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] privsep.thread_pool_size       = 4 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.782588 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] privsep.user                   = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.782823 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.783034 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] privsep_dhcp_release.group     = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.783238 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.783454 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.783661 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] privsep_dhcp_release.user      = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.783898 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.784127 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group        = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.784331 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.784552 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.784757 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user         = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.784980 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.785233 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] privsep_namespace.group        = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.785462 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.785677 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.785883 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] privsep_namespace.user         = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.786105 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.786310 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] privsep_conntrack.group        = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.786517 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.786730 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.786959 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] privsep_conntrack.user         = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.787296 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] AGENT.root_helper              = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.787553 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon       = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.787774 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read   = True {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.788557 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset     = True {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.788557 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.788724 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [-] 10.222.0.122 "GET / HTTP/1.1" status: 200  len: 254 time: 0.0154090
May 25 17:34:06.789118 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver  = openvswitch {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.789392 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.790690 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] ml2.extension_drivers          = ['port_security'] {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.790965 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] ml2.external_network_type      = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.791912 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] ml2.mechanism_drivers          = ['openvswitch', 'hyperv'] {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.792456 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] ml2.overlay_ip_version         = 4 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.792686 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] ml2.path_mtu                   = 0 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.792916 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] ml2.physical_network_mtus      = [] {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.793981 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] ml2.tenant_network_types       = ['vlan'] {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.793981 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] ml2.type_drivers               = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.793981 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks    = ['physnet1'] {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.794196 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.794333 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges     = ['1:1000'] {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.794601 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges  = ['1:1000'] {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.794894 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:1300:1349'] {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.795144 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges      = ['1:1000'] {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.795378 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group     = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.795688 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.796036 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] database.backend               = sqlalchemy {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.796391 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] database.connection            = **** {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.796689 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] database.connection_debug      = 0 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.796875 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] database.connection_parameters =  {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.797170 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.797421 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] database.connection_trace      = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.797645 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.797876 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] database.db_max_retries        = 20 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.798107 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.798319 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] database.db_retry_interval     = 1 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.799426 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] database.max_overflow          = 50 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.799717 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] database.max_pool_size         = 50 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.799914 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] database.max_retries           = 10 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.800159 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] database.mysql_enable_ndb      = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.800390 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] database.mysql_sql_mode        = TRADITIONAL {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.800635 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] database.pool_timeout          = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.800874 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] database.retry_interval        = 10 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.801144 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] database.slave_connection      = **** {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.801384 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] database.sqlite_synchronous    = True {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.801596 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] database.use_db_reconnect      = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.801742 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}}
May 25 17:34:06.802362 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=98883) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:650}}
May 25 17:34:06.802514 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}}
May 25 17:34:06.802654 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}}
May 25 17:34:06.802837 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}}
May 25 17:34:06.802994 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}}
May 25 17:34:06.803135 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}}
May 25 17:34:06.803333 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] agent_down_time                = 75 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.803489 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover  = True {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.803675 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.803820 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] allow_bulk                     = True {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.803959 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] allow_overlapping_ips          = True {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.804120 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] allowed_conntrack_helpers      = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.804268 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] api_extensions_path            =  {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.804415 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] api_paste_config               = api-paste.ini {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.804554 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] api_workers                    = 2 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.804702 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] auth_strategy                  = keystone {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.804862 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] backdoor_port                  = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.805006 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] backdoor_socket                = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.805174 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] backlog                        = 4096 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.805316 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] base_mac                       = fa:16:3e:00:00:00 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.805476 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] bind_host                      = 0.0.0.0 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.805620 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] bind_port                      = 9696 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.805865 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] client_socket_timeout          = 900 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.806038 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] config_dir                     = [] {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.806209 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] config_file                    = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.806209 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] config_source                  = [] {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.806542 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] control_exchange               = neutron {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.806542 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] core_plugin                    = ml2 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.806867 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] debug                          = True {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.806867 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] default_availability_zones     = [] {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.807157 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.807157 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] dhcp_agent_notification        = True {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.807479 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] dhcp_agents_per_network        = 1 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.807479 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] dhcp_lease_duration            = 86400 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.807842 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] dhcp_load_type                 = networks {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.807842 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] dns_domain                     = openstacklocal {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.807842 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] dvr_base_mac                   = fa:16:3f:00:00:00 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.808388 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] enable_dvr                     = True {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.808388 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] enable_new_agents              = True {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.808388 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.808787 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] enable_snat_by_default         = True {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.808787 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] enable_traditional_dhcp        = True {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.808787 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] external_dns_driver            = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.809230 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] filter_validation              = True {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.809230 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] global_physnet_mtu             = 1500 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.809230 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] graceful_shutdown_timeout      = 60 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.809635 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] host                           = dv-cinder-789564-2-iscsi {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.809635 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] host_dvr_for_dhcp              = True {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.809635 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] http_retries                   = 3 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.810018 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] instance_format                = [instance: %(uuid)s]  {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.810791 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.810954 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] ipam_driver                    = internal {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.811112 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] ipv6_pd_enabled                = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.811969 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] l3_ha                          = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.811969 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] l3_ha_net_cidr                 = 169.254.192.0/18 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.811969 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] l3_ha_network_physical_name    =  {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.811969 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] l3_ha_network_type             =  {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.811969 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] log_config_append              = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.811969 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.812842 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] log_dir                        = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.812842 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] log_file                       = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.812842 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] log_options                    = True {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.812842 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] log_rotate_interval            = 1 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.812842 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] log_rotate_interval_type       = days {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.812842 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] log_rotation_type              = none {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.813486 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.813975 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.814140 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.814372 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.814945 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] logging_user_identity_format   = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.814945 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] max_allowed_address_pair       = 10 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.814945 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] max_dns_nameservers            = 5 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.814945 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] max_header_line                = 16384 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.816161 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] max_l3_agents_per_router       = 3 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.816161 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] max_logfile_count              = 30 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.816161 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] max_logfile_size_mb            = 200 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.816161 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] max_routes                     = 30 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.817001 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] max_subnet_host_routes         = 20 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.817001 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] network_auto_schedule          = True {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.817001 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] network_link_prefix            = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.817001 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] network_scheduler_driver       = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.817001 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.817618 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.817618 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] pagination_max_limit           = -1 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.817618 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] periodic_fuzzy_delay           = 5 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.817618 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] periodic_interval              = 40 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.818215 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] publish_errors                 = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.818215 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] rate_limit_burst               = 0 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.818215 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] rate_limit_except_level        = CRITICAL {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.818215 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] rate_limit_interval            = 0 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.818215 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] retry_until_window             = 30 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.818717 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] router_auto_schedule           = True {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.818717 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] router_distributed             = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.818717 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] router_scheduler_driver        = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.818928 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] rpc_response_max_timeout       = 600 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.818928 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] rpc_response_timeout           = 60 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.819073 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] rpc_state_report_workers       = 0 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.819234 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] rpc_workers                    = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.819432 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] send_events_interval           = 2 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.819594 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] service_plugins                = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.819799 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] setproctitle                   = on {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.819944 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] state_path                     = /opt/stack/data/neutron {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.820084 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] syslog_log_facility            = LOG_USER {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.820221 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] tcp_keepidle                   = 600 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.820360 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] transport_url                  = **** {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.820514 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] use_eventlog                   = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.820651 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] use_journal                    = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.820789 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] use_json                       = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.820937 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] use_ssl                        = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.821125 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] use_stderr                     = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.821273 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] use_syslog                     = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.821412 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] vlan_transparent               = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.821549 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] watch_log_file                 = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.821686 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] wsgi_default_pool_size         = 100 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.821825 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] wsgi_keep_alive                = True {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.821964 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] wsgi_log_format                = %(client_ip)s "%(request_line)s" status: %(status_code)s  len: %(body_length)s time: %(wall_seconds).7f {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 25 17:34:06.822104 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.822255 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path     = /opt/stack/data/neutron/lock {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.822420 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] profiler.connection_string     = messaging:// {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.822561 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] profiler.enabled               = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.822711 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] profiler.es_doc_type           = notification {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.822850 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] profiler.es_scroll_size        = 10000 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.822989 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] profiler.es_scroll_time        = 2m {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.823127 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] profiler.filter_error_trace    = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.823795 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] profiler.hmac_keys             = SECRET_KEY {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.824354 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.825816 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] profiler.socket_timeout        = 0.1 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.825816 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy      = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.825816 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.826188 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope      = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.826188 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.826442 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.826566 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] oslo_policy.policy_file        = /etc/neutron/policy.json {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.826691 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.826939 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.827083 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.827262 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.827437 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.827629 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] nova.auth_section              = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.827794 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] nova.auth_type                 = password {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.827966 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] nova.auth_url                  = http://10.222.0.122/identity {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.828134 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] nova.cafile                    = /opt/stack/data/ca-bundle.pem {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.828301 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] nova.certfile                  = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.828468 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] nova.collect_timing            = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.828619 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] nova.default_domain_id         = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.828791 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] nova.default_domain_name       = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.828955 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] nova.domain_id                 = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.829171 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] nova.domain_name               = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.829339 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] nova.endpoint_type             = public {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.829499 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] nova.insecure                  = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.830574 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] nova.keyfile                   = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.830574 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] nova.live_migration_events     = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.830574 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] nova.password                  = **** {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.830574 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] nova.project_domain_id         = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.830574 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] nova.project_domain_name       = Default {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.830911 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] nova.project_id                = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.830911 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] nova.project_name              = service {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.831028 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] nova.region_name               = RegionOne {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.831250 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] nova.split_loggers             = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.831854 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] nova.system_scope              = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.832064 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] nova.timeout                   = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.832271 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] nova.trust_id                  = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.832428 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] nova.user_domain_id            = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.832555 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] nova.user_domain_name          = Default {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.832753 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] nova.user_id                   = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.837211 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] nova.username                  = nova {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.837445 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] placement.auth_section         = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.837632 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] placement.auth_type            = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.837814 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] placement.cafile               = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.837993 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] placement.certfile             = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.838170 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] placement.collect_timing       = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.838336 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] placement.endpoint_type        = public {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.838517 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] placement.insecure             = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.838680 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] placement.keyfile              = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.838852 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] placement.region_name          = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.839118 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] placement.split_loggers        = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.839855 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] placement.timeout              = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.840071 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] ironic.auth_section            = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.840219 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] ironic.auth_type               = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.840747 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] ironic.cafile                  = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.840966 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] ironic.certfile                = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.842141 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] ironic.collect_timing          = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.842364 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] ironic.connect_retries         = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.842508 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] ironic.connect_retry_delay     = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.842805 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] ironic.enable_notifications    = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.843199 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] ironic.endpoint_override       = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.843458 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] ironic.insecure                = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.843724 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] ironic.interface               = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.844744 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] ironic.keyfile                 = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.845227 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] ironic.max_version             = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.845603 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] ironic.min_version             = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.845968 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] ironic.region_name             = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.846328 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] ironic.service_name            = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.846750 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] ironic.service_type            = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.847092 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] ironic.split_loggers           = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.847417 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] ironic.status_code_retries     = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.847742 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.848068 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] ironic.timeout                 = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.848418 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] ironic.valid_interfaces        = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.848725 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] ironic.version                 = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.849034 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.849323 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.849427 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.849592 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.849762 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.849933 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.850131 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.850340 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.850504 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.850675 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.850821 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.851134 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.851315 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.851455 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.852191 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.852191 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.852191 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.852191 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.852191 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.852531 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.852531 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.852651 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.852846 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl      = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.852960 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.853152 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.853345 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file =  {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.853463 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version =  {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.853779 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.853953 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.854107 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.854270 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.854498 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.854624 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] QUOTAS.default_quota           = -1 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.855293 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] QUOTAS.quota_driver            = neutron.db.quota.driver.DbQuotaDriver {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.855407 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip        = 50 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.855516 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] QUOTAS.quota_network           = 100 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.855673 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] QUOTAS.quota_port              = 500 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.856750 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy       = 10 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.857107 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] QUOTAS.quota_router            = 100 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.857302 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group    = 100 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.857453 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.857636 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet            = 100 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.857792 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage       = True {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.857958 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.858105 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] healthcheck.backends           = ['disable_by_file'] {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.858270 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] healthcheck.detailed           = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.858364 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:34:06.858442 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.858594 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] healthcheck.path               = /healthcheck {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.859490 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.859490 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.859490 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.859490 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user  = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.859490 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix =  {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.859490 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.859877 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port   = 35357 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.859877 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.859997 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.860214 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type   = password {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.860214 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri    = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.860439 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url    = http://10.222.0.122/identity {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.860583 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.860725 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.cache       = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.860869 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.861011 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.certfile    = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.861238 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.861401 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.861543 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.861688 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id   = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.861842 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.862004 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.862161 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.862320 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.862478 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.862637 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.862795 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.insecure    = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.862952 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.interface   = public {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.863110 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile     = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.863268 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.863426 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.863584 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.863743 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.863901 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.864059 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.864217 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.864375 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.864536 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.864694 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.password    = **** {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.864853 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.865011 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.865204 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.project_id  = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.865364 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.865523 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.865688 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.865847 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.866006 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.866176 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.866371 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.866484 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id    = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.866617 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.866775 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.866934 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.user_id     = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.867092 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.username    = neutron {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.867250 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.867423 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] cache.backend                  = dogpile.cache.null {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.867598 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] cache.backend_argument         = **** {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.867730 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] cache.config_prefix            = cache.oslo {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.867889 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] cache.debug_cache_backend      = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.868048 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] cache.enabled                  = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.868230 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] cache.expiration_time          = 600 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.868360 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] cache.memcache_dead_retry      = 300 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.868519 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.868676 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.868839 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize    = 10 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.868997 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.869200 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] cache.memcache_servers         = ['localhost:11211'] {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.869363 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout  = 1.0 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.869522 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] cache.proxies                  = [] {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.869681 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers      = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.870560 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] cache.tls_cafile               = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.870560 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] cache.tls_certfile             = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.870560 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] cache.tls_enabled              = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.870560 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] cache.tls_keyfile              = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.870560 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] privsep.capabilities           = [21, 12, 1, 2, 19] {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.871151 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] privsep.group                  = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.871151 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] privsep.helper_command         = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.871151 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] privsep.thread_pool_size       = 4 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.871449 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] privsep.user                   = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.871557 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.871687 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] privsep_dhcp_release.group     = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.871847 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.872007 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.872165 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] privsep_dhcp_release.user      = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.872334 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.872490 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group        = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.872671 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.872811 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.873629 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user         = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.873629 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.873629 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] privsep_namespace.group        = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.873629 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.873629 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.874384 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] privsep_namespace.user         = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.874384 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.874384 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] privsep_conntrack.group        = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.874384 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.874384 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.874849 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] privsep_conntrack.user         = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.874849 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] AGENT.root_helper              = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.874849 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon       = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.875165 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read   = True {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.875165 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset     = True {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.875401 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.875401 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver  = openvswitch {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.875634 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.875756 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] ml2.extension_drivers          = ['port_security'] {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.875880 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] ml2.external_network_type      = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.876252 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] ml2.mechanism_drivers          = ['openvswitch', 'hyperv'] {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.876252 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] ml2.overlay_ip_version         = 4 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.876585 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] ml2.path_mtu                   = 0 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.876585 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] ml2.physical_network_mtus      = [] {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.876585 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] ml2.tenant_network_types       = ['vlan'] {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.877186 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] ml2.type_drivers               = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.877186 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks    = ['physnet1'] {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.877186 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.877603 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges     = ['1:1000'] {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.877603 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges  = ['1:1000'] {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.877603 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:1300:1349'] {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.877997 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges      = ['1:1000'] {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.877997 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group     = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.878260 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.878260 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] database.backend               = sqlalchemy {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.878754 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] database.connection            = **** {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.878754 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] database.connection_debug      = 0 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.878754 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] database.connection_parameters =  {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.878754 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.879268 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] database.connection_trace      = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.879268 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.879268 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] database.db_max_retries        = 20 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.879661 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.879661 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] database.db_retry_interval     = 1 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.879661 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] database.max_overflow          = 50 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.880046 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] database.max_pool_size         = 50 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.880046 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] database.max_retries           = 10 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.880304 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] database.mysql_enable_ndb      = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.880304 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] database.mysql_sql_mode        = TRADITIONAL {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.880592 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] database.pool_timeout          = None {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.880592 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] database.retry_interval        = 10 {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.880863 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] database.slave_connection      = **** {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.880863 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] database.sqlite_synchronous    = True {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.881137 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] database.use_db_reconnect      = False {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 25 17:34:06.881137 dv-cinder-789564-2-iscsi neutron-server[98883]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=98883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}}
May 25 17:34:18.122765 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-64892ecd-5583-4161-984a-b0962f416449 None None] get_active_networks_info from dv-cinder-789564-2-iscsi {{(pid=99028) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:158}}
May 25 17:34:18.221876 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-64892ecd-5583-4161-984a-b0962f416449 None None] No non-hosted networks {{(pid=99028) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:60}}
May 25 17:34:18.228794 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.agentschedulers_db [None req-64892ecd-5583-4161-984a-b0962f416449 None None] DHCP Agent not found on host dv-cinder-789564-2-iscsi {{(pid=99028) list_active_networks_on_active_dhcp_agent /opt/stack/neutron/neutron/db/agentschedulers_db.py:455}}
May 25 17:34:18.327853 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-dd376d63-4418-41d3-bac9-d03c4a0a3766 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134'] for agent, after_create {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:34:20.655794 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-41a6e2f1-132b-411d-b9fd-ce73ddb3b82e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134'] for agent, after_create {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:34:20.705587 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.db.api [None req-fce9db1c-248a-4f91-a9f4-b42357b151be None None] Retry wrapper got retriable exception: Failed to create a duplicate Agent: for attribute(s) ['agents.uniq_agents0agent_type0host'] with value(s) L3 agent-dv-cinder-789564-2-iscsi {{(pid=99028) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}}
May 25 17:34:20.706555 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_db.api [None req-fce9db1c-248a-4f91-a9f4-b42357b151be None None] Performing DB retry for function neutron.db.agents_db.AgentDbMixin.create_or_update_agent {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}}
May 25 17:34:20.802006 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134'] for agent, after_create {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:34:20.803157 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:34:20.803945 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:34:20.805223 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:34:20.806188 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:34:20.806982 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:34:20.807782 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:34:20.808590 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:34:20.809259 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:34:20.809886 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:34:20.810451 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:34:20.811132 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:34:20.811700 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:34:20.812368 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServersRpcApi method report_agent_resource_versions called with arguments (<neutron_lib.context.Context object at 0x7fcae7c1b820>, 'Open vSwitch agent', 'dv-cinder-789564-2-iscsi', {'QosPolicy': '1.8', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2'}) {} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:34:20.827700 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServerRpcCallback method report_agent_resource_versions called with arguments (<neutron_lib.context.Context object at 0x7fcae72d4460>,) {'agent_type': 'Open vSwitch agent', 'agent_host': 'dv-cinder-789564-2-iscsi', 'version_map': {'QosPolicy': '1.8', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2'}} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:34:21.231209 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-fce9db1c-248a-4f91-a9f4-b42357b151be None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:34:21.676245 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-7e261f94-b84f-443e-be49-3bc1ac903b55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134'] for agent, after_create {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:34:23.271354 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-6df2b2a7-a54e-4d57-9be3-033078b9d5b3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134'] for agent, after_create {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:34:24.624339 dv-cinder-789564-2-iscsi neutron-server[99028]: INFO neutron.db.l3_hamode_db [None req-2fef49e6-f51f-4cd5-be1e-9f2b176753e7 None None] Number of active agents lower than max_l3_agents_per_router. L3 agents available: 1
May 25 17:34:24.719199 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2fef49e6-f51f-4cd5-be1e-9f2b176753e7 None None] Routers set() bound to L3 agent in host dv-cinder-789564-2-iscsi {{(pid=99028) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 17:34:24.719612 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2fef49e6-f51f-4cd5-be1e-9f2b176753e7 None None] Router IDs set() for agent in host dv-cinder-789564-2-iscsi {{(pid=99028) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:464}}
May 25 17:34:24.953841 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 38420) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:34:25.551069 dv-cinder-789564-2-iscsi neutron-server[99027]: WARNING oslo_policy.policy [None req-b505e716-d8aa-4cb0-98eb-01169d9547d1 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
May 25 17:34:25.551674 dv-cinder-789564-2-iscsi neutron-server[99027]: WARNING oslo_policy.policy [None req-b505e716-d8aa-4cb0-98eb-01169d9547d1 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
May 25 17:34:25.776073 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [None req-b505e716-d8aa-4cb0-98eb-01169d9547d1 admin admin] http://10.222.0.122:9696/v2.0/extensions returned with HTTP 200 {{(pid=99027) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 25 17:34:25.777685 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-b505e716-d8aa-4cb0-98eb-01169d9547d1 admin admin] 10.222.0.122 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.8222618
May 25 17:34:28.159119 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 38434) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:34:28.741808 dv-cinder-789564-2-iscsi neutron-server[99026]: WARNING oslo_policy.policy [None req-4da35b98-71ce-457a-81e4-3c05591630b6 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
May 25 17:34:28.742377 dv-cinder-789564-2-iscsi neutron-server[99026]: WARNING oslo_policy.policy [None req-4da35b98-71ce-457a-81e4-3c05591630b6 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
May 25 17:34:28.963524 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.v2.base [None req-4da35b98-71ce-457a-81e4-3c05591630b6 admin admin] Request body: {'subnetpool': {'name': 'shared-default-subnetpool-v4', 'default_prefixlen': 26, 'is_default': True, 'prefixes': ['172.20.0.0/16'], 'shared': True}} {{(pid=99026) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:34:29.063839 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.policy [None req-4da35b98-71ce-457a-81e4-3c05591630b6 admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=99026) register_rules /opt/stack/neutron/neutron/policy.py:73}}
May 25 17:34:29.110371 dv-cinder-789564-2-iscsi neutron-server[99026]: WARNING oslo_policy.policy [None req-4da35b98-71ce-457a-81e4-3c05591630b6 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
May 25 17:34:29.110747 dv-cinder-789564-2-iscsi neutron-server[99026]: WARNING oslo_policy.policy [None req-4da35b98-71ce-457a-81e4-3c05591630b6 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
May 25 17:34:29.119872 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.quota [None req-4da35b98-71ce-457a-81e4-3c05591630b6 admin admin] Loaded quota_driver: <neutron.db.quota.driver.DbQuotaDriver object at 0x7fcae799a430>.
May 25 17:34:29.147373 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-4da35b98-71ce-457a-81e4-3c05591630b6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:34:29.351936 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-4da35b98-71ce-457a-81e4-3c05591630b6 admin admin] Notify callbacks ['neutron.objects.securitygroup.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8781844814291', 'neutron.objects.address_group.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8781844813628', 'neutron.objects.network.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8781844818594', 'neutron.objects.qos.policy.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8781844829790', 'neutron.objects.subnetpool.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8781844835537', 'neutron.objects.address_scope.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8781844846042', 'neutron.plugins.ml2.plugin.External_net_db_mixin._process_ext_policy_create-1492628', 'neutron.plugins.ml2.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-1555990', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-523520', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-16309485'] for rbac-policy, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:34:29.613838 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-4da35b98-71ce-457a-81e4-3c05591630b6 admin admin] Notify callbacks [] for subnetpool, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:34:29.615179 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-4da35b98-71ce-457a-81e4-3c05591630b6 admin admin] 10.222.0.122 "POST /v2.0/subnetpools HTTP/1.1" status: 201  len: 739 time: 1.4540346
May 25 17:34:32.243328 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 38452) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:34:32.604564 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.v2.base [None req-04aa2c8c-70c9-4a90-9660-b0dd9f113774 admin admin] Request body: {'network': {'name': 'private', 'admin_state_up': True, 'project_id': '12fb4bc5180b4a2b947845fbaad4dffc', 'tenant_id': '12fb4bc5180b4a2b947845fbaad4dffc'}} {{(pid=99026) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:34:32.610046 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-04aa2c8c-70c9-4a90-9660-b0dd9f113774 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:34:32.614468 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-04aa2c8c-70c9-4a90-9660-b0dd9f113774 admin admin] Usage tracker for resource:network and tenant:12fb4bc5180b4a2b947845fbaad4dffc is out of sync, need to count used quota {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:34:32.619056 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-04aa2c8c-70c9-4a90-9660-b0dd9f113774 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:34:32.625941 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-04aa2c8c-70c9-4a90-9660-b0dd9f113774 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:34:32.699730 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-04aa2c8c-70c9-4a90-9660-b0dd9f113774 admin admin] Made reservation on behalf of 12fb4bc5180b4a2b947845fbaad4dffc for: {'network': 1} {{(pid=99026) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 17:34:32.702695 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-04aa2c8c-70c9-4a90-9660-b0dd9f113774 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-1465344'] for network, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:34:32.720874 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-04aa2c8c-70c9-4a90-9660-b0dd9f113774 admin admin] Notify callbacks [] for security_group, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:34:32.736099 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-04aa2c8c-70c9-4a90-9660-b0dd9f113774 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:34:32.739849 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-04aa2c8c-70c9-4a90-9660-b0dd9f113774 admin admin] Usage tracker for resource:security_group_rule and tenant:12fb4bc5180b4a2b947845fbaad4dffc is out of sync, need to count used quota {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:34:32.746482 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-04aa2c8c-70c9-4a90-9660-b0dd9f113774 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:34:32.752610 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-04aa2c8c-70c9-4a90-9660-b0dd9f113774 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:34:32.852563 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-04aa2c8c-70c9-4a90-9660-b0dd9f113774 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:34:32.922310 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-04aa2c8c-70c9-4a90-9660-b0dd9f113774 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:34:32.926766 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:34:32.946094 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-04aa2c8c-70c9-4a90-9660-b0dd9f113774 admin admin] vlan segment allocate from pool success with {'vlan_id': 1341, 'physical_network': 'physnet1'}  {{(pid=99026) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 25 17:34:32.971615 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-04aa2c8c-70c9-4a90-9660-b0dd9f113774 admin admin] Notify callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8781841233125', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1469168'] for segment, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:34:32.972215 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-04aa2c8c-70c9-4a90-9660-b0dd9f113774 admin admin] Unsubscribe: <function _add_segment_host_mapping_for_segment at 0x7fcae86f4e50> segment precommit_create {{(pid=99026) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}}
May 25 17:34:32.972684 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.db.segments_db [None req-04aa2c8c-70c9-4a90-9660-b0dd9f113774 admin admin] Added segment 46ed7828-a393-47d0-875c-86a5a4862adb of type vlan for network 4edd9e75-e73f-4268-a103-709560cae7d5
May 25 17:34:33.021038 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04aa2c8c-70c9-4a90-9660-b0dd9f113774 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=04acad04-bccd-4fb6-877f-fb1a123dc51e,revision_number=1']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:34:33.036724 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-04aa2c8c-70c9-4a90-9660-b0dd9f113774 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:34:33.037066 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-04aa2c8c-70c9-4a90-9660-b0dd9f113774 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:34:33.037415 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-04aa2c8c-70c9-4a90-9660-b0dd9f113774 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:34:33.039929 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-04aa2c8c-70c9-4a90-9660-b0dd9f113774 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:34:33.039929 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-04aa2c8c-70c9-4a90-9660-b0dd9f113774 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:34:33.039929 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-04aa2c8c-70c9-4a90-9660-b0dd9f113774 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:34:33.039929 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-04aa2c8c-70c9-4a90-9660-b0dd9f113774 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:34:33.039929 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-04aa2c8c-70c9-4a90-9660-b0dd9f113774 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:34:33.040333 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-04aa2c8c-70c9-4a90-9660-b0dd9f113774 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:34:33.040333 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-04aa2c8c-70c9-4a90-9660-b0dd9f113774 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:34:33.040333 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-04aa2c8c-70c9-4a90-9660-b0dd9f113774 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:34:33.040333 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-04aa2c8c-70c9-4a90-9660-b0dd9f113774 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:34:33.041326 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-04aa2c8c-70c9-4a90-9660-b0dd9f113774 admin admin] Tracked resource versions report:
May 25 17:34:33.041326 dv-cinder-789564-2-iscsi neutron-server[99026]: pushed versions:
May 25 17:34:33.041326 dv-cinder-789564-2-iscsi neutron-server[99026]: {   'AddressGroup': {'1.2'},
May 25 17:34:33.041326 dv-cinder-789564-2-iscsi neutron-server[99026]:     'ConntrackHelper': {'1.0'},
May 25 17:34:33.041326 dv-cinder-789564-2-iscsi neutron-server[99026]:     'Log': {'1.0'},
May 25 17:34:33.041326 dv-cinder-789564-2-iscsi neutron-server[99026]:     'Network': {'1.1'},
May 25 17:34:33.041326 dv-cinder-789564-2-iscsi neutron-server[99026]:     'Port': {'1.7'},
May 25 17:34:33.041326 dv-cinder-789564-2-iscsi neutron-server[99026]:     'PortForwarding': {'1.2'},
May 25 17:34:33.041326 dv-cinder-789564-2-iscsi neutron-server[99026]:     'QosPolicy': {'1.8'},
May 25 17:34:33.041326 dv-cinder-789564-2-iscsi neutron-server[99026]:     'SecurityGroup': {'1.4'},
May 25 17:34:33.041326 dv-cinder-789564-2-iscsi neutron-server[99026]:     'SecurityGroupRule': {'1.2'},
May 25 17:34:33.041326 dv-cinder-789564-2-iscsi neutron-server[99026]:     'SubPort': {'1.0'},
May 25 17:34:33.041326 dv-cinder-789564-2-iscsi neutron-server[99026]:     'Subnet': {'1.1'},
May 25 17:34:33.041326 dv-cinder-789564-2-iscsi neutron-server[99026]:     'Trunk': {'1.1'}}
May 25 17:34:33.041326 dv-cinder-789564-2-iscsi neutron-server[99026]: consumer versions:
May 25 17:34:33.041326 dv-cinder-789564-2-iscsi neutron-server[99026]: {   DHCP agent@dv-cinder-789564-2-iscsi: {},
May 25 17:34:33.041326 dv-cinder-789564-2-iscsi neutron-server[99026]:     L3 agent@dv-cinder-789564-2-iscsi: {},
May 25 17:34:33.041326 dv-cinder-789564-2-iscsi neutron-server[99026]:     Metadata agent@dv-cinder-789564-2-iscsi: {},
May 25 17:34:33.041326 dv-cinder-789564-2-iscsi neutron-server[99026]:     Metering agent@dv-cinder-789564-2-iscsi: {},
May 25 17:34:33.041326 dv-cinder-789564-2-iscsi neutron-server[99026]:     Open vSwitch agent@dv-cinder-789564-2-iscsi: {   'AddressGroup': '1.2',
May 25 17:34:33.041326 dv-cinder-789564-2-iscsi neutron-server[99026]:                                                      'ConntrackHelper': '1.0',
May 25 17:34:33.041326 dv-cinder-789564-2-iscsi neutron-server[99026]:                                                      'Log': '1.0',
May 25 17:34:33.041326 dv-cinder-789564-2-iscsi neutron-server[99026]:                                                      'Network': '1.1',
May 25 17:34:33.041326 dv-cinder-789564-2-iscsi neutron-server[99026]:                                                      'Port': '1.7',
May 25 17:34:33.041326 dv-cinder-789564-2-iscsi neutron-server[99026]:                                                      'PortForwarding': '1.2',
May 25 17:34:33.041326 dv-cinder-789564-2-iscsi neutron-server[99026]:                                                      'QosPolicy': '1.8',
May 25 17:34:33.041326 dv-cinder-789564-2-iscsi neutron-server[99026]:                                                      'SecurityGroup': '1.4',
May 25 17:34:33.041326 dv-cinder-789564-2-iscsi neutron-server[99026]:                                                      'SecurityGroupRule': '1.2',
May 25 17:34:33.041326 dv-cinder-789564-2-iscsi neutron-server[99026]:                                                      'SubPort': '1.0',
May 25 17:34:33.041326 dv-cinder-789564-2-iscsi neutron-server[99026]:                                                      'Subnet': '1.1',
May 25 17:34:33.041326 dv-cinder-789564-2-iscsi neutron-server[99026]:                                                      'Trunk': '1.1'}}
May 25 17:34:33.041326 dv-cinder-789564-2-iscsi neutron-server[99026]:  {{(pid=99026) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
May 25 17:34:33.091771 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-04aa2c8c-70c9-4a90-9660-b0dd9f113774 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.165s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:34:33.093506 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-04aa2c8c-70c9-4a90-9660-b0dd9f113774 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8781840806997'] for network, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:34:33.213868 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-04aa2c8c-70c9-4a90-9660-b0dd9f113774 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-459299', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551400'] for network, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:34:33.216175 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-04aa2c8c-70c9-4a90-9660-b0dd9f113774 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:34:33.216843 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-04aa2c8c-70c9-4a90-9660-b0dd9f113774 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for network, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:34:33.221899 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:34:33.323805 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04aa2c8c-70c9-4a90-9660-b0dd9f113774 admin admin] Pushing event updated for resources: {'Network': ['ID=4edd9e75-e73f-4268-a103-709560cae7d5,revision_number=1']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:34:33.327053 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-04aa2c8c-70c9-4a90-9660-b0dd9f113774 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.105s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:34:33.335376 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Network 4edd9e75-e73f-4268-a103-709560cae7d5 details requested by agent ovs-agent-dv-cinder-789564-2-iscsi with host dv-cinder-789564-2-iscsi {{(pid=99028) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 25 17:34:33.505473 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-04aa2c8c-70c9-4a90-9660-b0dd9f113774 admin admin] 10.222.0.122 "POST /v2.0/networks HTTP/1.1" status: 201  len: 850 time: 1.2609179
May 25 17:34:36.175962 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 38468) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:34:36.641743 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-13cff115-6c51-411b-b29f-a177b15042b1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:34:36.642997 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-13cff115-6c51-411b-b29f-a177b15042b1 admin admin] 10.222.0.122 "GET /v2.0/networks/4edd9e75-e73f-4268-a103-709560cae7d5 HTTP/1.1" status: 200  len: 826 time: 0.4660764
May 25 17:34:36.669742 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-2ac25f1f-b380-42d8-b0fd-8ace4c809784 admin admin] 10.222.0.122 "GET /v2.0/subnetpools/6f7dd76a-6a1a-499f-be76-0b2c573bc951 HTTP/1.1" status: 200  len: 734 time: 0.0214572
May 25 17:34:36.677972 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.v2.base [None req-f288c504-4a90-4591-a684-00b2eab95c3d admin admin] Request body: {'subnet': {'network_id': '4edd9e75-e73f-4268-a103-709560cae7d5', 'ip_version': 4, 'name': 'private-subnet', 'tenant_id': '12fb4bc5180b4a2b947845fbaad4dffc', 'gateway_ip': '172.20.0.1', 'subnetpool_id': '6f7dd76a-6a1a-499f-be76-0b2c573bc951'}} {{(pid=99026) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:34:36.682138 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-f288c504-4a90-4591-a684-00b2eab95c3d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:34:36.686784 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-f288c504-4a90-4591-a684-00b2eab95c3d admin admin] Usage tracker for resource:subnet and tenant:12fb4bc5180b4a2b947845fbaad4dffc is out of sync, need to count used quota {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:34:36.689626 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-f288c504-4a90-4591-a684-00b2eab95c3d admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:34:36.695069 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-f288c504-4a90-4591-a684-00b2eab95c3d admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:34:36.777020 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f288c504-4a90-4591-a684-00b2eab95c3d admin admin] Made reservation on behalf of 12fb4bc5180b4a2b947845fbaad4dffc for: {'subnet': 1} {{(pid=99026) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 17:34:36.779385 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-f288c504-4a90-4591-a684-00b2eab95c3d admin admin] Notify callbacks [] for subnet, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:34:37.312298 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-f288c504-4a90-4591-a684-00b2eab95c3d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114466', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411'] for subnet, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:34:37.317449 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:34:37.396754 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f288c504-4a90-4591-a684-00b2eab95c3d admin admin] Pushing event updated for resources: {'Subnet': ['ID=9c8e2274-27a5-431a-94be-cfb15ecbe039,revision_number=0']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:34:37.398761 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f288c504-4a90-4591-a684-00b2eab95c3d admin admin] Checking segment: {'id': '46ed7828-a393-47d0-875c-86a5a4862adb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1341, 'network_id': '4edd9e75-e73f-4268-a103-709560cae7d5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=99026) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 17:34:37.399128 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f288c504-4a90-4591-a684-00b2eab95c3d admin admin] Network hostable DHCP agents. Network: 4edd9e75-e73f-4268-a103-709560cae7d5, hostable agents: ['c8b0a350-254b-4562-874b-120ecdef0e25'], hosted agents: [] {{(pid=99026) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 25 17:34:37.404220 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-f288c504-4a90-4591-a684-00b2eab95c3d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:34:37.481812 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f288c504-4a90-4591-a684-00b2eab95c3d admin admin] Network 4edd9e75-e73f-4268-a103-709560cae7d5 is scheduled to be hosted by DHCP agent c8b0a350-254b-4562-874b-120ecdef0e25 with binding_index 1 {{(pid=99026) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 25 17:34:37.533408 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.scheduler.base_scheduler [None req-f288c504-4a90-4591-a684-00b2eab95c3d admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-789564-2-iscsi, 4edd9e75-e73f-4268-a103-709560cae7d5) {{(pid=99026) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 17:34:37.538052 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f288c504-4a90-4591-a684-00b2eab95c3d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:34:37.538613 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-f288c504-4a90-4591-a684-00b2eab95c3d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for subnet, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:34:37.544659 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-684e4914-7551-46dc-af62-10d3e0a02674 None None] Network 4edd9e75-e73f-4268-a103-709560cae7d5 requested from dv-cinder-789564-2-iscsi {{(pid=99028) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 17:34:37.640893 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-f288c504-4a90-4591-a684-00b2eab95c3d admin admin] 10.222.0.122 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 854 time: 0.9661164
May 25 17:34:37.856454 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f6e6293c-505c-4def-9f60-05da90d918a0 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpe415bc4a-81ee-5198-a7be-1f5e4adc5586-4edd9e75-e73f-4268-a103-709560cae7d5', 'network_id': '4edd9e75-e73f-4268-a103-709560cae7d5', 'tenant_id': '12fb4bc5180b4a2b947845fbaad4dffc', 'fixed_ips': [{'subnet_id': '9c8e2274-27a5-431a-94be-cfb15ecbe039'}]}} from dv-cinder-789564-2-iscsi. {{(pid=99028) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
May 25 17:34:37.857697 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-f6e6293c-505c-4def-9f60-05da90d918a0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_create {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:34:38.047438 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.db_base_plugin_common [None req-f6e6293c-505c-4def-9f60-05da90d918a0 None None] Allocated IP 172.20.0.2 (4edd9e75-e73f-4268-a103-709560cae7d5/9c8e2274-27a5-431a-94be-cfb15ecbe039/188a9f16-5d70-4e31-8249-4cbf70054f42) {{(pid=99028) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 17:34:38.287800 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-f6e6293c-505c-4def-9f60-05da90d918a0 None None] Notify callbacks [] for port, precommit_create {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:34:38.300682 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-f6e6293c-505c-4def-9f60-05da90d918a0 None None] Transition to ACTIVE for port object 188a9f16-5d70-4e31-8249-4cbf70054f42 will not be triggered until provisioned by entity L2. {{(pid=99028) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 17:34:38.320178 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-f6e6293c-505c-4def-9f60-05da90d918a0 None None] Transition to ACTIVE for port object 188a9f16-5d70-4e31-8249-4cbf70054f42 will not be triggered until provisioned by entity DHCP. {{(pid=99028) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 17:34:38.412062 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-f6e6293c-505c-4def-9f60-05da90d918a0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781840788179'] for port, after_create {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:34:38.416992 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:34:38.477353 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f6e6293c-505c-4def-9f60-05da90d918a0 None None] Network 4edd9e75-e73f-4268-a103-709560cae7d5 is already hosted by enough agents. {{(pid=99028) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 17:34:38.480183 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.scheduler.base_scheduler [None req-f6e6293c-505c-4def-9f60-05da90d918a0 None None] Resources bound (agent type, host, resource id):  {{(pid=99028) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 17:34:38.486699 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f6e6293c-505c-4def-9f60-05da90d918a0 None None] Received port after_create {{(pid=99028) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 17:34:38.494343 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6e6293c-505c-4def-9f60-05da90d918a0 None None] Pushing event updated for resources: {'Port': ['ID=188a9f16-5d70-4e31-8249-4cbf70054f42,revision_number=1']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:34:38.540760 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6e6293c-505c-4def-9f60-05da90d918a0 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:34:38.541165 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6e6293c-505c-4def-9f60-05da90d918a0 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:34:38.541455 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6e6293c-505c-4def-9f60-05da90d918a0 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:34:38.541778 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6e6293c-505c-4def-9f60-05da90d918a0 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:34:38.542132 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6e6293c-505c-4def-9f60-05da90d918a0 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:34:38.542440 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6e6293c-505c-4def-9f60-05da90d918a0 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:34:38.542749 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6e6293c-505c-4def-9f60-05da90d918a0 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:34:38.543058 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6e6293c-505c-4def-9f60-05da90d918a0 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:34:38.543382 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6e6293c-505c-4def-9f60-05da90d918a0 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:34:38.543697 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6e6293c-505c-4def-9f60-05da90d918a0 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:34:38.544001 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6e6293c-505c-4def-9f60-05da90d918a0 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:34:38.544302 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6e6293c-505c-4def-9f60-05da90d918a0 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:34:38.545463 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6e6293c-505c-4def-9f60-05da90d918a0 None None] Tracked resource versions report:
May 25 17:34:38.545463 dv-cinder-789564-2-iscsi neutron-server[99028]: pushed versions:
May 25 17:34:38.545463 dv-cinder-789564-2-iscsi neutron-server[99028]: {   'AddressGroup': {'1.2'},
May 25 17:34:38.545463 dv-cinder-789564-2-iscsi neutron-server[99028]:     'ConntrackHelper': {'1.0'},
May 25 17:34:38.545463 dv-cinder-789564-2-iscsi neutron-server[99028]:     'Log': {'1.0'},
May 25 17:34:38.545463 dv-cinder-789564-2-iscsi neutron-server[99028]:     'Network': {'1.1'},
May 25 17:34:38.545463 dv-cinder-789564-2-iscsi neutron-server[99028]:     'Port': {'1.7'},
May 25 17:34:38.545463 dv-cinder-789564-2-iscsi neutron-server[99028]:     'PortForwarding': {'1.2'},
May 25 17:34:38.545463 dv-cinder-789564-2-iscsi neutron-server[99028]:     'QosPolicy': {'1.8'},
May 25 17:34:38.545463 dv-cinder-789564-2-iscsi neutron-server[99028]:     'SecurityGroup': {'1.4'},
May 25 17:34:38.545463 dv-cinder-789564-2-iscsi neutron-server[99028]:     'SecurityGroupRule': {'1.2'},
May 25 17:34:38.545463 dv-cinder-789564-2-iscsi neutron-server[99028]:     'SubPort': {'1.0'},
May 25 17:34:38.545463 dv-cinder-789564-2-iscsi neutron-server[99028]:     'Subnet': {'1.1'},
May 25 17:34:38.545463 dv-cinder-789564-2-iscsi neutron-server[99028]:     'Trunk': {'1.1'}}
May 25 17:34:38.545463 dv-cinder-789564-2-iscsi neutron-server[99028]: consumer versions:
May 25 17:34:38.545463 dv-cinder-789564-2-iscsi neutron-server[99028]: {   DHCP agent@dv-cinder-789564-2-iscsi: {},
May 25 17:34:38.545463 dv-cinder-789564-2-iscsi neutron-server[99028]:     L3 agent@dv-cinder-789564-2-iscsi: {},
May 25 17:34:38.545463 dv-cinder-789564-2-iscsi neutron-server[99028]:     Metadata agent@dv-cinder-789564-2-iscsi: {},
May 25 17:34:38.545463 dv-cinder-789564-2-iscsi neutron-server[99028]:     Metering agent@dv-cinder-789564-2-iscsi: {},
May 25 17:34:38.545463 dv-cinder-789564-2-iscsi neutron-server[99028]:     Open vSwitch agent@dv-cinder-789564-2-iscsi: {   'AddressGroup': '1.2',
May 25 17:34:38.545463 dv-cinder-789564-2-iscsi neutron-server[99028]:                                                      'ConntrackHelper': '1.0',
May 25 17:34:38.545463 dv-cinder-789564-2-iscsi neutron-server[99028]:                                                      'Log': '1.0',
May 25 17:34:38.545463 dv-cinder-789564-2-iscsi neutron-server[99028]:                                                      'Network': '1.1',
May 25 17:34:38.545463 dv-cinder-789564-2-iscsi neutron-server[99028]:                                                      'Port': '1.7',
May 25 17:34:38.545463 dv-cinder-789564-2-iscsi neutron-server[99028]:                                                      'PortForwarding': '1.2',
May 25 17:34:38.545463 dv-cinder-789564-2-iscsi neutron-server[99028]:                                                      'QosPolicy': '1.8',
May 25 17:34:38.545463 dv-cinder-789564-2-iscsi neutron-server[99028]:                                                      'SecurityGroup': '1.4',
May 25 17:34:38.545463 dv-cinder-789564-2-iscsi neutron-server[99028]:                                                      'SecurityGroupRule': '1.2',
May 25 17:34:38.545463 dv-cinder-789564-2-iscsi neutron-server[99028]:                                                      'SubPort': '1.0',
May 25 17:34:38.545463 dv-cinder-789564-2-iscsi neutron-server[99028]:                                                      'Subnet': '1.1',
May 25 17:34:38.545463 dv-cinder-789564-2-iscsi neutron-server[99028]:                                                      'Trunk': '1.1'}}
May 25 17:34:38.545463 dv-cinder-789564-2-iscsi neutron-server[99028]:  {{(pid=99028) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
May 25 17:34:38.578689 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-f6e6293c-505c-4def-9f60-05da90d918a0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.161s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:34:38.598551 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.managers [None req-f6e6293c-505c-4def-9f60-05da90d918a0 None None] Attempting to bind port 188a9f16-5d70-4e31-8249-4cbf70054f42 on host dv-cinder-789564-2-iscsi for vnic_type normal with profile  {{(pid=99028) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 17:34:38.598948 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.managers [None req-f6e6293c-505c-4def-9f60-05da90d918a0 None None] Attempting to bind port 188a9f16-5d70-4e31-8249-4cbf70054f42 by drivers openvswitch,hyperv on host dv-cinder-789564-2-iscsi at level 0 using segments [{'id': '46ed7828-a393-47d0-875c-86a5a4862adb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1341, 'network_id': '4edd9e75-e73f-4268-a103-709560cae7d5'}] {{(pid=99028) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 17:34:38.599389 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f6e6293c-505c-4def-9f60-05da90d918a0 None None] Attempting to bind port 188a9f16-5d70-4e31-8249-4cbf70054f42 on network 4edd9e75-e73f-4268-a103-709560cae7d5 {{(pid=99028) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 17:34:38.604688 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f6e6293c-505c-4def-9f60-05da90d918a0 None None] Checking agent: {'id': '7bb67520-1e97-4ad9-9b97-101068bbe1a3', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-789564-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 17, 34, 21), 'started_at': datetime.datetime(2021, 5, 25, 17, 34, 21), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 17, 34, 21), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-789564-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=99028) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 17:34:38.605478 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f6e6293c-505c-4def-9f60-05da90d918a0 None None] Checking segment: {'id': '46ed7828-a393-47d0-875c-86a5a4862adb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1341, 'network_id': '4edd9e75-e73f-4268-a103-709560cae7d5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=99028) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 17:34:38.606227 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-f6e6293c-505c-4def-9f60-05da90d918a0 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:34:38.606629 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f6e6293c-505c-4def-9f60-05da90d918a0 None None] Bound using segment: {'id': '46ed7828-a393-47d0-875c-86a5a4862adb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1341, 'network_id': '4edd9e75-e73f-4268-a103-709560cae7d5'} {{(pid=99028) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 17:34:38.607159 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.managers [None req-f6e6293c-505c-4def-9f60-05da90d918a0 None None] Bound port: 188a9f16-5d70-4e31-8249-4cbf70054f42, host: dv-cinder-789564-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '46ed7828-a393-47d0-875c-86a5a4862adb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1341, 'network_id': '4edd9e75-e73f-4268-a103-709560cae7d5'}}] {{(pid=99028) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 17:34:38.607533 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-f6e6293c-505c-4def-9f60-05da90d918a0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:34:38.696722 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-f6e6293c-505c-4def-9f60-05da90d918a0 None None] For port 188a9f16-5d70-4e31-8249-4cbf70054f42, host dv-cinder-789564-2-iscsi, cleared binding levels {{(pid=99028) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 17:34:38.701392 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-f6e6293c-505c-4def-9f60-05da90d918a0 None None] For port 188a9f16-5d70-4e31-8249-4cbf70054f42, host dv-cinder-789564-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=188a9f16-5d70-4e31-8249-4cbf70054f42,segment=NetworkSegment(46ed7828-a393-47d0-875c-86a5a4862adb),segment_id=46ed7828-a393-47d0-875c-86a5a4862adb)] {{(pid=99028) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 17:34:38.768336 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-f6e6293c-505c-4def-9f60-05da90d918a0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:34:38.772479 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:34:38.860052 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6e6293c-505c-4def-9f60-05da90d918a0 None None] Pushing event updated for resources: {'Port': ['ID=188a9f16-5d70-4e31-8249-4cbf70054f42,revision_number=2']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:34:38.872126 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-f6e6293c-505c-4def-9f60-05da90d918a0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.099s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:34:40.071830 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 38478) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:34:40.470765 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [None req-03df8da1-f913-4144-a808-b15878cd4a20 admin admin] http://10.222.0.122:9696/v2.0/extensions returned with HTTP 200 {{(pid=99027) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 25 17:34:40.471808 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-03df8da1-f913-4144-a808-b15878cd4a20 admin admin] 10.222.0.122 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.3986940
May 25 17:34:42.873869 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 38488) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:34:43.255338 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [None req-ac5d0406-6cd6-48ee-8d6d-48cdf135e00b admin admin] http://10.222.0.122:9696/v2.0/extensions returned with HTTP 200 {{(pid=99027) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 25 17:34:43.256916 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-ac5d0406-6cd6-48ee-8d6d-48cdf135e00b admin admin] 10.222.0.122 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.3820868
May 25 17:34:44.578561 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c9de35f3-69b5-4fd1-8ac1-9bff14739b5e None None] Network 4edd9e75-e73f-4268-a103-709560cae7d5 requested from dv-cinder-789564-2-iscsi {{(pid=99028) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 17:34:44.751086 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-23b31a2a-59cf-4b75-bf32-c21061f49986 None None] Provisioning for port 188a9f16-5d70-4e31-8249-4cbf70054f42 completed by entity DHCP. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 17:34:44.785329 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device 188a9f16-5d70-4e31-8249-4cbf70054f42 up at agent ovs-agent-dv-cinder-789564-2-iscsi {{(pid=99028) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 17:34:44.967953 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Provisioning for port 188a9f16-5d70-4e31-8249-4cbf70054f42 completed by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 17:34:44.974288 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Provisioning complete for port 188a9f16-5d70-4e31-8249-4cbf70054f42 triggered by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 17:34:44.974703 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:34:45.102606 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:34:45.135169 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] For port 188a9f16-5d70-4e31-8249-4cbf70054f42, host dv-cinder-789564-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=188a9f16-5d70-4e31-8249-4cbf70054f42,segment=NetworkSegment(46ed7828-a393-47d0-875c-86a5a4862adb),segment_id=46ed7828-a393-47d0-875c-86a5a4862adb)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:34:45.190953 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-5c4ec251-350f-4af9-becf-c13aea98cabc None None] Provisioning complete for port 188a9f16-5d70-4e31-8249-4cbf70054f42 triggered by entity DHCP. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 17:34:45.191325 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-5c4ec251-350f-4af9-becf-c13aea98cabc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:34:45.222796 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:34:45.238271 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-f6e6293c-505c-4def-9f60-05da90d918a0 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:34:45.321984 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Pushing event updated for resources: {'Port': ['ID=188a9f16-5d70-4e31-8249-4cbf70054f42,revision_number=3']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:34:45.327326 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:34:45.970713 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 38504) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:34:46.328176 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.v2.base [None req-51f177ca-c43e-4d03-b225-760e8aa2fa1c admin admin] Request body: {'router': {'name': 'router1', 'admin_state_up': True, 'tenant_id': '12fb4bc5180b4a2b947845fbaad4dffc'}} {{(pid=99027) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:34:46.405173 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.policy [None req-51f177ca-c43e-4d03-b225-760e8aa2fa1c admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=99027) register_rules /opt/stack/neutron/neutron/policy.py:73}}
May 25 17:34:46.452283 dv-cinder-789564-2-iscsi neutron-server[99027]: WARNING oslo_policy.policy [None req-51f177ca-c43e-4d03-b225-760e8aa2fa1c admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
May 25 17:34:46.452662 dv-cinder-789564-2-iscsi neutron-server[99027]: WARNING oslo_policy.policy [None req-51f177ca-c43e-4d03-b225-760e8aa2fa1c admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
May 25 17:34:46.461291 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.quota [None req-51f177ca-c43e-4d03-b225-760e8aa2fa1c admin admin] Loaded quota_driver: <neutron.db.quota.driver.DbQuotaDriver object at 0x7fcae79aabb0>.
May 25 17:34:46.477351 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-51f177ca-c43e-4d03-b225-760e8aa2fa1c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:34:46.484379 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-51f177ca-c43e-4d03-b225-760e8aa2fa1c admin admin] Usage tracker for resource:router and tenant:12fb4bc5180b4a2b947845fbaad4dffc is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:34:46.488751 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-51f177ca-c43e-4d03-b225-760e8aa2fa1c admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:34:46.497332 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-51f177ca-c43e-4d03-b225-760e8aa2fa1c admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:34:46.596340 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-51f177ca-c43e-4d03-b225-760e8aa2fa1c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-415064', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-6983'] for router, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:34:46.598349 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-51f177ca-c43e-4d03-b225-760e8aa2fa1c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-414296', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-419975', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-491114', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-6988'] for router, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:34:46.623658 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-51f177ca-c43e-4d03-b225-760e8aa2fa1c admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:34:46.746678 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device 188a9f16-5d70-4e31-8249-4cbf70054f42 up at agent ovs-agent-dv-cinder-789564-2-iscsi {{(pid=99028) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 17:34:46.800435 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-51f177ca-c43e-4d03-b225-760e8aa2fa1c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-415057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-420065'] for router, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:34:46.812073 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Provisioning complete for port 188a9f16-5d70-4e31-8249-4cbf70054f42 triggered by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 17:34:46.812448 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:34:46.904839 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-51f177ca-c43e-4d03-b225-760e8aa2fa1c admin admin] Notify callbacks [] for router, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:34:46.905913 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-51f177ca-c43e-4d03-b225-760e8aa2fa1c admin admin] 10.222.0.122 "POST /v2.0/routers HTTP/1.1" status: 201  len: 709 time: 0.9342420
May 25 17:34:48.133398 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-cafb35b4-6423-4bfe-a6e6-5b50bacd0b81 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:34:49.245065 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 38516) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:34:49.651815 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [None req-94a6ad1e-8356-4114-91bf-d432ea59924f admin admin] http://10.222.0.122:9696/v2.0/extensions returned with HTTP 200 {{(pid=99027) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 25 17:34:49.652989 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-94a6ad1e-8356-4114-91bf-d432ea59924f admin admin] 10.222.0.122 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.4068971
May 25 17:34:50.623841 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-d99fb668-d154-4168-b79c-946c97057b63 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:34:50.805530 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:34:51.619047 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-7e261f94-b84f-443e-be49-3bc1ac903b55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:34:52.071972 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 38532) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:34:52.419579 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.v2.base [None req-cb6fe376-d1fa-4bc5-9cbc-18073d1d7f88 admin admin] Request body: {'network': {'is_default': True, 'admin_state_up': True, 'provider:network_type': 'flat', 'router:external': True, 'provider:physical_network': 'physnet1', 'name': 'public'}} {{(pid=99027) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:34:52.424607 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-cb6fe376-d1fa-4bc5-9cbc-18073d1d7f88 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:34:52.428327 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-cb6fe376-d1fa-4bc5-9cbc-18073d1d7f88 admin admin] Usage tracker for resource:network and tenant:537bb945cac6475e8b1205f34ad1e207 is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:34:52.431859 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-cb6fe376-d1fa-4bc5-9cbc-18073d1d7f88 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:34:52.438363 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-cb6fe376-d1fa-4bc5-9cbc-18073d1d7f88 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:34:52.498867 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cb6fe376-d1fa-4bc5-9cbc-18073d1d7f88 admin admin] Made reservation on behalf of 537bb945cac6475e8b1205f34ad1e207 for: {'network': 1} {{(pid=99027) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 17:34:52.501529 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-cb6fe376-d1fa-4bc5-9cbc-18073d1d7f88 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-1465344'] for network, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:34:52.518343 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-cb6fe376-d1fa-4bc5-9cbc-18073d1d7f88 admin admin] Notify callbacks [] for security_group, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:34:52.532884 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-cb6fe376-d1fa-4bc5-9cbc-18073d1d7f88 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:34:52.536671 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-cb6fe376-d1fa-4bc5-9cbc-18073d1d7f88 admin admin] Usage tracker for resource:security_group_rule and tenant:537bb945cac6475e8b1205f34ad1e207 is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:34:52.539934 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-cb6fe376-d1fa-4bc5-9cbc-18073d1d7f88 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:34:52.546266 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-cb6fe376-d1fa-4bc5-9cbc-18073d1d7f88 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:34:52.642072 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-cb6fe376-d1fa-4bc5-9cbc-18073d1d7f88 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:34:52.727967 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-cb6fe376-d1fa-4bc5-9cbc-18073d1d7f88 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:34:52.732604 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:34:52.746482 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.type_flat [None req-cb6fe376-d1fa-4bc5-9cbc-18073d1d7f88 admin admin] Reserving flat network on physical network physnet1 {{(pid=99027) reserve_provider_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_flat.py:100}}
May 25 17:34:52.775811 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-cb6fe376-d1fa-4bc5-9cbc-18073d1d7f88 admin admin] Notify callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8781841233125', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1469168'] for segment, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:34:52.776396 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-cb6fe376-d1fa-4bc5-9cbc-18073d1d7f88 admin admin] Unsubscribe: <function _add_segment_host_mapping_for_segment at 0x7fcae86f4e50> segment precommit_create {{(pid=99027) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}}
May 25 17:34:52.776875 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.db.segments_db [None req-cb6fe376-d1fa-4bc5-9cbc-18073d1d7f88 admin admin] Added segment 471771f9-c462-4865-800d-0d5029e9eb3e of type flat for network eb7ec72b-a691-481b-8d7e-42c05e13a8cb
May 25 17:34:52.830615 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb6fe376-d1fa-4bc5-9cbc-18073d1d7f88 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=745f2e4c-c5c2-4d23-a2fb-d6a50af6355a,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:34:52.852764 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb6fe376-d1fa-4bc5-9cbc-18073d1d7f88 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:34:52.853064 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb6fe376-d1fa-4bc5-9cbc-18073d1d7f88 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:34:52.853392 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb6fe376-d1fa-4bc5-9cbc-18073d1d7f88 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:34:52.853712 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb6fe376-d1fa-4bc5-9cbc-18073d1d7f88 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:34:52.854129 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb6fe376-d1fa-4bc5-9cbc-18073d1d7f88 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:34:52.854541 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb6fe376-d1fa-4bc5-9cbc-18073d1d7f88 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:34:52.854895 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb6fe376-d1fa-4bc5-9cbc-18073d1d7f88 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:34:52.855259 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb6fe376-d1fa-4bc5-9cbc-18073d1d7f88 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:34:52.855859 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb6fe376-d1fa-4bc5-9cbc-18073d1d7f88 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:34:52.856174 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb6fe376-d1fa-4bc5-9cbc-18073d1d7f88 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:34:52.856477 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb6fe376-d1fa-4bc5-9cbc-18073d1d7f88 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:34:52.856785 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb6fe376-d1fa-4bc5-9cbc-18073d1d7f88 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:34:52.858014 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb6fe376-d1fa-4bc5-9cbc-18073d1d7f88 admin admin] Tracked resource versions report:
May 25 17:34:52.858014 dv-cinder-789564-2-iscsi neutron-server[99027]: pushed versions:
May 25 17:34:52.858014 dv-cinder-789564-2-iscsi neutron-server[99027]: {   'AddressGroup': {'1.2'},
May 25 17:34:52.858014 dv-cinder-789564-2-iscsi neutron-server[99027]:     'ConntrackHelper': {'1.0'},
May 25 17:34:52.858014 dv-cinder-789564-2-iscsi neutron-server[99027]:     'Log': {'1.0'},
May 25 17:34:52.858014 dv-cinder-789564-2-iscsi neutron-server[99027]:     'Network': {'1.1'},
May 25 17:34:52.858014 dv-cinder-789564-2-iscsi neutron-server[99027]:     'Port': {'1.7'},
May 25 17:34:52.858014 dv-cinder-789564-2-iscsi neutron-server[99027]:     'PortForwarding': {'1.2'},
May 25 17:34:52.858014 dv-cinder-789564-2-iscsi neutron-server[99027]:     'QosPolicy': {'1.8'},
May 25 17:34:52.858014 dv-cinder-789564-2-iscsi neutron-server[99027]:     'SecurityGroup': {'1.4'},
May 25 17:34:52.858014 dv-cinder-789564-2-iscsi neutron-server[99027]:     'SecurityGroupRule': {'1.2'},
May 25 17:34:52.858014 dv-cinder-789564-2-iscsi neutron-server[99027]:     'SubPort': {'1.0'},
May 25 17:34:52.858014 dv-cinder-789564-2-iscsi neutron-server[99027]:     'Subnet': {'1.1'},
May 25 17:34:52.858014 dv-cinder-789564-2-iscsi neutron-server[99027]:     'Trunk': {'1.1'}}
May 25 17:34:52.858014 dv-cinder-789564-2-iscsi neutron-server[99027]: consumer versions:
May 25 17:34:52.858014 dv-cinder-789564-2-iscsi neutron-server[99027]: {   DHCP agent@dv-cinder-789564-2-iscsi: {},
May 25 17:34:52.858014 dv-cinder-789564-2-iscsi neutron-server[99027]:     L3 agent@dv-cinder-789564-2-iscsi: {},
May 25 17:34:52.858014 dv-cinder-789564-2-iscsi neutron-server[99027]:     Metadata agent@dv-cinder-789564-2-iscsi: {},
May 25 17:34:52.858014 dv-cinder-789564-2-iscsi neutron-server[99027]:     Metering agent@dv-cinder-789564-2-iscsi: {},
May 25 17:34:52.858014 dv-cinder-789564-2-iscsi neutron-server[99027]:     Open vSwitch agent@dv-cinder-789564-2-iscsi: {   'AddressGroup': '1.2',
May 25 17:34:52.858014 dv-cinder-789564-2-iscsi neutron-server[99027]:                                                      'ConntrackHelper': '1.0',
May 25 17:34:52.858014 dv-cinder-789564-2-iscsi neutron-server[99027]:                                                      'Log': '1.0',
May 25 17:34:52.858014 dv-cinder-789564-2-iscsi neutron-server[99027]:                                                      'Network': '1.1',
May 25 17:34:52.858014 dv-cinder-789564-2-iscsi neutron-server[99027]:                                                      'Port': '1.7',
May 25 17:34:52.858014 dv-cinder-789564-2-iscsi neutron-server[99027]:                                                      'PortForwarding': '1.2',
May 25 17:34:52.858014 dv-cinder-789564-2-iscsi neutron-server[99027]:                                                      'QosPolicy': '1.8',
May 25 17:34:52.858014 dv-cinder-789564-2-iscsi neutron-server[99027]:                                                      'SecurityGroup': '1.4',
May 25 17:34:52.858014 dv-cinder-789564-2-iscsi neutron-server[99027]:                                                      'SecurityGroupRule': '1.2',
May 25 17:34:52.858014 dv-cinder-789564-2-iscsi neutron-server[99027]:                                                      'SubPort': '1.0',
May 25 17:34:52.858014 dv-cinder-789564-2-iscsi neutron-server[99027]:                                                      'Subnet': '1.1',
May 25 17:34:52.858014 dv-cinder-789564-2-iscsi neutron-server[99027]:                                                      'Trunk': '1.1'}}
May 25 17:34:52.858014 dv-cinder-789564-2-iscsi neutron-server[99027]:  {{(pid=99027) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
May 25 17:34:52.907888 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-cb6fe376-d1fa-4bc5-9cbc-18073d1d7f88 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.175s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:34:52.909868 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-cb6fe376-d1fa-4bc5-9cbc-18073d1d7f88 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8781840806997'] for network, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:34:53.018938 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-cb6fe376-d1fa-4bc5-9cbc-18073d1d7f88 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-459299', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551400'] for network, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:34:53.020394 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cb6fe376-d1fa-4bc5-9cbc-18073d1d7f88 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:34:53.021056 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-cb6fe376-d1fa-4bc5-9cbc-18073d1d7f88 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for network, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:34:53.024570 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:34:53.133206 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb6fe376-d1fa-4bc5-9cbc-18073d1d7f88 admin admin] Pushing event updated for resources: {'Network': ['ID=eb7ec72b-a691-481b-8d7e-42c05e13a8cb,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:34:53.136523 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-cb6fe376-d1fa-4bc5-9cbc-18073d1d7f88 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.112s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:34:53.143982 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Network eb7ec72b-a691-481b-8d7e-42c05e13a8cb details requested by agent ovs-agent-dv-cinder-789564-2-iscsi with host dv-cinder-789564-2-iscsi {{(pid=99028) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 25 17:34:53.174333 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-cb6fe376-d1fa-4bc5-9cbc-18073d1d7f88 admin admin] 10.222.0.122 "POST /v2.0/networks HTTP/1.1" status: 201  len: 847 time: 1.1010993
May 25 17:34:53.258056 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-6df2b2a7-a54e-4d57-9be3-033078b9d5b3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:34:55.425184 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 38556) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:34:55.567556 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ac400372-7021-400d-9ca8-1766cf817fb2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:34:55.568797 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-ac400372-7021-400d-9ca8-1766cf817fb2 admin admin] 10.222.0.122 "GET /v2.0/subnets/9c8e2274-27a5-431a-94be-cfb15ecbe039 HTTP/1.1" status: 200  len: 849 time: 0.1426449
May 25 17:34:55.741306 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-c0542f79-76a3-4cc8-a6d5-19068ea8e2b4 admin admin] 10.222.0.122 "GET /v2.0/routers/891972ea-8a57-4573-a1da-d47e23a8e0a1 HTTP/1.1" status: 200  len: 704 time: 0.1668088
May 25 17:34:56.204213 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-8a2aea2e-9cd4-4269-b9f7-ae4cfcda55b7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:34:56.430477 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.db_base_plugin_common [None req-8a2aea2e-9cd4-4269-b9f7-ae4cfcda55b7 admin admin] Allocated IP 172.20.0.1 (4edd9e75-e73f-4268-a103-709560cae7d5/9c8e2274-27a5-431a-94be-cfb15ecbe039/ae1d1c44-513c-4b18-be03-3e9111372d24) {{(pid=99026) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 17:34:56.615899 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-8a2aea2e-9cd4-4269-b9f7-ae4cfcda55b7 admin admin] Notify callbacks [] for port, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:34:56.632437 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.provisioning_blocks [None req-8a2aea2e-9cd4-4269-b9f7-ae4cfcda55b7 admin admin] Transition to ACTIVE for port object ae1d1c44-513c-4b18-be03-3e9111372d24 will not be triggered until provisioned by entity DHCP. {{(pid=99026) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 17:34:56.739734 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-8a2aea2e-9cd4-4269-b9f7-ae4cfcda55b7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781840788179'] for port, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:34:56.743676 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:34:56.804418 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8a2aea2e-9cd4-4269-b9f7-ae4cfcda55b7 admin admin] Network 4edd9e75-e73f-4268-a103-709560cae7d5 is already hosted by enough agents. {{(pid=99026) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 17:34:56.807205 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.scheduler.base_scheduler [None req-8a2aea2e-9cd4-4269-b9f7-ae4cfcda55b7 admin admin] Resources bound (agent type, host, resource id):  {{(pid=99026) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 17:34:56.809807 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8a2aea2e-9cd4-4269-b9f7-ae4cfcda55b7 admin admin] Received port after_create {{(pid=99026) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 17:34:56.810337 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-8a2aea2e-9cd4-4269-b9f7-ae4cfcda55b7 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-421008'] for router_interface, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:34:56.945194 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a2aea2e-9cd4-4269-b9f7-ae4cfcda55b7 admin admin] Pushing event updated for resources: {'Port': ['ID=ae1d1c44-513c-4b18-be03-3e9111372d24,revision_number=1']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:34:56.955995 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-8a2aea2e-9cd4-4269-b9f7-ae4cfcda55b7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.212s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:34:57.053333 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-593b4905-6315-4aec-8567-410a56a2fb45 None None] Provisioning for port ae1d1c44-513c-4b18-be03-3e9111372d24 completed by entity DHCP. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 17:34:57.059266 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-593b4905-6315-4aec-8567-410a56a2fb45 None None] Provisioning complete for port ae1d1c44-513c-4b18-be03-3e9111372d24 triggered by entity DHCP. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 17:34:57.059633 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-593b4905-6315-4aec-8567-410a56a2fb45 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:34:57.116920 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.plugin [None req-593b4905-6315-4aec-8567-410a56a2fb45 None None] Port ae1d1c44-513c-4b18-be03-3e9111372d24 cannot update to ACTIVE because it is not bound. {{(pid=99028) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 25 17:34:57.133843 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-8a2aea2e-9cd4-4269-b9f7-ae4cfcda55b7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:34:57.392290 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-8a2aea2e-9cd4-4269-b9f7-ae4cfcda55b7 admin admin] Notify callbacks [] for port, precommit_update {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:34:57.480024 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-8a2aea2e-9cd4-4269-b9f7-ae4cfcda55b7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:34:57.481527 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-8a2aea2e-9cd4-4269-b9f7-ae4cfcda55b7 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-549394', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-420925'] for router_interface, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:34:57.488876 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:34:57.654863 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a2aea2e-9cd4-4269-b9f7-ae4cfcda55b7 admin admin] Pushing event updated for resources: {'Port': ['ID=ae1d1c44-513c-4b18-be03-3e9111372d24,revision_number=2']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:34:57.660794 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-8a2aea2e-9cd4-4269-b9f7-ae4cfcda55b7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.172s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:34:57.737782 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8a2aea2e-9cd4-4269-b9f7-ae4cfcda55b7 admin admin] Network 4edd9e75-e73f-4268-a103-709560cae7d5 is already hosted by enough agents. {{(pid=99026) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 17:34:57.739030 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.scheduler.base_scheduler [None req-8a2aea2e-9cd4-4269-b9f7-ae4cfcda55b7 admin admin] Resources bound (agent type, host, resource id):  {{(pid=99026) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 17:34:57.944999 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-69c500cd-4fe1-45e5-b2ed-1afa6a8d2abc None None] Provisioning complete for port ae1d1c44-513c-4b18-be03-3e9111372d24 triggered by entity DHCP. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 17:34:57.945304 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-69c500cd-4fe1-45e5-b2ed-1afa6a8d2abc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:34:58.017926 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.plugin [None req-69c500cd-4fe1-45e5-b2ed-1afa6a8d2abc None None] Port ae1d1c44-513c-4b18-be03-3e9111372d24 cannot update to ACTIVE because it is not bound. {{(pid=99028) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 25 17:34:58.065411 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8a2aea2e-9cd4-4269-b9f7-ae4cfcda55b7 admin admin] Router 891972ea-8a57-4573-a1da-d47e23a8e0a1 is scheduled to L3 agent eaeb6875-c4ed-43b6-8658-aa4e52324fdf with binding_index 1 {{(pid=99026) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
May 25 17:34:58.234633 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8a2aea2e-9cd4-4269-b9f7-ae4cfcda55b7 admin admin] Notify agent at l3_agent.dv-cinder-789564-2-iscsi the message routers_updated {{(pid=99026) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 25 17:34:58.243955 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-8a2aea2e-9cd4-4269-b9f7-ae4cfcda55b7 admin admin] 10.222.0.122 "PUT /v2.0/routers/891972ea-8a57-4573-a1da-d47e23a8e0a1/add_router_interface HTTP/1.1" status: 200  len: 508 time: 2.4974599
May 25 17:34:58.244492 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6c8f6e84-622e-4412-a394-a9c733200fc9 None None] Sync routers for ids ['891972ea-8a57-4573-a1da-d47e23a8e0a1'] in dv-cinder-789564-2-iscsi {{(pid=99029) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 25 17:34:58.257160 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6c8f6e84-622e-4412-a394-a9c733200fc9 None None] Routers {'891972ea-8a57-4573-a1da-d47e23a8e0a1'} bound to L3 agent in host dv-cinder-789564-2-iscsi {{(pid=99029) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 17:34:58.257989 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_hamode_db [None req-6c8f6e84-622e-4412-a394-a9c733200fc9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcae7c99a90>, 'dv-cinder-789564-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-05-25T17:34:21Z,description=<?>,heartbeat_timestamp=2021-05-25T17:34:51Z,host='dv-cinder-789564-2-iscsi',id=eaeb6875-c4ed-43b6-8658-aa4e52324fdf,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T17:34:21Z,topic='l3_agent')) {'router_ids': ['891972ea-8a57-4573-a1da-d47e23a8e0a1'], 'active': True} {{(pid=99029) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:34:58.439720 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_dvr_db [None req-6c8f6e84-622e-4412-a394-a9c733200fc9 None None] Set router 891972ea-8a57-4573-a1da-d47e23a8e0a1 gateway port host: None {{(pid=99029) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 17:34:58.811468 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_hamode_db [None req-6c8f6e84-622e-4412-a394-a9c733200fc9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcae7c99a90>, [{'id': '891972ea-8a57-4573-a1da-d47e23a8e0a1', 'name': 'router1', 'tenant_id': '12fb4bc5180b4a2b947845fbaad4dffc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:34:46Z', 'updated_at': '2021-05-25T17:34:57Z', 'revision_number': 2, 'project_id': '12fb4bc5180b4a2b947845fbaad4dffc', 'gw_port_host': None, '_interfaces': [{'id': 'ae1d1c44-513c-4b18-be03-3e9111372d24', 'name': '', 'network_id': '4edd9e75-e73f-4268-a103-709560cae7d5', 'tenant_id': '12fb4bc5180b4a2b947845fbaad4dffc', 'mac_address': 'fa:16:3e:1a:55:e3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '891972ea-8a57-4573-a1da-d47e23a8e0a1', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '9c8e2274-27a5-431a-94be-cfb15ecbe039', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:34:56Z', 'updated_at': '2021-05-25T17:34:57Z', 'revision_number': 2, 'project_id': '12fb4bc5180b4a2b947845fbaad4dffc', 'subnets': [{'id': '9c8e2274-27a5-431a-94be-cfb15ecbe039', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '6f7dd76a-6a1a-499f-be76-0b2c573bc951'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-789564-2-iscsi', False) {} {{(pid=99029) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:34:58.816393 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6c8f6e84-622e-4412-a394-a9c733200fc9 None None] Checking router: 891972ea-8a57-4573-a1da-d47e23a8e0a1 for host: dv-cinder-789564-2-iscsi {{(pid=99029) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 25 17:34:58.816765 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6c8f6e84-622e-4412-a394-a9c733200fc9 None None] Updating router 891972ea-8a57-4573-a1da-d47e23a8e0a1 port ae1d1c44-513c-4b18-be03-3e9111372d24 binding host dv-cinder-789564-2-iscsi {{(pid=99029) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 25 17:34:58.868427 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron_lib.callbacks.manager [None req-6c8f6e84-622e-4412-a394-a9c733200fc9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99029) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:34:59.358423 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron_lib.callbacks.manager [None req-6c8f6e84-622e-4412-a394-a9c733200fc9 None None] Notify callbacks [] for port, precommit_update {{(pid=99029) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:34:59.373720 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.provisioning_blocks [None req-6c8f6e84-622e-4412-a394-a9c733200fc9 None None] Transition to ACTIVE for port object ae1d1c44-513c-4b18-be03-3e9111372d24 will not be triggered until provisioned by entity L2. {{(pid=99029) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 17:34:59.465471 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron_lib.callbacks.manager [None req-6c8f6e84-622e-4412-a394-a9c733200fc9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99029) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:34:59.470777 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:34:59.638212 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-009906de-ed50-4a1c-a917-e873b47dabad None None] Pushing event updated for resources: {'Port': ['ID=ae1d1c44-513c-4b18-be03-3e9111372d24,revision_number=3']} {{(pid=99029) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:34:59.683344 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-009906de-ed50-4a1c-a917-e873b47dabad None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99029) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:34:59.683686 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-009906de-ed50-4a1c-a917-e873b47dabad None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99029) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:34:59.684014 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-009906de-ed50-4a1c-a917-e873b47dabad None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99029) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:34:59.684332 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-009906de-ed50-4a1c-a917-e873b47dabad None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99029) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:34:59.684646 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-009906de-ed50-4a1c-a917-e873b47dabad None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99029) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:34:59.684959 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-009906de-ed50-4a1c-a917-e873b47dabad None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99029) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:34:59.685296 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-009906de-ed50-4a1c-a917-e873b47dabad None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99029) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:34:59.685607 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-009906de-ed50-4a1c-a917-e873b47dabad None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99029) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:34:59.685920 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-009906de-ed50-4a1c-a917-e873b47dabad None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99029) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:34:59.686224 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-009906de-ed50-4a1c-a917-e873b47dabad None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99029) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:34:59.686526 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-009906de-ed50-4a1c-a917-e873b47dabad None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99029) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:34:59.686859 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-009906de-ed50-4a1c-a917-e873b47dabad None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99029) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:34:59.688348 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-009906de-ed50-4a1c-a917-e873b47dabad None None] Tracked resource versions report:
May 25 17:34:59.688348 dv-cinder-789564-2-iscsi neutron-server[99029]: pushed versions:
May 25 17:34:59.688348 dv-cinder-789564-2-iscsi neutron-server[99029]: {   'AddressGroup': {'1.2'},
May 25 17:34:59.688348 dv-cinder-789564-2-iscsi neutron-server[99029]:     'ConntrackHelper': {'1.0'},
May 25 17:34:59.688348 dv-cinder-789564-2-iscsi neutron-server[99029]:     'Log': {'1.0'},
May 25 17:34:59.688348 dv-cinder-789564-2-iscsi neutron-server[99029]:     'Network': {'1.1'},
May 25 17:34:59.688348 dv-cinder-789564-2-iscsi neutron-server[99029]:     'Port': {'1.7'},
May 25 17:34:59.688348 dv-cinder-789564-2-iscsi neutron-server[99029]:     'PortForwarding': {'1.2'},
May 25 17:34:59.688348 dv-cinder-789564-2-iscsi neutron-server[99029]:     'QosPolicy': {'1.8'},
May 25 17:34:59.688348 dv-cinder-789564-2-iscsi neutron-server[99029]:     'SecurityGroup': {'1.4'},
May 25 17:34:59.688348 dv-cinder-789564-2-iscsi neutron-server[99029]:     'SecurityGroupRule': {'1.2'},
May 25 17:34:59.688348 dv-cinder-789564-2-iscsi neutron-server[99029]:     'SubPort': {'1.0'},
May 25 17:34:59.688348 dv-cinder-789564-2-iscsi neutron-server[99029]:     'Subnet': {'1.1'},
May 25 17:34:59.688348 dv-cinder-789564-2-iscsi neutron-server[99029]:     'Trunk': {'1.1'}}
May 25 17:34:59.688348 dv-cinder-789564-2-iscsi neutron-server[99029]: consumer versions:
May 25 17:34:59.688348 dv-cinder-789564-2-iscsi neutron-server[99029]: {   DHCP agent@dv-cinder-789564-2-iscsi: {},
May 25 17:34:59.688348 dv-cinder-789564-2-iscsi neutron-server[99029]:     L3 agent@dv-cinder-789564-2-iscsi: {},
May 25 17:34:59.688348 dv-cinder-789564-2-iscsi neutron-server[99029]:     Metadata agent@dv-cinder-789564-2-iscsi: {},
May 25 17:34:59.688348 dv-cinder-789564-2-iscsi neutron-server[99029]:     Metering agent@dv-cinder-789564-2-iscsi: {},
May 25 17:34:59.688348 dv-cinder-789564-2-iscsi neutron-server[99029]:     Open vSwitch agent@dv-cinder-789564-2-iscsi: {   'AddressGroup': '1.2',
May 25 17:34:59.688348 dv-cinder-789564-2-iscsi neutron-server[99029]:                                                      'ConntrackHelper': '1.0',
May 25 17:34:59.688348 dv-cinder-789564-2-iscsi neutron-server[99029]:                                                      'Log': '1.0',
May 25 17:34:59.688348 dv-cinder-789564-2-iscsi neutron-server[99029]:                                                      'Network': '1.1',
May 25 17:34:59.688348 dv-cinder-789564-2-iscsi neutron-server[99029]:                                                      'Port': '1.7',
May 25 17:34:59.688348 dv-cinder-789564-2-iscsi neutron-server[99029]:                                                      'PortForwarding': '1.2',
May 25 17:34:59.688348 dv-cinder-789564-2-iscsi neutron-server[99029]:                                                      'QosPolicy': '1.8',
May 25 17:34:59.688348 dv-cinder-789564-2-iscsi neutron-server[99029]:                                                      'SecurityGroup': '1.4',
May 25 17:34:59.688348 dv-cinder-789564-2-iscsi neutron-server[99029]:                                                      'SecurityGroupRule': '1.2',
May 25 17:34:59.688348 dv-cinder-789564-2-iscsi neutron-server[99029]:                                                      'SubPort': '1.0',
May 25 17:34:59.688348 dv-cinder-789564-2-iscsi neutron-server[99029]:                                                      'Subnet': '1.1',
May 25 17:34:59.688348 dv-cinder-789564-2-iscsi neutron-server[99029]:                                                      'Trunk': '1.1'}}
May 25 17:34:59.688348 dv-cinder-789564-2-iscsi neutron-server[99029]:  {{(pid=99029) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
May 25 17:34:59.699692 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG oslo_concurrency.lockutils [None req-009906de-ed50-4a1c-a917-e873b47dabad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.229s {{(pid=99029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:34:59.707209 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.plugins.ml2.managers [None req-6c8f6e84-622e-4412-a394-a9c733200fc9 None None] Attempting to bind port ae1d1c44-513c-4b18-be03-3e9111372d24 on host dv-cinder-789564-2-iscsi for vnic_type normal with profile  {{(pid=99029) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 17:34:59.707594 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.plugins.ml2.managers [None req-6c8f6e84-622e-4412-a394-a9c733200fc9 None None] Attempting to bind port ae1d1c44-513c-4b18-be03-3e9111372d24 by drivers openvswitch,hyperv on host dv-cinder-789564-2-iscsi at level 0 using segments [{'id': '46ed7828-a393-47d0-875c-86a5a4862adb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1341, 'network_id': '4edd9e75-e73f-4268-a103-709560cae7d5'}] {{(pid=99029) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 17:34:59.708034 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6c8f6e84-622e-4412-a394-a9c733200fc9 None None] Attempting to bind port ae1d1c44-513c-4b18-be03-3e9111372d24 on network 4edd9e75-e73f-4268-a103-709560cae7d5 {{(pid=99029) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 17:34:59.713816 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6c8f6e84-622e-4412-a394-a9c733200fc9 None None] Checking agent: {'id': '7bb67520-1e97-4ad9-9b97-101068bbe1a3', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-789564-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 17, 34, 21), 'started_at': datetime.datetime(2021, 5, 25, 17, 34, 51), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 17, 34, 51), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-789564-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=99029) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 17:34:59.714215 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6c8f6e84-622e-4412-a394-a9c733200fc9 None None] Checking segment: {'id': '46ed7828-a393-47d0-875c-86a5a4862adb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1341, 'network_id': '4edd9e75-e73f-4268-a103-709560cae7d5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=99029) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 17:34:59.714675 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron_lib.callbacks.manager [None req-6c8f6e84-622e-4412-a394-a9c733200fc9 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=99029) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:34:59.715052 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6c8f6e84-622e-4412-a394-a9c733200fc9 None None] Bound using segment: {'id': '46ed7828-a393-47d0-875c-86a5a4862adb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1341, 'network_id': '4edd9e75-e73f-4268-a103-709560cae7d5'} {{(pid=99029) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 17:34:59.715576 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.plugins.ml2.managers [None req-6c8f6e84-622e-4412-a394-a9c733200fc9 None None] Bound port: ae1d1c44-513c-4b18-be03-3e9111372d24, host: dv-cinder-789564-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '46ed7828-a393-47d0-875c-86a5a4862adb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1341, 'network_id': '4edd9e75-e73f-4268-a103-709560cae7d5'}}] {{(pid=99029) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 17:34:59.715937 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron_lib.callbacks.manager [None req-6c8f6e84-622e-4412-a394-a9c733200fc9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99029) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:34:59.805026 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.plugins.ml2.db [None req-6c8f6e84-622e-4412-a394-a9c733200fc9 None None] For port ae1d1c44-513c-4b18-be03-3e9111372d24, host dv-cinder-789564-2-iscsi, cleared binding levels {{(pid=99029) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 17:34:59.809205 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.plugins.ml2.db [None req-6c8f6e84-622e-4412-a394-a9c733200fc9 None None] For port ae1d1c44-513c-4b18-be03-3e9111372d24, host dv-cinder-789564-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=ae1d1c44-513c-4b18-be03-3e9111372d24,segment=NetworkSegment(46ed7828-a393-47d0-875c-86a5a4862adb),segment_id=46ed7828-a393-47d0-875c-86a5a4862adb)] {{(pid=99029) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 17:34:59.870969 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron_lib.callbacks.manager [None req-6c8f6e84-622e-4412-a394-a9c733200fc9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99029) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:34:59.875075 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:34:59.984654 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-009906de-ed50-4a1c-a917-e873b47dabad None None] Pushing event updated for resources: {'Port': ['ID=ae1d1c44-513c-4b18-be03-3e9111372d24,revision_number=4']} {{(pid=99029) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:34:59.987358 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6c8f6e84-622e-4412-a394-a9c733200fc9 None None] Routers {'891972ea-8a57-4573-a1da-d47e23a8e0a1'} bound to L3 agent in host dv-cinder-789564-2-iscsi {{(pid=99029) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 17:34:59.987970 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_hamode_db [None req-6c8f6e84-622e-4412-a394-a9c733200fc9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcae7c99a90>, 'dv-cinder-789564-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-05-25T17:34:21Z,description=<?>,heartbeat_timestamp=2021-05-25T17:34:51Z,host='dv-cinder-789564-2-iscsi',id=eaeb6875-c4ed-43b6-8658-aa4e52324fdf,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T17:34:21Z,topic='l3_agent')) {'router_ids': ['891972ea-8a57-4573-a1da-d47e23a8e0a1'], 'active': True} {{(pid=99029) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:35:00.106050 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG oslo_concurrency.lockutils [None req-009906de-ed50-4a1c-a917-e873b47dabad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.230s {{(pid=99029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:35:00.148693 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_dvr_db [None req-6c8f6e84-622e-4412-a394-a9c733200fc9 None None] Set router 891972ea-8a57-4573-a1da-d47e23a8e0a1 gateway port host: None {{(pid=99029) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 17:35:00.471669 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 38572) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:35:00.513012 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_hamode_db [None req-6c8f6e84-622e-4412-a394-a9c733200fc9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcae7c99a90>, [{'id': '891972ea-8a57-4573-a1da-d47e23a8e0a1', 'name': 'router1', 'tenant_id': '12fb4bc5180b4a2b947845fbaad4dffc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:34:46Z', 'updated_at': '2021-05-25T17:34:57Z', 'revision_number': 2, 'project_id': '12fb4bc5180b4a2b947845fbaad4dffc', 'gw_port_host': None, '_interfaces': [{'id': 'ae1d1c44-513c-4b18-be03-3e9111372d24', 'name': '', 'network_id': '4edd9e75-e73f-4268-a103-709560cae7d5', 'tenant_id': '12fb4bc5180b4a2b947845fbaad4dffc', 'mac_address': 'fa:16:3e:1a:55:e3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '891972ea-8a57-4573-a1da-d47e23a8e0a1', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '9c8e2274-27a5-431a-94be-cfb15ecbe039', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:34:56Z', 'updated_at': '2021-05-25T17:34:59Z', 'revision_number': 4, 'project_id': '12fb4bc5180b4a2b947845fbaad4dffc', 'subnets': [{'id': '9c8e2274-27a5-431a-94be-cfb15ecbe039', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '6f7dd76a-6a1a-499f-be76-0b2c573bc951'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-789564-2-iscsi', False) {} {{(pid=99029) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:35:00.517013 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6c8f6e84-622e-4412-a394-a9c733200fc9 None None] The sync data for ids ['891972ea-8a57-4573-a1da-d47e23a8e0a1'] in dv-cinder-789564-2-iscsi is: [{'id': '891972ea-8a57-4573-a1da-d47e23a8e0a1', 'name': 'router1', 'tenant_id': '12fb4bc5180b4a2b947845fbaad4dffc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:34:46Z', 'updated_at': '2021-05-25T17:34:57Z', 'revision_number': 2, 'project_id': '12fb4bc5180b4a2b947845fbaad4dffc', 'gw_port_host': None, '_interfaces': [{'id': 'ae1d1c44-513c-4b18-be03-3e9111372d24', 'name': '', 'network_id': '4edd9e75-e73f-4268-a103-709560cae7d5', 'tenant_id': '12fb4bc5180b4a2b947845fbaad4dffc', 'mac_address': 'fa:16:3e:1a:55:e3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '891972ea-8a57-4573-a1da-d47e23a8e0a1', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '9c8e2274-27a5-431a-94be-cfb15ecbe039', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:34:56Z', 'updated_at': '2021-05-25T17:34:59Z', 'revision_number': 4, 'project_id': '12fb4bc5180b4a2b947845fbaad4dffc', 'subnets': [{'id': '9c8e2274-27a5-431a-94be-cfb15ecbe039', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '6f7dd76a-6a1a-499f-be76-0b2c573bc951'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=99029) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 25 17:35:00.665717 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a5241457-b634-425a-811e-6ad6cbbfa7c1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:35:00.667682 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-a5241457-b634-425a-811e-6ad6cbbfa7c1 admin admin] 10.222.0.122 "GET /v2.0/networks/eb7ec72b-a691-481b-8d7e-42c05e13a8cb HTTP/1.1" status: 200  len: 842 time: 0.1950569
May 25 17:35:00.676860 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.v2.base [None req-c8a4b9c3-4d80-44d7-9891-d01d9d86b9e0 admin admin] Request body: {'subnet': {'enable_dhcp': False, 'cidr': '172.27.3.0/24', 'name': 'public-subnet', 'gateway_ip': '172.27.3.1', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'ip_version': 4}} {{(pid=99026) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:35:00.682053 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-c8a4b9c3-4d80-44d7-9891-d01d9d86b9e0 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:35:00.686587 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-c8a4b9c3-4d80-44d7-9891-d01d9d86b9e0 admin admin] Usage tracker for resource:subnet and tenant:537bb945cac6475e8b1205f34ad1e207 is out of sync, need to count used quota {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:35:00.689795 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-c8a4b9c3-4d80-44d7-9891-d01d9d86b9e0 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:35:00.695774 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-c8a4b9c3-4d80-44d7-9891-d01d9d86b9e0 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:35:00.772860 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c8a4b9c3-4d80-44d7-9891-d01d9d86b9e0 admin admin] Made reservation on behalf of 537bb945cac6475e8b1205f34ad1e207 for: {'subnet': 1} {{(pid=99026) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 17:35:00.775194 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-c8a4b9c3-4d80-44d7-9891-d01d9d86b9e0 admin admin] Notify callbacks [] for subnet, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:35:01.292916 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.objects.ports [None req-c8a4b9c3-4d80-44d7-9891-d01d9d86b9e0 admin admin] Time-cost: Fetching 0 ports in 0 security groups {{(pid=99026) get_objects /opt/stack/neutron/neutron/objects/ports.py:443}}
May 25 17:35:01.293397 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-c8a4b9c3-4d80-44d7-9891-d01d9d86b9e0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114466', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411'] for subnet, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:35:01.297729 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:35:01.368620 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8a4b9c3-4d80-44d7-9891-d01d9d86b9e0 admin admin] Pushing event updated for resources: {'Subnet': ['ID=d6898f5f-da0b-4428-97b4-4cbe3e83caaa,revision_number=0']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:35:01.373840 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-c8a4b9c3-4d80-44d7-9891-d01d9d86b9e0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:35:01.376474 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c8a4b9c3-4d80-44d7-9891-d01d9d86b9e0 admin admin] Checking segment: {'id': '471771f9-c462-4865-800d-0d5029e9eb3e', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=99026) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 17:35:01.376824 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c8a4b9c3-4d80-44d7-9891-d01d9d86b9e0 admin admin] Network hostable DHCP agents. Network: eb7ec72b-a691-481b-8d7e-42c05e13a8cb, hostable agents: ['c8b0a350-254b-4562-874b-120ecdef0e25'], hosted agents: [] {{(pid=99026) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 25 17:35:01.481935 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c8a4b9c3-4d80-44d7-9891-d01d9d86b9e0 admin admin] Network eb7ec72b-a691-481b-8d7e-42c05e13a8cb is scheduled to be hosted by DHCP agent c8b0a350-254b-4562-874b-120ecdef0e25 with binding_index 1 {{(pid=99026) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 25 17:35:01.550783 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.scheduler.base_scheduler [None req-c8a4b9c3-4d80-44d7-9891-d01d9d86b9e0 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-789564-2-iscsi, eb7ec72b-a691-481b-8d7e-42c05e13a8cb) {{(pid=99026) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 17:35:01.554855 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c8a4b9c3-4d80-44d7-9891-d01d9d86b9e0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:35:01.555442 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-c8a4b9c3-4d80-44d7-9891-d01d9d86b9e0 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for subnet, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:35:01.562015 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9c4913ce-49f9-42b4-ad42-99d8d89b49e5 None None] Network eb7ec72b-a691-481b-8d7e-42c05e13a8cb requested from dv-cinder-789564-2-iscsi {{(pid=99028) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 17:35:01.652606 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-c8a4b9c3-4d80-44d7-9891-d01d9d86b9e0 admin admin] 10.222.0.122 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 821 time: 0.9790552
May 25 17:35:01.766358 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-442b3a99-c086-4ac5-bd87-d06394f344bf None None] Network eb7ec72b-a691-481b-8d7e-42c05e13a8cb requested from dv-cinder-789564-2-iscsi {{(pid=99028) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 17:35:03.936844 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 38586) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:35:04.131972 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-410b50ce-2cde-413c-93cc-a87e8654fe6e admin admin] 10.222.0.122 "GET /v2.0/routers/891972ea-8a57-4573-a1da-d47e23a8e0a1 HTTP/1.1" status: 200  len: 710 time: 0.1939385
May 25 17:35:04.266368 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4120280a-bc15-41db-8a2d-5775c80a0284 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:35:04.268047 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-4120280a-bc15-41db-8a2d-5775c80a0284 admin admin] 10.222.0.122 "GET /v2.0/networks/eb7ec72b-a691-481b-8d7e-42c05e13a8cb HTTP/1.1" status: 200  len: 886 time: 0.1301992
May 25 17:35:04.276391 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.v2.base [None req-4aba278a-ace1-4979-959f-0579123e3658 admin admin] Request body: {'router': {'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb'}}} {{(pid=99026) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:35:04.766880 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-4aba278a-ace1-4979-959f-0579123e3658 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-420002', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-415082', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-6970'] for router, precommit_update {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:35:04.770481 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device ae1d1c44-513c-4b18-be03-3e9111372d24 up at agent ovs-agent-dv-cinder-789564-2-iscsi {{(pid=99028) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 17:35:04.930781 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Provisioning for port ae1d1c44-513c-4b18-be03-3e9111372d24 completed by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 17:35:04.935931 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Provisioning complete for port ae1d1c44-513c-4b18-be03-3e9111372d24 triggered by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 17:35:04.936314 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:35:05.056912 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:35:05.090868 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] For port ae1d1c44-513c-4b18-be03-3e9111372d24, host dv-cinder-789564-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=ae1d1c44-513c-4b18-be03-3e9111372d24,segment=NetworkSegment(46ed7828-a393-47d0-875c-86a5a4862adb),segment_id=46ed7828-a393-47d0-875c-86a5a4862adb)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:35:05.169205 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-4aba278a-ace1-4979-959f-0579123e3658 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:35:05.170745 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:35:05.173335 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:35:05.225208 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-4aba278a-ace1-4979-959f-0579123e3658 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:35:05.243018 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Pushing event updated for resources: {'Port': ['ID=ae1d1c44-513c-4b18-be03-3e9111372d24,revision_number=5']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:35:05.246257 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:35:05.363056 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.db_base_plugin_common [None req-4aba278a-ace1-4979-959f-0579123e3658 admin admin] Allocated IP 172.27.3.85 (eb7ec72b-a691-481b-8d7e-42c05e13a8cb/d6898f5f-da0b-4428-97b4-4cbe3e83caaa/9dc6f1e7-025f-406c-8e93-01d4c5994aea) {{(pid=99026) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 17:35:05.511579 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-4aba278a-ace1-4979-959f-0579123e3658 admin admin] Notify callbacks [] for port, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:35:05.602237 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-4aba278a-ace1-4979-959f-0579123e3658 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781840788179'] for port, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:35:05.606612 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-8a2aea2e-9cd4-4269-b9f7-ae4cfcda55b7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:35:05.673475 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4aba278a-ace1-4979-959f-0579123e3658 admin admin] Network eb7ec72b-a691-481b-8d7e-42c05e13a8cb is already hosted by enough agents. {{(pid=99026) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 17:35:05.675918 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.scheduler.base_scheduler [None req-4aba278a-ace1-4979-959f-0579123e3658 admin admin] Resources bound (agent type, host, resource id):  {{(pid=99026) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 17:35:05.679895 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4aba278a-ace1-4979-959f-0579123e3658 admin admin] Received port after_create {{(pid=99026) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 17:35:05.734756 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4aba278a-ace1-4979-959f-0579123e3658 admin admin] Pushing event updated for resources: {'Port': ['ID=9dc6f1e7-025f-406c-8e93-01d4c5994aea,revision_number=1']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:35:05.744661 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-4aba278a-ace1-4979-959f-0579123e3658 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.138s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:35:06.159777 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-4aba278a-ace1-4979-959f-0579123e3658 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:35:06.548041 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-4aba278a-ace1-4979-959f-0579123e3658 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-420002', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-415082', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-6970'] for router, precommit_update {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:35:06.551479 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-4aba278a-ace1-4979-959f-0579123e3658 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-420065', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-420009', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-420072', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-415100'] for router, after_update {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:35:06.734079 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4aba278a-ace1-4979-959f-0579123e3658 admin admin] Router 891972ea-8a57-4573-a1da-d47e23a8e0a1 has already been hosted by L3 agent eaeb6875-c4ed-43b6-8658-aa4e52324fdf {{(pid=99026) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 25 17:35:06.757683 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device ae1d1c44-513c-4b18-be03-3e9111372d24 up at agent ovs-agent-dv-cinder-789564-2-iscsi {{(pid=99028) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 17:35:06.827238 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Provisioning complete for port ae1d1c44-513c-4b18-be03-3e9111372d24 triggered by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 17:35:06.827523 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:35:06.921238 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4aba278a-ace1-4979-959f-0579123e3658 admin admin] Notify agent at l3_agent.dv-cinder-789564-2-iscsi the message routers_updated {{(pid=99026) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 25 17:35:06.930122 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-4aba278a-ace1-4979-959f-0579123e3658 admin admin] Notify callbacks [] for router, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:35:06.932119 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-4aba278a-ace1-4979-959f-0579123e3658 admin admin] 10.222.0.122 "PUT /v2.0/routers/891972ea-8a57-4573-a1da-d47e23a8e0a1 HTTP/1.1" status: 200  len: 889 time: 2.6584477
May 25 17:35:06.932737 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0ff43688-1813-48f2-9506-2aab0cfe3afe None None] Sync routers for ids ['891972ea-8a57-4573-a1da-d47e23a8e0a1'] in dv-cinder-789564-2-iscsi {{(pid=99028) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 25 17:35:06.953231 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0ff43688-1813-48f2-9506-2aab0cfe3afe None None] Routers {'891972ea-8a57-4573-a1da-d47e23a8e0a1'} bound to L3 agent in host dv-cinder-789564-2-iscsi {{(pid=99028) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 17:35:06.953914 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-0ff43688-1813-48f2-9506-2aab0cfe3afe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcae7304730>, 'dv-cinder-789564-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-05-25T17:34:21Z,description=<?>,heartbeat_timestamp=2021-05-25T17:34:51Z,host='dv-cinder-789564-2-iscsi',id=eaeb6875-c4ed-43b6-8658-aa4e52324fdf,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T17:34:21Z,topic='l3_agent')) {'router_ids': ['891972ea-8a57-4573-a1da-d47e23a8e0a1'], 'active': True} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:35:07.183226 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvr_db [None req-0ff43688-1813-48f2-9506-2aab0cfe3afe None None] Set router 891972ea-8a57-4573-a1da-d47e23a8e0a1 gateway port host: dv-cinder-789564-2-iscsi {{(pid=99028) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 17:35:07.526863 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-0ff43688-1813-48f2-9506-2aab0cfe3afe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcae7304730>, [{'id': '891972ea-8a57-4573-a1da-d47e23a8e0a1', 'name': 'router1', 'tenant_id': '12fb4bc5180b4a2b947845fbaad4dffc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.85'}], 'enable_snat': True}, 'gw_port_id': '9dc6f1e7-025f-406c-8e93-01d4c5994aea', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:34:46Z', 'updated_at': '2021-05-25T17:35:05Z', 'revision_number': 4, 'project_id': '12fb4bc5180b4a2b947845fbaad4dffc', 'gw_port': {'id': '9dc6f1e7-025f-406c-8e93-01d4c5994aea', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:f5:e2:4f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '891972ea-8a57-4573-a1da-d47e23a8e0a1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.85', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:35:05Z', 'updated_at': '2021-05-25T17:35:05Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi', '_interfaces': [{'id': 'ae1d1c44-513c-4b18-be03-3e9111372d24', 'name': '', 'network_id': '4edd9e75-e73f-4268-a103-709560cae7d5', 'tenant_id': '12fb4bc5180b4a2b947845fbaad4dffc', 'mac_address': 'fa:16:3e:1a:55:e3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '891972ea-8a57-4573-a1da-d47e23a8e0a1', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '9c8e2274-27a5-431a-94be-cfb15ecbe039', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:34:56Z', 'updated_at': '2021-05-25T17:35:05Z', 'revision_number': 5, 'project_id': '12fb4bc5180b4a2b947845fbaad4dffc', 'subnets': [{'id': '9c8e2274-27a5-431a-94be-cfb15ecbe039', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '6f7dd76a-6a1a-499f-be76-0b2c573bc951'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-789564-2-iscsi', False) {} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:35:07.532672 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0ff43688-1813-48f2-9506-2aab0cfe3afe None None] Checking router: 891972ea-8a57-4573-a1da-d47e23a8e0a1 for host: dv-cinder-789564-2-iscsi {{(pid=99028) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 25 17:35:07.533023 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0ff43688-1813-48f2-9506-2aab0cfe3afe None None] Updating router 891972ea-8a57-4573-a1da-d47e23a8e0a1 port 9dc6f1e7-025f-406c-8e93-01d4c5994aea binding host dv-cinder-789564-2-iscsi {{(pid=99028) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 25 17:35:07.590110 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-0ff43688-1813-48f2-9506-2aab0cfe3afe None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:35:07.937380 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-0ff43688-1813-48f2-9506-2aab0cfe3afe None None] Notify callbacks [] for port, precommit_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:35:07.950125 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-0ff43688-1813-48f2-9506-2aab0cfe3afe None None] Transition to ACTIVE for port object 9dc6f1e7-025f-406c-8e93-01d4c5994aea will not be triggered until provisioned by entity L2. {{(pid=99028) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 17:35:08.016522 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-0ff43688-1813-48f2-9506-2aab0cfe3afe None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:35:08.020664 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:35:08.097361 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.managers [None req-0ff43688-1813-48f2-9506-2aab0cfe3afe None None] Attempting to bind port 9dc6f1e7-025f-406c-8e93-01d4c5994aea on host dv-cinder-789564-2-iscsi for vnic_type normal with profile  {{(pid=99028) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 17:35:08.097734 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.managers [None req-0ff43688-1813-48f2-9506-2aab0cfe3afe None None] Attempting to bind port 9dc6f1e7-025f-406c-8e93-01d4c5994aea by drivers openvswitch,hyperv on host dv-cinder-789564-2-iscsi at level 0 using segments [{'id': '471771f9-c462-4865-800d-0d5029e9eb3e', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb'}] {{(pid=99028) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 17:35:08.098102 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0ff43688-1813-48f2-9506-2aab0cfe3afe None None] Attempting to bind port 9dc6f1e7-025f-406c-8e93-01d4c5994aea on network eb7ec72b-a691-481b-8d7e-42c05e13a8cb {{(pid=99028) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 17:35:08.100251 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93bc2756-fb99-44ad-b948-26684c9058a3 None None] Pushing event updated for resources: {'Port': ['ID=9dc6f1e7-025f-406c-8e93-01d4c5994aea,revision_number=2']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:35:08.103966 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-93bc2756-fb99-44ad-b948-26684c9058a3 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.083s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:35:08.106987 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0ff43688-1813-48f2-9506-2aab0cfe3afe None None] Checking agent: {'id': '7bb67520-1e97-4ad9-9b97-101068bbe1a3', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-789564-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 17, 34, 21), 'started_at': datetime.datetime(2021, 5, 25, 17, 34, 51), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 17, 34, 51), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-789564-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=99028) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 17:35:08.107366 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0ff43688-1813-48f2-9506-2aab0cfe3afe None None] Checking segment: {'id': '471771f9-c462-4865-800d-0d5029e9eb3e', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=99028) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 17:35:08.108556 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-0ff43688-1813-48f2-9506-2aab0cfe3afe None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:35:08.108556 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0ff43688-1813-48f2-9506-2aab0cfe3afe None None] Bound using segment: {'id': '471771f9-c462-4865-800d-0d5029e9eb3e', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb'} {{(pid=99028) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 17:35:08.108712 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.managers [None req-0ff43688-1813-48f2-9506-2aab0cfe3afe None None] Bound port: 9dc6f1e7-025f-406c-8e93-01d4c5994aea, host: dv-cinder-789564-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '471771f9-c462-4865-800d-0d5029e9eb3e', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb'}}] {{(pid=99028) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 17:35:08.108950 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-0ff43688-1813-48f2-9506-2aab0cfe3afe None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:35:08.186818 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-0ff43688-1813-48f2-9506-2aab0cfe3afe None None] For port 9dc6f1e7-025f-406c-8e93-01d4c5994aea, host dv-cinder-789564-2-iscsi, cleared binding levels {{(pid=99028) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 17:35:08.198413 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-0ff43688-1813-48f2-9506-2aab0cfe3afe None None] For port 9dc6f1e7-025f-406c-8e93-01d4c5994aea, host dv-cinder-789564-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=9dc6f1e7-025f-406c-8e93-01d4c5994aea,segment=NetworkSegment(471771f9-c462-4865-800d-0d5029e9eb3e),segment_id=471771f9-c462-4865-800d-0d5029e9eb3e)] {{(pid=99028) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 17:35:08.276735 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-0ff43688-1813-48f2-9506-2aab0cfe3afe None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:35:08.281484 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:35:08.357100 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0ff43688-1813-48f2-9506-2aab0cfe3afe None None] Routers {'891972ea-8a57-4573-a1da-d47e23a8e0a1'} bound to L3 agent in host dv-cinder-789564-2-iscsi {{(pid=99028) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 17:35:08.357740 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-0ff43688-1813-48f2-9506-2aab0cfe3afe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcae7304730>, 'dv-cinder-789564-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-05-25T17:34:21Z,description=<?>,heartbeat_timestamp=2021-05-25T17:34:51Z,host='dv-cinder-789564-2-iscsi',id=eaeb6875-c4ed-43b6-8658-aa4e52324fdf,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T17:34:21Z,topic='l3_agent')) {'router_ids': ['891972ea-8a57-4573-a1da-d47e23a8e0a1'], 'active': True} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:35:08.414652 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93bc2756-fb99-44ad-b948-26684c9058a3 None None] Pushing event updated for resources: {'Port': ['ID=9dc6f1e7-025f-406c-8e93-01d4c5994aea,revision_number=3']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:35:08.425517 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-93bc2756-fb99-44ad-b948-26684c9058a3 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.144s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:35:08.544094 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvr_db [None req-0ff43688-1813-48f2-9506-2aab0cfe3afe None None] Set router 891972ea-8a57-4573-a1da-d47e23a8e0a1 gateway port host: dv-cinder-789564-2-iscsi {{(pid=99028) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 17:35:08.889445 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-0ff43688-1813-48f2-9506-2aab0cfe3afe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcae7304730>, [{'id': '891972ea-8a57-4573-a1da-d47e23a8e0a1', 'name': 'router1', 'tenant_id': '12fb4bc5180b4a2b947845fbaad4dffc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.85'}], 'enable_snat': True}, 'gw_port_id': '9dc6f1e7-025f-406c-8e93-01d4c5994aea', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:34:46Z', 'updated_at': '2021-05-25T17:35:05Z', 'revision_number': 4, 'project_id': '12fb4bc5180b4a2b947845fbaad4dffc', 'gw_port': {'id': '9dc6f1e7-025f-406c-8e93-01d4c5994aea', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:f5:e2:4f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '891972ea-8a57-4573-a1da-d47e23a8e0a1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.85', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:35:05Z', 'updated_at': '2021-05-25T17:35:08Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi', '_interfaces': [{'id': 'ae1d1c44-513c-4b18-be03-3e9111372d24', 'name': '', 'network_id': '4edd9e75-e73f-4268-a103-709560cae7d5', 'tenant_id': '12fb4bc5180b4a2b947845fbaad4dffc', 'mac_address': 'fa:16:3e:1a:55:e3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '891972ea-8a57-4573-a1da-d47e23a8e0a1', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '9c8e2274-27a5-431a-94be-cfb15ecbe039', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:34:56Z', 'updated_at': '2021-05-25T17:35:05Z', 'revision_number': 5, 'project_id': '12fb4bc5180b4a2b947845fbaad4dffc', 'subnets': [{'id': '9c8e2274-27a5-431a-94be-cfb15ecbe039', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '6f7dd76a-6a1a-499f-be76-0b2c573bc951'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-789564-2-iscsi', False) {} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:35:08.893743 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0ff43688-1813-48f2-9506-2aab0cfe3afe None None] The sync data for ids ['891972ea-8a57-4573-a1da-d47e23a8e0a1'] in dv-cinder-789564-2-iscsi is: [{'id': '891972ea-8a57-4573-a1da-d47e23a8e0a1', 'name': 'router1', 'tenant_id': '12fb4bc5180b4a2b947845fbaad4dffc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.85'}], 'enable_snat': True}, 'gw_port_id': '9dc6f1e7-025f-406c-8e93-01d4c5994aea', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:34:46Z', 'updated_at': '2021-05-25T17:35:05Z', 'revision_number': 4, 'project_id': '12fb4bc5180b4a2b947845fbaad4dffc', 'gw_port': {'id': '9dc6f1e7-025f-406c-8e93-01d4c5994aea', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:f5:e2:4f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '891972ea-8a57-4573-a1da-d47e23a8e0a1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.85', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:35:05Z', 'updated_at': '2021-05-25T17:35:08Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi', '_interfaces': [{'id': 'ae1d1c44-513c-4b18-be03-3e9111372d24', 'name': '', 'network_id': '4edd9e75-e73f-4268-a103-709560cae7d5', 'tenant_id': '12fb4bc5180b4a2b947845fbaad4dffc', 'mac_address': 'fa:16:3e:1a:55:e3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '891972ea-8a57-4573-a1da-d47e23a8e0a1', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '9c8e2274-27a5-431a-94be-cfb15ecbe039', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:34:56Z', 'updated_at': '2021-05-25T17:35:05Z', 'revision_number': 5, 'project_id': '12fb4bc5180b4a2b947845fbaad4dffc', 'subnets': [{'id': '9c8e2274-27a5-431a-94be-cfb15ecbe039', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '6f7dd76a-6a1a-499f-be76-0b2c573bc951'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=99028) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 25 17:35:09.396962 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 38596) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:35:09.518273 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-7b60347f-f046-4eaa-9bd8-f66d7cabcba0 admin admin] 10.222.0.122 "GET /v2.0/ports?device_owner=network%3Arouter_gateway&fields=id&fields=name&fields=mac_address&fields=fixed_ips&fields=status HTTP/1.1" status: 200  len: 410 time: 0.1201351
May 25 17:35:10.777058 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device 9dc6f1e7-025f-406c-8e93-01d4c5994aea up at agent ovs-agent-dv-cinder-789564-2-iscsi {{(pid=99028) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 17:35:10.956028 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Provisioning for port 9dc6f1e7-025f-406c-8e93-01d4c5994aea completed by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 17:35:10.961337 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Provisioning complete for port 9dc6f1e7-025f-406c-8e93-01d4c5994aea triggered by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 17:35:10.961716 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:35:11.077816 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:35:11.094357 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] For port 9dc6f1e7-025f-406c-8e93-01d4c5994aea, host dv-cinder-789564-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=9dc6f1e7-025f-406c-8e93-01d4c5994aea,segment=NetworkSegment(471771f9-c462-4865-800d-0d5029e9eb3e),segment_id=471771f9-c462-4865-800d-0d5029e9eb3e)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:35:11.161991 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:35:11.165455 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-f6e6293c-505c-4def-9f60-05da90d918a0 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:35:11.246035 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Pushing event updated for resources: {'Port': ['ID=9dc6f1e7-025f-406c-8e93-01d4c5994aea,revision_number=4']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:35:11.249208 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:35:12.774962 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device 9dc6f1e7-025f-406c-8e93-01d4c5994aea up at agent ovs-agent-dv-cinder-789564-2-iscsi {{(pid=99028) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 17:35:12.844922 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Provisioning complete for port 9dc6f1e7-025f-406c-8e93-01d4c5994aea triggered by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 17:35:12.845448 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:35:13.754084 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.agents_db [None req-14fae233-15dc-4576-836b-621c5f95b584 None None] Agent healthcheck: found 5 active agents {{(pid=99029) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 17:35:18.145491 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-80ccc5dd-464b-481a-8ce5-02bd96d2bdda None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:35:20.664795 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-88682e41-88fe-409a-b293-a655c361886c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:35:20.813599 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:35:21.658537 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-7e261f94-b84f-443e-be49-3bc1ac903b55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:35:23.213074 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-6df2b2a7-a54e-4d57-9be3-033078b9d5b3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:35:48.144161 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-51a15570-a562-4651-95da-587ebc40c79e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:35:50.661944 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-190304ce-69f4-4d9e-8341-a4fd94f5d999 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:35:50.763598 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.agents_db [None req-14fae233-15dc-4576-836b-621c5f95b584 None None] Agent healthcheck: found 5 active agents {{(pid=99029) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 17:35:50.833170 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:35:51.621489 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-7e261f94-b84f-443e-be49-3bc1ac903b55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:35:53.215966 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-6df2b2a7-a54e-4d57-9be3-033078b9d5b3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:36:18.115490 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-160d41d6-6ecf-490e-8718-a85f27061780 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:36:20.658984 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-f1d5d1d4-bd15-47e4-83bb-d4a977392f12 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:36:20.818076 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:36:21.629419 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-7e261f94-b84f-443e-be49-3bc1ac903b55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:36:23.215484 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-6df2b2a7-a54e-4d57-9be3-033078b9d5b3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:36:27.755180 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.agents_db [None req-14fae233-15dc-4576-836b-621c5f95b584 None None] Agent healthcheck: found 5 active agents {{(pid=99029) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 17:36:48.134127 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-ccd9a782-816c-4d08-a322-c297dad2c059 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:36:48.268000 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 39166) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:36:48.337283 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.pecan_wsgi.hooks.translation [None req-a9558fbd-ffe6-43c3-b6a1-54d6b05909bd admin admin] GET failed (client error): The resource could not be found.
May 25 17:36:48.338585 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-a9558fbd-ffe6-43c3-b6a1-54d6b05909bd admin admin] 10.222.0.122 "GET /v2.0/networks/private HTTP/1.1" status: 404  len: 315 time: 0.0696423
May 25 17:36:48.493261 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bfec17d0-6e5d-43f5-9e0b-652d84381254 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:36:48.494742 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-bfec17d0-6e5d-43f5-9e0b-652d84381254 admin admin] 10.222.0.122 "GET /v2.0/networks?name=private HTTP/1.1" status: 200  len: 873 time: 0.1523645
May 25 17:36:50.635428 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-a688c100-5711-42a3-af6f-3eff90047ee0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:36:50.679612 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 39176) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:36:50.787486 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1e624b0f-b468-4a09-9d1f-ff5604d1a031 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:36:50.788045 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-1e624b0f-b468-4a09-9d1f-ff5604d1a031 admin admin] Synchronizing usage tracker for tenant:537bb945cac6475e8b1205f34ad1e207 on resource:subnet {{(pid=99026) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 17:36:50.809602 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:36:50.894954 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-1e624b0f-b468-4a09-9d1f-ff5604d1a031 admin admin] Unset dirty status for tenant:537bb945cac6475e8b1205f34ad1e207 on resource:subnet {{(pid=99026) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 17:36:50.896080 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-1e624b0f-b468-4a09-9d1f-ff5604d1a031 admin admin] 10.222.0.122 "GET /v2.0/subnets/9c8e2274-27a5-431a-94be-cfb15ecbe039 HTTP/1.1" status: 200  len: 849 time: 0.2155271
May 25 17:36:50.906518 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.v2.base [None req-2bb2ee96-d1ef-4960-b0c3-9a951ed4d2e2 admin admin] Request body: {'subnet': {'dns_nameservers': ['8.8.8.8', '8.8.4.4']}} {{(pid=99026) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:36:51.026715 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-2bb2ee96-d1ef-4960-b0c3-9a951ed4d2e2 admin admin] Notify callbacks [] for subnet, before_update {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:36:51.321096 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-2bb2ee96-d1ef-4960-b0c3-9a951ed4d2e2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114466', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8781841222557'] for subnet, after_update {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:36:51.325274 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-c8a4b9c3-4d80-44d7-9891-d01d9d86b9e0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:36:51.367831 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2bb2ee96-d1ef-4960-b0c3-9a951ed4d2e2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:36:51.368416 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-2bb2ee96-d1ef-4960-b0c3-9a951ed4d2e2 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for subnet, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:36:51.369719 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-2bb2ee96-d1ef-4960-b0c3-9a951ed4d2e2 admin admin] 10.222.0.122 "PUT /v2.0/subnets/9c8e2274-27a5-431a-94be-cfb15ecbe039 HTTP/1.1" status: 200  len: 868 time: 0.4671280
May 25 17:36:51.373911 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-506ab11d-db08-4418-ab29-76274113bf88 None None] Network 4edd9e75-e73f-4268-a103-709560cae7d5 requested from dv-cinder-789564-2-iscsi {{(pid=99028) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 17:36:51.399874 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2bb2ee96-d1ef-4960-b0c3-9a951ed4d2e2 admin admin] Pushing event updated for resources: {'Subnet': ['ID=9c8e2274-27a5-431a-94be-cfb15ecbe039,revision_number=1']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:36:51.410203 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2bb2ee96-d1ef-4960-b0c3-9a951ed4d2e2 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:36:51.410602 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2bb2ee96-d1ef-4960-b0c3-9a951ed4d2e2 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:36:51.410914 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2bb2ee96-d1ef-4960-b0c3-9a951ed4d2e2 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:36:51.411339 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2bb2ee96-d1ef-4960-b0c3-9a951ed4d2e2 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:36:51.411711 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2bb2ee96-d1ef-4960-b0c3-9a951ed4d2e2 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:36:51.412058 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2bb2ee96-d1ef-4960-b0c3-9a951ed4d2e2 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:36:51.412520 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2bb2ee96-d1ef-4960-b0c3-9a951ed4d2e2 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:36:51.412847 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2bb2ee96-d1ef-4960-b0c3-9a951ed4d2e2 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:36:51.413568 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2bb2ee96-d1ef-4960-b0c3-9a951ed4d2e2 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:36:51.413904 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2bb2ee96-d1ef-4960-b0c3-9a951ed4d2e2 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:36:51.414227 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2bb2ee96-d1ef-4960-b0c3-9a951ed4d2e2 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:36:51.414541 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2bb2ee96-d1ef-4960-b0c3-9a951ed4d2e2 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:36:51.418869 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-2bb2ee96-d1ef-4960-b0c3-9a951ed4d2e2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.094s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:36:51.627417 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-7e261f94-b84f-443e-be49-3bc1ac903b55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:36:51.820585 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-9e4191fc-a4e7-4019-b913-4249234c8c01 None None] Provisioning complete for port ae1d1c44-513c-4b18-be03-3e9111372d24 triggered by entity DHCP. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 17:36:51.821268 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-9e4191fc-a4e7-4019-b913-4249234c8c01 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:36:51.951212 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-9e4191fc-a4e7-4019-b913-4249234c8c01 None None] Provisioning complete for port 188a9f16-5d70-4e31-8249-4cbf70054f42 triggered by entity DHCP. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 17:36:51.951504 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-9e4191fc-a4e7-4019-b913-4249234c8c01 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:36:53.223680 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-6df2b2a7-a54e-4d57-9be3-033078b9d5b3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:36:53.526082 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 39186) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:36:53.701057 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8f93b5bc-f045-4e50-aa28-9366fd75a4ff admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:36:53.701554 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8f93b5bc-f045-4e50-aa28-9366fd75a4ff admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:36:53.703096 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-8f93b5bc-f045-4e50-aa28-9366fd75a4ff admin admin] 10.222.0.122 "GET /v2.0/networks HTTP/1.1" status: 200  len: 1550 time: 0.1760461
May 25 17:36:55.859329 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 39198) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:36:56.071335 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-246d6857-1f63-4e3a-84bf-828780a42f28 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:36:56.071713 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-246d6857-1f63-4e3a-84bf-828780a42f28 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:36:56.073213 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-246d6857-1f63-4e3a-84bf-828780a42f28 admin admin] 10.222.0.122 "GET /v2.0/networks HTTP/1.1" status: 200  len: 1550 time: 0.2129323
May 25 17:36:58.206161 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 39208) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:36:58.381194 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dadacb9e-9bbf-4eb9-a3bd-83a3c1105244 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:36:58.383109 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-dadacb9e-9bbf-4eb9-a3bd-83a3c1105244 admin admin] 10.222.0.122 "GET /v2.0/networks/4edd9e75-e73f-4268-a103-709560cae7d5 HTTP/1.1" status: 200  len: 870 time: 0.1749647
May 25 17:37:00.541968 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 39218) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:37:00.778047 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-495f8132-c7fe-4dc7-b7bd-0f639badda26 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:37:00.779613 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-495f8132-c7fe-4dc7-b7bd-0f639badda26 admin admin] 10.222.0.122 "GET /v2.0/networks/eb7ec72b-a691-481b-8d7e-42c05e13a8cb HTTP/1.1" status: 200  len: 886 time: 0.2363234
May 25 17:37:02.996312 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 39228) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:37:03.120748 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-90d2d28b-36f0-46d0-9ce4-551afb2ffee0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:37:03.121255 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-90d2d28b-36f0-46d0-9ce4-551afb2ffee0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:37:03.122787 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-90d2d28b-36f0-46d0-9ce4-551afb2ffee0 admin admin] 10.222.0.122 "GET /v2.0/subnets HTTP/1.1" status: 200  len: 1479 time: 0.1254897
May 25 17:37:04.754486 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.agents_db [None req-14fae233-15dc-4576-836b-621c5f95b584 None None] Agent healthcheck: found 5 active agents {{(pid=99029) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 17:37:05.292002 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 39238) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:37:05.404766 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7d95b6da-f9ff-4554-ac41-c658cc8a1a75 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:37:05.405254 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7d95b6da-f9ff-4554-ac41-c658cc8a1a75 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:37:05.409122 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-7d95b6da-f9ff-4554-ac41-c658cc8a1a75 admin admin] 10.222.0.122 "GET /v2.0/subnets HTTP/1.1" status: 200  len: 1479 time: 0.1137426
May 25 17:37:07.559749 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 39248) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:37:07.667625 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f12416f1-e663-40ec-901a-b6c33906db03 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:37:07.668967 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-f12416f1-e663-40ec-901a-b6c33906db03 admin admin] 10.222.0.122 "GET /v2.0/subnets/9c8e2274-27a5-431a-94be-cfb15ecbe039 HTTP/1.1" status: 200  len: 868 time: 0.1082771
May 25 17:37:09.794502 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 39258) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:37:09.894225 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-76b019cf-8c13-43d9-b70f-95d4acca32d1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:37:09.895625 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-76b019cf-8c13-43d9-b70f-95d4acca32d1 admin admin] 10.222.0.122 "GET /v2.0/subnets/d6898f5f-da0b-4428-97b4-4cbe3e83caaa HTTP/1.1" status: 200  len: 816 time: 0.1001930
May 25 17:37:18.149406 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-87c1784c-a343-407e-a93a-6298c8734fb4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:37:20.632694 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-94619561-bd1c-4785-8151-c57a747c86db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:37:20.811881 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:37:21.620446 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-7e261f94-b84f-443e-be49-3bc1ac903b55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:37:23.237485 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-6df2b2a7-a54e-4d57-9be3-033078b9d5b3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:37:33.335999 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 39302) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:37:33.385532 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [None req-09342ef5-07ec-4ac6-a6d8-b72f9b3bb0be admin admin] http://10.222.0.122:9696/v2.0/extensions returned with HTTP 200 {{(pid=99026) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 25 17:37:33.386524 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-09342ef5-07ec-4ac6-a6d8-b72f9b3bb0be admin admin] 10.222.0.122 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.0495818
May 25 17:37:35.630902 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 39312) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:37:35.701752 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.pecan_wsgi.hooks.translation [None req-0eabedaf-6080-43ed-ad4d-0073ceee0da2 admin admin] GET failed (client error): The resource could not be found.
May 25 17:37:35.703918 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-0eabedaf-6080-43ed-ad4d-0073ceee0da2 admin admin] 10.222.0.122 "GET /v2.0/networks/public HTTP/1.1" status: 404  len: 314 time: 0.0715554
May 25 17:37:35.834566 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5677d837-a11e-4a84-a473-59c7191e4cfd admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:37:35.836148 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-5677d837-a11e-4a84-a473-59c7191e4cfd admin admin] 10.222.0.122 "GET /v2.0/networks?name=public HTTP/1.1" status: 200  len: 889 time: 0.1284609
May 25 17:37:38.042207 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 39322) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:37:38.092536 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.v2.base [None req-e2834cad-64f1-429b-9df7-13c87f2ba45a admin admin] Request body: {'network': {'name': 'shared', 'admin_state_up': True, 'shared': True}} {{(pid=99026) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:37:38.097249 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-e2834cad-64f1-429b-9df7-13c87f2ba45a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:37:38.101501 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-e2834cad-64f1-429b-9df7-13c87f2ba45a admin admin] Usage tracker for resource:network and tenant:537bb945cac6475e8b1205f34ad1e207 is out of sync, need to count used quota {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:37:38.104609 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-e2834cad-64f1-429b-9df7-13c87f2ba45a admin admin] Quota usage for network was recalculated. Used quota:1. {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:37:38.110495 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-e2834cad-64f1-429b-9df7-13c87f2ba45a admin admin] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:37:38.188889 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e2834cad-64f1-429b-9df7-13c87f2ba45a admin admin] Made reservation on behalf of 537bb945cac6475e8b1205f34ad1e207 for: {'network': 1} {{(pid=99026) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 17:37:38.191254 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-e2834cad-64f1-429b-9df7-13c87f2ba45a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-1465344'] for network, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:37:38.290150 dv-cinder-789564-2-iscsi neutron-server[99026]: WARNING neutron.services.revisions.revision_plugin [None req-e2834cad-64f1-429b-9df7-13c87f2ba45a admin admin] Could not find related network for resource <neutron.db.rbac_db_models.NetworkRBAC[object at 7fcae6ae6e80] {project_id='537bb945cac6475e8b1205f34ad1e207', id='10f1c61b-4437-4c8a-84c2-0959ed3e77a1', target_tenant='*', action='access_as_shared', object_id='0c8c34da-ff66-41c1-a56f-de3f6145b223'}> to bump revision.
May 25 17:37:38.303734 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e2834cad-64f1-429b-9df7-13c87f2ba45a admin admin] vlan segment allocate from pool success with {'vlan_id': 1348, 'physical_network': 'physnet1'}  {{(pid=99026) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 25 17:37:38.312824 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-e2834cad-64f1-429b-9df7-13c87f2ba45a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1469168'] for segment, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:37:38.313192 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.db.segments_db [None req-e2834cad-64f1-429b-9df7-13c87f2ba45a admin admin] Added segment b22125c1-5fbd-40a2-a6a7-0f8662838c08 of type vlan for network 0c8c34da-ff66-41c1-a56f-de3f6145b223
May 25 17:37:38.339435 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-e2834cad-64f1-429b-9df7-13c87f2ba45a admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8781840806997'] for network, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:37:38.440361 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-e2834cad-64f1-429b-9df7-13c87f2ba45a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-459299', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551400'] for network, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:37:38.441784 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e2834cad-64f1-429b-9df7-13c87f2ba45a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:37:38.442357 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-e2834cad-64f1-429b-9df7-13c87f2ba45a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for network, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:37:38.446593 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-04aa2c8c-70c9-4a90-9660-b0dd9f113774 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:37:38.540825 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2834cad-64f1-429b-9df7-13c87f2ba45a admin admin] Pushing event updated for resources: {'Network': ['ID=0c8c34da-ff66-41c1-a56f-de3f6145b223,revision_number=1']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:37:38.543444 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-e2834cad-64f1-429b-9df7-13c87f2ba45a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.097s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:37:38.550988 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Network 0c8c34da-ff66-41c1-a56f-de3f6145b223 details requested by agent ovs-agent-dv-cinder-789564-2-iscsi with host dv-cinder-789564-2-iscsi {{(pid=99028) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 25 17:37:38.612407 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-e2834cad-64f1-429b-9df7-13c87f2ba45a admin admin] 10.222.0.122 "POST /v2.0/networks HTTP/1.1" status: 201  len: 848 time: 0.5690768
May 25 17:37:40.767117 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 39332) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:37:40.834854 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.pecan_wsgi.hooks.translation [None req-3904a493-79fc-425f-9d43-9793b4c1df32 admin admin] GET failed (client error): The resource could not be found.
May 25 17:37:40.835372 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-3904a493-79fc-425f-9d43-9793b4c1df32 admin admin] Synchronizing usage tracker for tenant:537bb945cac6475e8b1205f34ad1e207 on resource:network {{(pid=99026) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 17:37:40.948994 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-3904a493-79fc-425f-9d43-9793b4c1df32 admin admin] Unset dirty status for tenant:537bb945cac6475e8b1205f34ad1e207 on resource:network {{(pid=99026) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 17:37:40.950233 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-3904a493-79fc-425f-9d43-9793b4c1df32 admin admin] 10.222.0.122 "GET /v2.0/networks/shared HTTP/1.1" status: 404  len: 314 time: 0.1821511
May 25 17:37:41.056249 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0d1f9638-86f8-4341-8414-ffb57665f09f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:37:41.057710 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-0d1f9638-86f8-4341-8414-ffb57665f09f admin admin] 10.222.0.122 "GET /v2.0/networks?name=shared HTTP/1.1" status: 200  len: 827 time: 0.1035180
May 25 17:37:41.067163 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.v2.base [None req-b60bba53-b245-4547-aa1c-db4d4618483f admin admin] Request body: {'subnet': {'name': 'shared-subnet', 'network_id': '0c8c34da-ff66-41c1-a56f-de3f6145b223', 'cidr': '192.168.233.0/24', 'description': 'shared-subnet', 'ip_version': 4}} {{(pid=99026) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:37:41.072587 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-b60bba53-b245-4547-aa1c-db4d4618483f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:37:41.082058 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-b60bba53-b245-4547-aa1c-db4d4618483f admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:37:41.165981 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b60bba53-b245-4547-aa1c-db4d4618483f admin admin] Made reservation on behalf of 537bb945cac6475e8b1205f34ad1e207 for: {'subnet': 1} {{(pid=99026) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 17:37:41.168296 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-b60bba53-b245-4547-aa1c-db4d4618483f admin admin] Notify callbacks [] for subnet, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:37:41.644460 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-b60bba53-b245-4547-aa1c-db4d4618483f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114466', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411'] for subnet, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:37:41.648325 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-f288c504-4a90-4591-a684-00b2eab95c3d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:37:41.721933 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b60bba53-b245-4547-aa1c-db4d4618483f admin admin] Pushing event updated for resources: {'Subnet': ['ID=6ae88d72-5303-4d56-a3cc-8079ba99cfd9,revision_number=0']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:37:41.727029 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-b60bba53-b245-4547-aa1c-db4d4618483f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:37:41.731344 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b60bba53-b245-4547-aa1c-db4d4618483f admin admin] Checking segment: {'id': 'b22125c1-5fbd-40a2-a6a7-0f8662838c08', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1348, 'network_id': '0c8c34da-ff66-41c1-a56f-de3f6145b223'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=99026) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 17:37:41.731695 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b60bba53-b245-4547-aa1c-db4d4618483f admin admin] Network hostable DHCP agents. Network: 0c8c34da-ff66-41c1-a56f-de3f6145b223, hostable agents: ['c8b0a350-254b-4562-874b-120ecdef0e25'], hosted agents: [] {{(pid=99026) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 25 17:37:41.755757 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.agents_db [None req-14fae233-15dc-4576-836b-621c5f95b584 None None] Agent healthcheck: found 5 active agents {{(pid=99029) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 17:37:41.854406 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b60bba53-b245-4547-aa1c-db4d4618483f admin admin] Network 0c8c34da-ff66-41c1-a56f-de3f6145b223 is scheduled to be hosted by DHCP agent c8b0a350-254b-4562-874b-120ecdef0e25 with binding_index 1 {{(pid=99026) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 25 17:37:41.946076 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.scheduler.base_scheduler [None req-b60bba53-b245-4547-aa1c-db4d4618483f admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-789564-2-iscsi, 0c8c34da-ff66-41c1-a56f-de3f6145b223) {{(pid=99026) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 17:37:41.950613 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b60bba53-b245-4547-aa1c-db4d4618483f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:37:41.951130 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-b60bba53-b245-4547-aa1c-db4d4618483f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for subnet, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:37:41.955841 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8414983f-68f1-4e86-98c6-1bfbf714aaaa None None] Network 0c8c34da-ff66-41c1-a56f-de3f6145b223 requested from dv-cinder-789564-2-iscsi {{(pid=99028) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 17:37:42.032766 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-b60bba53-b245-4547-aa1c-db4d4618483f admin admin] 10.222.0.122 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 845 time: 0.9688263
May 25 17:37:42.207117 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d0032186-1802-49e4-b250-bca64ed38313 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpe415bc4a-81ee-5198-a7be-1f5e4adc5586-0c8c34da-ff66-41c1-a56f-de3f6145b223', 'network_id': '0c8c34da-ff66-41c1-a56f-de3f6145b223', 'tenant_id': '537bb945cac6475e8b1205f34ad1e207', 'fixed_ips': [{'subnet_id': '6ae88d72-5303-4d56-a3cc-8079ba99cfd9'}]}} from dv-cinder-789564-2-iscsi. {{(pid=99028) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
May 25 17:37:42.207988 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-d0032186-1802-49e4-b250-bca64ed38313 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_create {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:37:42.377040 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.db_base_plugin_common [None req-d0032186-1802-49e4-b250-bca64ed38313 None None] Allocated IP 192.168.233.2 (0c8c34da-ff66-41c1-a56f-de3f6145b223/6ae88d72-5303-4d56-a3cc-8079ba99cfd9/ca4f6c4b-e941-4af7-95dd-52af362a733d) {{(pid=99028) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 17:37:42.592138 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-d0032186-1802-49e4-b250-bca64ed38313 None None] Notify callbacks [] for port, precommit_create {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:37:42.604008 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-d0032186-1802-49e4-b250-bca64ed38313 None None] Transition to ACTIVE for port object ca4f6c4b-e941-4af7-95dd-52af362a733d will not be triggered until provisioned by entity L2. {{(pid=99028) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 17:37:42.627906 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-d0032186-1802-49e4-b250-bca64ed38313 None None] Transition to ACTIVE for port object ca4f6c4b-e941-4af7-95dd-52af362a733d will not be triggered until provisioned by entity DHCP. {{(pid=99028) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 17:37:42.715008 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-d0032186-1802-49e4-b250-bca64ed38313 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781840788179'] for port, after_create {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:37:42.721801 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-93bc2756-fb99-44ad-b948-26684c9058a3 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:37:42.788917 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d0032186-1802-49e4-b250-bca64ed38313 None None] Network 0c8c34da-ff66-41c1-a56f-de3f6145b223 is already hosted by enough agents. {{(pid=99028) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 17:37:42.796796 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.scheduler.base_scheduler [None req-d0032186-1802-49e4-b250-bca64ed38313 None None] Resources bound (agent type, host, resource id):  {{(pid=99028) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 17:37:42.799104 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0032186-1802-49e4-b250-bca64ed38313 None None] Pushing event updated for resources: {'Port': ['ID=ca4f6c4b-e941-4af7-95dd-52af362a733d,revision_number=1']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:37:42.801885 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d0032186-1802-49e4-b250-bca64ed38313 None None] Received port after_create {{(pid=99028) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 17:37:42.811713 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0032186-1802-49e4-b250-bca64ed38313 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:37:42.812056 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0032186-1802-49e4-b250-bca64ed38313 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:37:42.812392 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0032186-1802-49e4-b250-bca64ed38313 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:37:42.812722 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0032186-1802-49e4-b250-bca64ed38313 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:37:42.813048 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0032186-1802-49e4-b250-bca64ed38313 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:37:42.813405 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0032186-1802-49e4-b250-bca64ed38313 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:37:42.813724 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0032186-1802-49e4-b250-bca64ed38313 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:37:42.814043 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0032186-1802-49e4-b250-bca64ed38313 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:37:42.814402 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0032186-1802-49e4-b250-bca64ed38313 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:37:42.815001 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0032186-1802-49e4-b250-bca64ed38313 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:37:42.815271 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0032186-1802-49e4-b250-bca64ed38313 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:37:42.816060 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0032186-1802-49e4-b250-bca64ed38313 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:37:42.843435 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-d0032186-1802-49e4-b250-bca64ed38313 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.122s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:37:42.907450 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.managers [None req-d0032186-1802-49e4-b250-bca64ed38313 None None] Attempting to bind port ca4f6c4b-e941-4af7-95dd-52af362a733d on host dv-cinder-789564-2-iscsi for vnic_type normal with profile  {{(pid=99028) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 17:37:42.907815 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.managers [None req-d0032186-1802-49e4-b250-bca64ed38313 None None] Attempting to bind port ca4f6c4b-e941-4af7-95dd-52af362a733d by drivers openvswitch,hyperv on host dv-cinder-789564-2-iscsi at level 0 using segments [{'id': 'b22125c1-5fbd-40a2-a6a7-0f8662838c08', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1348, 'network_id': '0c8c34da-ff66-41c1-a56f-de3f6145b223'}] {{(pid=99028) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 17:37:42.908181 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d0032186-1802-49e4-b250-bca64ed38313 None None] Attempting to bind port ca4f6c4b-e941-4af7-95dd-52af362a733d on network 0c8c34da-ff66-41c1-a56f-de3f6145b223 {{(pid=99028) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 17:37:42.916355 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d0032186-1802-49e4-b250-bca64ed38313 None None] Checking agent: {'id': '7bb67520-1e97-4ad9-9b97-101068bbe1a3', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-789564-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 17, 34, 21), 'started_at': datetime.datetime(2021, 5, 25, 17, 34, 51), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 17, 37, 21), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-789564-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=99028) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 17:37:42.917310 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d0032186-1802-49e4-b250-bca64ed38313 None None] Checking segment: {'id': 'b22125c1-5fbd-40a2-a6a7-0f8662838c08', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1348, 'network_id': '0c8c34da-ff66-41c1-a56f-de3f6145b223'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=99028) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 17:37:42.917310 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-d0032186-1802-49e4-b250-bca64ed38313 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:37:42.917556 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d0032186-1802-49e4-b250-bca64ed38313 None None] Bound using segment: {'id': 'b22125c1-5fbd-40a2-a6a7-0f8662838c08', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1348, 'network_id': '0c8c34da-ff66-41c1-a56f-de3f6145b223'} {{(pid=99028) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 17:37:42.918040 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.managers [None req-d0032186-1802-49e4-b250-bca64ed38313 None None] Bound port: ca4f6c4b-e941-4af7-95dd-52af362a733d, host: dv-cinder-789564-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b22125c1-5fbd-40a2-a6a7-0f8662838c08', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1348, 'network_id': '0c8c34da-ff66-41c1-a56f-de3f6145b223'}}] {{(pid=99028) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 17:37:42.918412 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-d0032186-1802-49e4-b250-bca64ed38313 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:37:43.024780 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-d0032186-1802-49e4-b250-bca64ed38313 None None] For port ca4f6c4b-e941-4af7-95dd-52af362a733d, host dv-cinder-789564-2-iscsi, cleared binding levels {{(pid=99028) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 17:37:43.029768 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-d0032186-1802-49e4-b250-bca64ed38313 None None] For port ca4f6c4b-e941-4af7-95dd-52af362a733d, host dv-cinder-789564-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=ca4f6c4b-e941-4af7-95dd-52af362a733d,segment=NetworkSegment(b22125c1-5fbd-40a2-a6a7-0f8662838c08),segment_id=b22125c1-5fbd-40a2-a6a7-0f8662838c08)] {{(pid=99028) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 17:37:43.106447 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-d0032186-1802-49e4-b250-bca64ed38313 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:37:43.110923 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-93bc2756-fb99-44ad-b948-26684c9058a3 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:37:43.193047 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0032186-1802-49e4-b250-bca64ed38313 None None] Pushing event updated for resources: {'Port': ['ID=ca4f6c4b-e941-4af7-95dd-52af362a733d,revision_number=2']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:37:43.196380 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-d0032186-1802-49e4-b250-bca64ed38313 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.085s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:37:44.051633 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6bfdb0df-2e9d-400d-a93d-dccbc6e54dd0 None None] Network 0c8c34da-ff66-41c1-a56f-de3f6145b223 requested from dv-cinder-789564-2-iscsi {{(pid=99028) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 17:37:44.262365 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-a5e9f647-f045-4eea-a7f2-0e2baef95493 None None] Provisioning for port ca4f6c4b-e941-4af7-95dd-52af362a733d completed by entity DHCP. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 17:37:44.905939 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device ca4f6c4b-e941-4af7-95dd-52af362a733d up at agent ovs-agent-dv-cinder-789564-2-iscsi {{(pid=99028) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 17:37:45.041035 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Provisioning for port ca4f6c4b-e941-4af7-95dd-52af362a733d completed by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 17:37:45.047996 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Provisioning complete for port ca4f6c4b-e941-4af7-95dd-52af362a733d triggered by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 17:37:45.048372 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:37:45.172347 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:37:45.206458 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] For port ca4f6c4b-e941-4af7-95dd-52af362a733d, host dv-cinder-789564-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=ca4f6c4b-e941-4af7-95dd-52af362a733d,segment=NetworkSegment(b22125c1-5fbd-40a2-a6a7-0f8662838c08),segment_id=b22125c1-5fbd-40a2-a6a7-0f8662838c08)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:37:45.308946 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:37:45.312719 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:37:45.392931 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Pushing event updated for resources: {'Port': ['ID=ca4f6c4b-e941-4af7-95dd-52af362a733d,revision_number=3']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:37:45.397828 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.085s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:37:46.875979 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device ca4f6c4b-e941-4af7-95dd-52af362a733d up at agent ovs-agent-dv-cinder-789564-2-iscsi {{(pid=99028) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 17:37:46.950662 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Provisioning complete for port ca4f6c4b-e941-4af7-95dd-52af362a733d triggered by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 17:37:46.951289 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:37:48.171748 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-a3cda0e5-b922-4a24-8361-dc333a6bbcad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:37:50.634945 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-e68e120f-a79a-44ea-9646-ee5b57e8e319 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:37:50.828721 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:37:51.654715 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-7e261f94-b84f-443e-be49-3bc1ac903b55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:37:53.213808 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-6df2b2a7-a54e-4d57-9be3-033078b9d5b3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:38:18.128065 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4a2933be-9b72-4c8d-9fdc-069164e28287 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:38:18.760560 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.agents_db [None req-14fae233-15dc-4576-836b-621c5f95b584 None None] Agent healthcheck: found 5 active agents {{(pid=99029) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 17:38:20.623060 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-2419f362-cc07-418a-aef8-394216d1b34b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:38:20.817131 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:38:21.640016 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-7e261f94-b84f-443e-be49-3bc1ac903b55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:38:23.234598 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-6df2b2a7-a54e-4d57-9be3-033078b9d5b3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:38:48.131569 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-31db0105-efab-4e58-b5bb-984c1bd931f0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:38:50.788795 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-5c28c5bc-cfe4-4165-a6c3-dbe95a478b43 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:38:50.817064 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:38:51.625138 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-7e261f94-b84f-443e-be49-3bc1ac903b55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:38:53.247982 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-6df2b2a7-a54e-4d57-9be3-033078b9d5b3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:38:55.760842 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.agents_db [None req-14fae233-15dc-4576-836b-621c5f95b584 None None] Agent healthcheck: found 5 active agents {{(pid=99029) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 17:39:14.162010 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 39382) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:39:14.168107 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [None req-583c2aea-f48c-47e3-a76b-396e663f47bc tempest-verify_tempest_config-2032954180 tempest-verify_tempest_config-2032954180-project] http://10.222.0.122:9696/v2.0/extensions returned with HTTP 200 {{(pid=99026) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 25 17:39:14.169126 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-583c2aea-f48c-47e3-a76b-396e663f47bc tempest-verify_tempest_config-2032954180 tempest-verify_tempest_config-2032954180-project] 10.222.0.122 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13635 time: 0.0061295
May 25 17:39:14.807323 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 39400) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:39:14.927563 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-a801026f-b651-44ca-8e60-1210a688a32b admin admin] Notify callbacks [] for security_group, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:39:14.941783 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-a801026f-b651-44ca-8e60-1210a688a32b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:39:14.945474 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-a801026f-b651-44ca-8e60-1210a688a32b admin admin] Usage tracker for resource:security_group_rule and tenant:7433af5287f1406fa6aa0f15d92bb48a is out of sync, need to count used quota {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:39:14.948229 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-a801026f-b651-44ca-8e60-1210a688a32b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:39:14.953851 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-a801026f-b651-44ca-8e60-1210a688a32b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:39:15.042910 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-a801026f-b651-44ca-8e60-1210a688a32b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:39:15.110816 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-a801026f-b651-44ca-8e60-1210a688a32b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:39:15.118390 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-04aa2c8c-70c9-4a90-9660-b0dd9f113774 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:39:15.200067 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-a801026f-b651-44ca-8e60-1210a688a32b admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=7433af5287f1406fa6aa0f15d92bb48a&name=default HTTP/1.1" status: 200  len: 2975 time: 0.3916149
May 25 17:39:15.200808 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a801026f-b651-44ca-8e60-1210a688a32b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6b7f73df-efd2-4f85-afad-88c1a62ddece,revision_number=1']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:39:15.202605 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 39406) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:39:15.208901 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a801026f-b651-44ca-8e60-1210a688a32b admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:39:15.209299 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a801026f-b651-44ca-8e60-1210a688a32b admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:39:15.209635 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a801026f-b651-44ca-8e60-1210a688a32b admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:39:15.209958 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a801026f-b651-44ca-8e60-1210a688a32b admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:39:15.210276 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a801026f-b651-44ca-8e60-1210a688a32b admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:39:15.210607 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a801026f-b651-44ca-8e60-1210a688a32b admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:39:15.210924 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a801026f-b651-44ca-8e60-1210a688a32b admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:39:15.211235 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a801026f-b651-44ca-8e60-1210a688a32b admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:39:15.211620 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a801026f-b651-44ca-8e60-1210a688a32b admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:39:15.211935 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a801026f-b651-44ca-8e60-1210a688a32b admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:39:15.212242 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a801026f-b651-44ca-8e60-1210a688a32b admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:39:15.212546 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a801026f-b651-44ca-8e60-1210a688a32b admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:39:15.216361 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-a801026f-b651-44ca-8e60-1210a688a32b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.098s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:39:15.265442 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-68002ace-dd61-4966-b963-aabb04dbf428 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:39:15.292404 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-68002ace-dd61-4966-b963-aabb04dbf428 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:39:15.430751 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-68002ace-dd61-4966-b963-aabb04dbf428 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:39:15.434605 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:39:15.446045 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68002ace-dd61-4966-b963-aabb04dbf428 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6b7f73df-efd2-4f85-afad-88c1a62ddece,revision_number=None']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:39:15.456557 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68002ace-dd61-4966-b963-aabb04dbf428 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:39:15.457056 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68002ace-dd61-4966-b963-aabb04dbf428 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:39:15.457673 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68002ace-dd61-4966-b963-aabb04dbf428 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:39:15.457994 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68002ace-dd61-4966-b963-aabb04dbf428 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:39:15.458309 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68002ace-dd61-4966-b963-aabb04dbf428 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:39:15.458642 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68002ace-dd61-4966-b963-aabb04dbf428 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:39:15.458957 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68002ace-dd61-4966-b963-aabb04dbf428 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:39:15.459281 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68002ace-dd61-4966-b963-aabb04dbf428 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:39:15.459590 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68002ace-dd61-4966-b963-aabb04dbf428 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:39:15.459902 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68002ace-dd61-4966-b963-aabb04dbf428 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:39:15.460205 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68002ace-dd61-4966-b963-aabb04dbf428 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:39:15.460507 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68002ace-dd61-4966-b963-aabb04dbf428 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:39:15.463514 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-68002ace-dd61-4966-b963-aabb04dbf428 admin admin] Notify callbacks [] for security_group, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:39:15.464594 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-68002ace-dd61-4966-b963-aabb04dbf428 admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/6b7f73df-efd2-4f85-afad-88c1a62ddece HTTP/1.1" status: 204  len: 168 time: 0.2610548
May 25 17:39:15.465505 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-68002ace-dd61-4966-b963-aabb04dbf428 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:39:18.154088 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-8df2aee9-8be2-41cb-a8e6-cbebc7a70f93 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:39:20.628492 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-a55d5f05-6a5c-4d0a-a730-4a34bab987e5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:39:20.799943 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:39:21.636428 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-7e261f94-b84f-443e-be49-3bc1ac903b55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:39:23.241651 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-6df2b2a7-a54e-4d57-9be3-033078b9d5b3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:39:32.758975 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.agents_db [None req-14fae233-15dc-4576-836b-621c5f95b584 None None] Agent healthcheck: found 5 active agents {{(pid=99029) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 17:39:48.116146 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-23a955a5-bb16-49de-b88e-2dbe0a58d9d6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:39:50.618912 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-79cc9be2-9f0c-45a3-81bb-ad6398af6e60 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:39:50.801483 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:39:51.633890 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-7e261f94-b84f-443e-be49-3bc1ac903b55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:39:53.264120 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-6df2b2a7-a54e-4d57-9be3-033078b9d5b3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:40:09.758099 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.agents_db [None req-14fae233-15dc-4576-836b-621c5f95b584 None None] Agent healthcheck: found 5 active agents {{(pid=99029) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 17:40:18.138634 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-cc1a0ea4-fe34-4a5b-a403-10e049a79cf7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:40:20.653050 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-c28d64ca-ce21-490f-8694-00b22b37a50a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:40:20.818222 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:40:21.647250 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-7e261f94-b84f-443e-be49-3bc1ac903b55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:40:23.247357 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-6df2b2a7-a54e-4d57-9be3-033078b9d5b3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:40:41.469581 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134'] for agent, after_create {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:40:46.757458 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.agents_db [None req-14fae233-15dc-4576-836b-621c5f95b584 None None] Agent healthcheck: found 6 active agents {{(pid=99029) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 17:40:48.149774 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-d4f9325b-dc2a-4588-97c1-e55fb05388c7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:40:48.620772 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 39458) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:40:48.739364 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-516f6443-1190-4491-9fcd-822c8903d50c admin admin] 10.222.0.122 "GET /v2.0/agents HTTP/1.1" status: 200  len: 4304 time: 0.1174405
May 25 17:40:50.618475 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4f4fa598-e371-42b7-9a52-e4fbe78811ce None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:40:50.818230 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:40:50.947841 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 39468) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:40:51.002939 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-e95b0d55-ee83-43ac-81eb-e004703b7e96 admin admin] 10.222.0.122 "GET /v2.0/agents HTTP/1.1" status: 200  len: 4304 time: 0.0539546
May 25 17:40:51.641401 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-7e261f94-b84f-443e-be49-3bc1ac903b55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:40:53.246962 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-6df2b2a7-a54e-4d57-9be3-033078b9d5b3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:41:11.430095 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:41:18.132133 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4e674fb2-7aa8-4557-8a02-3e61bd6aa80a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:41:20.669431 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-56f20977-d434-4ca5-8c23-4b6b46e56dc9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:41:20.800466 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:41:21.680619 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-7e261f94-b84f-443e-be49-3bc1ac903b55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:41:23.269348 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-6df2b2a7-a54e-4d57-9be3-033078b9d5b3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:41:23.756741 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.agents_db [None req-14fae233-15dc-4576-836b-621c5f95b584 None None] Agent healthcheck: found 6 active agents {{(pid=99029) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 17:41:41.428944 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:41:48.132301 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-d73d1f11-c904-4d73-8cd8-5443afd7eb2c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:41:50.618479 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-200be26d-ffe2-472c-a52b-7335100a9586 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:41:50.852702 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:41:51.650893 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-7e261f94-b84f-443e-be49-3bc1ac903b55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:41:53.252536 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-6df2b2a7-a54e-4d57-9be3-033078b9d5b3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:00.756188 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.agents_db [None req-14fae233-15dc-4576-836b-621c5f95b584 None None] Agent healthcheck: found 6 active agents {{(pid=99029) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 17:42:11.429879 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:16.306035 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 39636) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:42:16.480656 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 39652) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:42:16.591470 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.v2.base [None req-aa7f2d94-cb9f-46e8-b481-9db8fe60626a admin admin] Request body: {'network': {'name': 'tempest-DeleteServersTestJSON-1479864880-network', 'tenant_id': 'fb338a290a2242fea3a4b8ae2bc4a14c'}} {{(pid=99026) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:42:16.597741 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-aa7f2d94-cb9f-46e8-b481-9db8fe60626a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:42:16.602461 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-aa7f2d94-cb9f-46e8-b481-9db8fe60626a admin admin] Usage tracker for resource:network and tenant:fb338a290a2242fea3a4b8ae2bc4a14c is out of sync, need to count used quota {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:42:16.605409 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-aa7f2d94-cb9f-46e8-b481-9db8fe60626a admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:42:16.611451 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-aa7f2d94-cb9f-46e8-b481-9db8fe60626a admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:42:16.667026 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.v2.base [None req-8b18666f-ad90-48d2-8753-670d885a401a admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeNegativeTest-830494069-network', 'tenant_id': '5ae575cfd07c4a88aa626c15e6bccfd9'}} {{(pid=99027) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:42:16.672205 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-8b18666f-ad90-48d2-8753-670d885a401a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:42:16.676297 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-8b18666f-ad90-48d2-8753-670d885a401a admin admin] Usage tracker for resource:network and tenant:5ae575cfd07c4a88aa626c15e6bccfd9 is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:42:16.680298 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-8b18666f-ad90-48d2-8753-670d885a401a admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:42:16.689760 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-8b18666f-ad90-48d2-8753-670d885a401a admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:42:16.719513 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-aa7f2d94-cb9f-46e8-b481-9db8fe60626a admin admin] Made reservation on behalf of fb338a290a2242fea3a4b8ae2bc4a14c for: {'network': 1} {{(pid=99026) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 17:42:16.724350 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-aa7f2d94-cb9f-46e8-b481-9db8fe60626a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-1465344'] for network, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:16.734894 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-aa7f2d94-cb9f-46e8-b481-9db8fe60626a admin admin] Notify callbacks [] for security_group, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:16.749909 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-aa7f2d94-cb9f-46e8-b481-9db8fe60626a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:42:16.753601 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-aa7f2d94-cb9f-46e8-b481-9db8fe60626a admin admin] Usage tracker for resource:security_group_rule and tenant:fb338a290a2242fea3a4b8ae2bc4a14c is out of sync, need to count used quota {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:42:16.756325 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-aa7f2d94-cb9f-46e8-b481-9db8fe60626a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:42:16.762166 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-aa7f2d94-cb9f-46e8-b481-9db8fe60626a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:42:16.842097 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-aa7f2d94-cb9f-46e8-b481-9db8fe60626a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:16.852473 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8b18666f-ad90-48d2-8753-670d885a401a admin admin] Made reservation on behalf of 5ae575cfd07c4a88aa626c15e6bccfd9 for: {'network': 1} {{(pid=99027) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 17:42:16.856050 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-8b18666f-ad90-48d2-8753-670d885a401a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-1465344'] for network, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:16.867358 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-8b18666f-ad90-48d2-8753-670d885a401a admin admin] Notify callbacks [] for security_group, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:16.881661 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-8b18666f-ad90-48d2-8753-670d885a401a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:42:16.890439 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-8b18666f-ad90-48d2-8753-670d885a401a admin admin] Usage tracker for resource:security_group_rule and tenant:5ae575cfd07c4a88aa626c15e6bccfd9 is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:42:16.890439 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-8b18666f-ad90-48d2-8753-670d885a401a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:42:16.893985 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-8b18666f-ad90-48d2-8753-670d885a401a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:42:16.955217 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-aa7f2d94-cb9f-46e8-b481-9db8fe60626a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:16.960407 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:16.979313 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-8b18666f-ad90-48d2-8753-670d885a401a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:16.997924 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa7f2d94-cb9f-46e8-b481-9db8fe60626a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=36f94dea-f495-4a32-ab2e-aef5450d5564,revision_number=1']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:17.000055 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-aa7f2d94-cb9f-46e8-b481-9db8fe60626a admin admin] vlan segment allocate from pool success with {'vlan_id': 1333, 'physical_network': 'physnet1'}  {{(pid=99026) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 25 17:42:17.011833 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa7f2d94-cb9f-46e8-b481-9db8fe60626a admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:42:17.012200 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa7f2d94-cb9f-46e8-b481-9db8fe60626a admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:42:17.012537 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa7f2d94-cb9f-46e8-b481-9db8fe60626a admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:42:17.012861 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa7f2d94-cb9f-46e8-b481-9db8fe60626a admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:42:17.013382 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa7f2d94-cb9f-46e8-b481-9db8fe60626a admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:42:17.013897 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa7f2d94-cb9f-46e8-b481-9db8fe60626a admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:42:17.014225 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa7f2d94-cb9f-46e8-b481-9db8fe60626a admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:42:17.014723 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa7f2d94-cb9f-46e8-b481-9db8fe60626a admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:42:17.015060 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa7f2d94-cb9f-46e8-b481-9db8fe60626a admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:42:17.015411 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa7f2d94-cb9f-46e8-b481-9db8fe60626a admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:42:17.015892 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa7f2d94-cb9f-46e8-b481-9db8fe60626a admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:42:17.016216 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa7f2d94-cb9f-46e8-b481-9db8fe60626a admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:42:17.017393 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa7f2d94-cb9f-46e8-b481-9db8fe60626a admin admin] Tracked resource versions report:
May 25 17:42:17.017393 dv-cinder-789564-2-iscsi neutron-server[99026]: pushed versions:
May 25 17:42:17.017393 dv-cinder-789564-2-iscsi neutron-server[99026]: {   'AddressGroup': {'1.2'},
May 25 17:42:17.017393 dv-cinder-789564-2-iscsi neutron-server[99026]:     'ConntrackHelper': {'1.0'},
May 25 17:42:17.017393 dv-cinder-789564-2-iscsi neutron-server[99026]:     'Log': {'1.0'},
May 25 17:42:17.017393 dv-cinder-789564-2-iscsi neutron-server[99026]:     'Network': {'1.1'},
May 25 17:42:17.017393 dv-cinder-789564-2-iscsi neutron-server[99026]:     'Port': {'1.7'},
May 25 17:42:17.017393 dv-cinder-789564-2-iscsi neutron-server[99026]:     'PortForwarding': {'1.2'},
May 25 17:42:17.017393 dv-cinder-789564-2-iscsi neutron-server[99026]:     'QosPolicy': {'1.8'},
May 25 17:42:17.017393 dv-cinder-789564-2-iscsi neutron-server[99026]:     'SecurityGroup': {'1.4'},
May 25 17:42:17.017393 dv-cinder-789564-2-iscsi neutron-server[99026]:     'SecurityGroupRule': {'1.2'},
May 25 17:42:17.017393 dv-cinder-789564-2-iscsi neutron-server[99026]:     'SubPort': {'1.0'},
May 25 17:42:17.017393 dv-cinder-789564-2-iscsi neutron-server[99026]:     'Subnet': {'1.1'},
May 25 17:42:17.017393 dv-cinder-789564-2-iscsi neutron-server[99026]:     'Trunk': {'1.1'}}
May 25 17:42:17.017393 dv-cinder-789564-2-iscsi neutron-server[99026]: consumer versions:
May 25 17:42:17.017393 dv-cinder-789564-2-iscsi neutron-server[99026]: {   DHCP agent@dv-cinder-789564-2-iscsi: {},
May 25 17:42:17.017393 dv-cinder-789564-2-iscsi neutron-server[99026]:     HyperV agent@hv-cinder-78956: {},
May 25 17:42:17.017393 dv-cinder-789564-2-iscsi neutron-server[99026]:     L3 agent@dv-cinder-789564-2-iscsi: {},
May 25 17:42:17.017393 dv-cinder-789564-2-iscsi neutron-server[99026]:     Metadata agent@dv-cinder-789564-2-iscsi: {},
May 25 17:42:17.017393 dv-cinder-789564-2-iscsi neutron-server[99026]:     Metering agent@dv-cinder-789564-2-iscsi: {},
May 25 17:42:17.017393 dv-cinder-789564-2-iscsi neutron-server[99026]:     Open vSwitch agent@dv-cinder-789564-2-iscsi: {   'AddressGroup': '1.2',
May 25 17:42:17.017393 dv-cinder-789564-2-iscsi neutron-server[99026]:                                                      'ConntrackHelper': '1.0',
May 25 17:42:17.017393 dv-cinder-789564-2-iscsi neutron-server[99026]:                                                      'Log': '1.0',
May 25 17:42:17.017393 dv-cinder-789564-2-iscsi neutron-server[99026]:                                                      'Network': '1.1',
May 25 17:42:17.017393 dv-cinder-789564-2-iscsi neutron-server[99026]:                                                      'Port': '1.7',
May 25 17:42:17.017393 dv-cinder-789564-2-iscsi neutron-server[99026]:                                                      'PortForwarding': '1.2',
May 25 17:42:17.017393 dv-cinder-789564-2-iscsi neutron-server[99026]:                                                      'QosPolicy': '1.8',
May 25 17:42:17.017393 dv-cinder-789564-2-iscsi neutron-server[99026]:                                                      'SecurityGroup': '1.4',
May 25 17:42:17.017393 dv-cinder-789564-2-iscsi neutron-server[99026]:                                                      'SecurityGroupRule': '1.2',
May 25 17:42:17.017393 dv-cinder-789564-2-iscsi neutron-server[99026]:                                                      'SubPort': '1.0',
May 25 17:42:17.017393 dv-cinder-789564-2-iscsi neutron-server[99026]:                                                      'Subnet': '1.1',
May 25 17:42:17.017393 dv-cinder-789564-2-iscsi neutron-server[99026]:                                                      'Trunk': '1.1'}}
May 25 17:42:17.017393 dv-cinder-789564-2-iscsi neutron-server[99026]:  {{(pid=99026) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
May 25 17:42:17.021287 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-aa7f2d94-cb9f-46e8-b481-9db8fe60626a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.061s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:17.023863 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-aa7f2d94-cb9f-46e8-b481-9db8fe60626a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1469168'] for segment, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:17.024198 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.db.segments_db [None req-aa7f2d94-cb9f-46e8-b481-9db8fe60626a admin admin] Added segment cc9a1d0a-1ce8-490e-886f-4f9fc5e8fc3d of type vlan for network 58926b0f-c6c9-44b1-aa59-d580f9359c87
May 25 17:42:17.053763 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-aa7f2d94-cb9f-46e8-b481-9db8fe60626a admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8781840806997'] for network, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:17.069261 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-8b18666f-ad90-48d2-8753-670d885a401a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:17.083546 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-68002ace-dd61-4966-b963-aabb04dbf428 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:17.090820 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-8b18666f-ad90-48d2-8753-670d885a401a admin admin] vlan segment allocate from pool success with {'vlan_id': 1304, 'physical_network': 'physnet1'}  {{(pid=99027) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 25 17:42:17.114376 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-8b18666f-ad90-48d2-8753-670d885a401a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1469168'] for segment, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:17.114720 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.db.segments_db [None req-8b18666f-ad90-48d2-8753-670d885a401a admin admin] Added segment 87df170f-54cc-461b-a7ac-79e125fc526b of type vlan for network 6c7eca3b-72f3-4ba8-9e95-614d64496512
May 25 17:42:17.147368 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b18666f-ad90-48d2-8753-670d885a401a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=dda11ec6-545c-479e-bba9-4390fea678fa,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:17.164518 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b18666f-ad90-48d2-8753-670d885a401a admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:42:17.164859 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b18666f-ad90-48d2-8753-670d885a401a admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:42:17.165225 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b18666f-ad90-48d2-8753-670d885a401a admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:42:17.165550 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b18666f-ad90-48d2-8753-670d885a401a admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:42:17.165871 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b18666f-ad90-48d2-8753-670d885a401a admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:42:17.166207 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b18666f-ad90-48d2-8753-670d885a401a admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:42:17.166531 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b18666f-ad90-48d2-8753-670d885a401a admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:42:17.166844 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b18666f-ad90-48d2-8753-670d885a401a admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:42:17.167172 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b18666f-ad90-48d2-8753-670d885a401a admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:42:17.167486 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b18666f-ad90-48d2-8753-670d885a401a admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:42:17.167796 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b18666f-ad90-48d2-8753-670d885a401a admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:42:17.168104 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b18666f-ad90-48d2-8753-670d885a401a admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:42:17.169210 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b18666f-ad90-48d2-8753-670d885a401a admin admin] Tracked resource versions report:
May 25 17:42:17.169210 dv-cinder-789564-2-iscsi neutron-server[99027]: pushed versions:
May 25 17:42:17.169210 dv-cinder-789564-2-iscsi neutron-server[99027]: {   'AddressGroup': {'1.2'},
May 25 17:42:17.169210 dv-cinder-789564-2-iscsi neutron-server[99027]:     'ConntrackHelper': {'1.0'},
May 25 17:42:17.169210 dv-cinder-789564-2-iscsi neutron-server[99027]:     'Log': {'1.0'},
May 25 17:42:17.169210 dv-cinder-789564-2-iscsi neutron-server[99027]:     'Network': {'1.1'},
May 25 17:42:17.169210 dv-cinder-789564-2-iscsi neutron-server[99027]:     'Port': {'1.7'},
May 25 17:42:17.169210 dv-cinder-789564-2-iscsi neutron-server[99027]:     'PortForwarding': {'1.2'},
May 25 17:42:17.169210 dv-cinder-789564-2-iscsi neutron-server[99027]:     'QosPolicy': {'1.8'},
May 25 17:42:17.169210 dv-cinder-789564-2-iscsi neutron-server[99027]:     'SecurityGroup': {'1.4'},
May 25 17:42:17.169210 dv-cinder-789564-2-iscsi neutron-server[99027]:     'SecurityGroupRule': {'1.2'},
May 25 17:42:17.169210 dv-cinder-789564-2-iscsi neutron-server[99027]:     'SubPort': {'1.0'},
May 25 17:42:17.169210 dv-cinder-789564-2-iscsi neutron-server[99027]:     'Subnet': {'1.1'},
May 25 17:42:17.169210 dv-cinder-789564-2-iscsi neutron-server[99027]:     'Trunk': {'1.1'}}
May 25 17:42:17.169210 dv-cinder-789564-2-iscsi neutron-server[99027]: consumer versions:
May 25 17:42:17.169210 dv-cinder-789564-2-iscsi neutron-server[99027]: {   DHCP agent@dv-cinder-789564-2-iscsi: {},
May 25 17:42:17.169210 dv-cinder-789564-2-iscsi neutron-server[99027]:     HyperV agent@hv-cinder-78956: {},
May 25 17:42:17.169210 dv-cinder-789564-2-iscsi neutron-server[99027]:     L3 agent@dv-cinder-789564-2-iscsi: {},
May 25 17:42:17.169210 dv-cinder-789564-2-iscsi neutron-server[99027]:     Metadata agent@dv-cinder-789564-2-iscsi: {},
May 25 17:42:17.169210 dv-cinder-789564-2-iscsi neutron-server[99027]:     Metering agent@dv-cinder-789564-2-iscsi: {},
May 25 17:42:17.169210 dv-cinder-789564-2-iscsi neutron-server[99027]:     Open vSwitch agent@dv-cinder-789564-2-iscsi: {   'AddressGroup': '1.2',
May 25 17:42:17.169210 dv-cinder-789564-2-iscsi neutron-server[99027]:                                                      'ConntrackHelper': '1.0',
May 25 17:42:17.169210 dv-cinder-789564-2-iscsi neutron-server[99027]:                                                      'Log': '1.0',
May 25 17:42:17.169210 dv-cinder-789564-2-iscsi neutron-server[99027]:                                                      'Network': '1.1',
May 25 17:42:17.169210 dv-cinder-789564-2-iscsi neutron-server[99027]:                                                      'Port': '1.7',
May 25 17:42:17.169210 dv-cinder-789564-2-iscsi neutron-server[99027]:                                                      'PortForwarding': '1.2',
May 25 17:42:17.169210 dv-cinder-789564-2-iscsi neutron-server[99027]:                                                      'QosPolicy': '1.8',
May 25 17:42:17.169210 dv-cinder-789564-2-iscsi neutron-server[99027]:                                                      'SecurityGroup': '1.4',
May 25 17:42:17.169210 dv-cinder-789564-2-iscsi neutron-server[99027]:                                                      'SecurityGroupRule': '1.2',
May 25 17:42:17.169210 dv-cinder-789564-2-iscsi neutron-server[99027]:                                                      'SubPort': '1.0',
May 25 17:42:17.169210 dv-cinder-789564-2-iscsi neutron-server[99027]:                                                      'Subnet': '1.1',
May 25 17:42:17.169210 dv-cinder-789564-2-iscsi neutron-server[99027]:                                                      'Trunk': '1.1'}}
May 25 17:42:17.169210 dv-cinder-789564-2-iscsi neutron-server[99027]:  {{(pid=99027) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
May 25 17:42:17.172448 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-8b18666f-ad90-48d2-8753-670d885a401a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:17.176645 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-8b18666f-ad90-48d2-8753-670d885a401a admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8781840806997'] for network, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:17.258646 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-aa7f2d94-cb9f-46e8-b481-9db8fe60626a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-459299', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551400'] for network, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:17.260013 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-aa7f2d94-cb9f-46e8-b481-9db8fe60626a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:42:17.260586 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-aa7f2d94-cb9f-46e8-b481-9db8fe60626a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for network, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:17.268093 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:17.338023 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-8b18666f-ad90-48d2-8753-670d885a401a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-459299', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551400'] for network, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:17.339485 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8b18666f-ad90-48d2-8753-670d885a401a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:42:17.340276 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-8b18666f-ad90-48d2-8753-670d885a401a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for network, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:17.345470 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:17.367778 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa7f2d94-cb9f-46e8-b481-9db8fe60626a admin admin] Pushing event updated for resources: {'Network': ['ID=58926b0f-c6c9-44b1-aa59-d580f9359c87,revision_number=1']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:17.370509 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-aa7f2d94-cb9f-46e8-b481-9db8fe60626a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.106s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:17.378795 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Network 58926b0f-c6c9-44b1-aa59-d580f9359c87 details requested by agent ovs-agent-dv-cinder-789564-2-iscsi with host dv-cinder-789564-2-iscsi {{(pid=99028) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 25 17:42:17.443883 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b18666f-ad90-48d2-8753-670d885a401a admin admin] Pushing event updated for resources: {'Network': ['ID=6c7eca3b-72f3-4ba8-9e95-614d64496512,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:17.448099 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-8b18666f-ad90-48d2-8753-670d885a401a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.103s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:17.463146 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-aa7f2d94-cb9f-46e8-b481-9db8fe60626a admin admin] 10.222.0.122 "POST /v2.0/networks HTTP/1.1" status: 201  len: 886 time: 1.1527579
May 25 17:42:17.463377 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 39688) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:42:17.469025 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.v2.base [None req-0ce2fcfb-6f6b-4875-97e5-5c30902b5da6 admin admin] Request body: {'subnet': {'network_id': '58926b0f-c6c9-44b1-aa59-d580f9359c87', 'cidr': '172.20.0.0/28', 'name': 'tempest-DeleteServersTestJSON-1479864880-subnet', 'tenant_id': 'fb338a290a2242fea3a4b8ae2bc4a14c', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=99026) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:42:17.473884 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-0ce2fcfb-6f6b-4875-97e5-5c30902b5da6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:42:17.477902 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-0ce2fcfb-6f6b-4875-97e5-5c30902b5da6 admin admin] Usage tracker for resource:subnet and tenant:fb338a290a2242fea3a4b8ae2bc4a14c is out of sync, need to count used quota {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:42:17.480984 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-0ce2fcfb-6f6b-4875-97e5-5c30902b5da6 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:42:17.486955 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-0ce2fcfb-6f6b-4875-97e5-5c30902b5da6 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:42:17.498783 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Network 6c7eca3b-72f3-4ba8-9e95-614d64496512 details requested by agent ovs-agent-dv-cinder-789564-2-iscsi with host dv-cinder-789564-2-iscsi {{(pid=99028) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 25 17:42:17.598333 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-8b18666f-ad90-48d2-8753-670d885a401a admin admin] 10.222.0.122 "POST /v2.0/networks HTTP/1.1" status: 201  len: 888 time: 1.1164587
May 25 17:42:17.599158 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 39694) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:42:17.605720 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.v2.base [None req-42f178f9-38ed-4412-827f-25a67a52c917 admin admin] Request body: {'subnet': {'network_id': '6c7eca3b-72f3-4ba8-9e95-614d64496512', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeNegativeTest-830494069-subnet', 'tenant_id': '5ae575cfd07c4a88aa626c15e6bccfd9', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=99026) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:42:17.610532 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-42f178f9-38ed-4412-827f-25a67a52c917 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:42:17.614850 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-42f178f9-38ed-4412-827f-25a67a52c917 admin admin] Usage tracker for resource:subnet and tenant:5ae575cfd07c4a88aa626c15e6bccfd9 is out of sync, need to count used quota {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:42:17.618533 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-42f178f9-38ed-4412-827f-25a67a52c917 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:42:17.624299 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-42f178f9-38ed-4412-827f-25a67a52c917 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:42:17.652010 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0ce2fcfb-6f6b-4875-97e5-5c30902b5da6 admin admin] Made reservation on behalf of fb338a290a2242fea3a4b8ae2bc4a14c for: {'subnet': 1} {{(pid=99026) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 17:42:17.654965 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-0ce2fcfb-6f6b-4875-97e5-5c30902b5da6 admin admin] Notify callbacks [] for subnet, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:17.718330 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 39704) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:42:17.741347 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-42f178f9-38ed-4412-827f-25a67a52c917 admin admin] Made reservation on behalf of 5ae575cfd07c4a88aa626c15e6bccfd9 for: {'subnet': 1} {{(pid=99026) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 17:42:17.744323 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-42f178f9-38ed-4412-827f-25a67a52c917 admin admin] Notify callbacks [] for subnet, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:17.754042 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 39710) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:42:18.053791 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.v2.base [None req-339aa27b-e142-4172-a51b-4bab30e479c6 admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-2078758342-network', 'tenant_id': '834c78f6fe1e4da3bcaa284865200eb2'}} {{(pid=99027) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:42:18.065584 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-339aa27b-e142-4172-a51b-4bab30e479c6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:42:18.071686 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-339aa27b-e142-4172-a51b-4bab30e479c6 admin admin] Usage tracker for resource:network and tenant:834c78f6fe1e4da3bcaa284865200eb2 is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:42:18.076040 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-339aa27b-e142-4172-a51b-4bab30e479c6 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:42:18.082206 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-339aa27b-e142-4172-a51b-4bab30e479c6 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:42:18.147479 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 39724) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:42:18.161652 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.v2.base [None req-144068ab-ac0d-4c3a-a29a-838c35f0f378 admin admin] Request body: {'network': {'name': 'tempest-ServerRescueNegativeTestJSON-301463405-network', 'tenant_id': '5b2f6ca8c5b94c2f8894c04f297b5f8b'}} {{(pid=99027) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:42:18.171022 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-144068ab-ac0d-4c3a-a29a-838c35f0f378 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:42:18.176302 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-144068ab-ac0d-4c3a-a29a-838c35f0f378 admin admin] Usage tracker for resource:network and tenant:5b2f6ca8c5b94c2f8894c04f297b5f8b is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:42:18.180799 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-144068ab-ac0d-4c3a-a29a-838c35f0f378 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:42:18.188817 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-144068ab-ac0d-4c3a-a29a-838c35f0f378 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:42:18.200814 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-7245946a-ed72-40af-86a3-69b696db44c8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:18.205571 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-339aa27b-e142-4172-a51b-4bab30e479c6 admin admin] Made reservation on behalf of 834c78f6fe1e4da3bcaa284865200eb2 for: {'network': 1} {{(pid=99027) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 17:42:18.205571 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-339aa27b-e142-4172-a51b-4bab30e479c6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-1465344'] for network, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:18.220893 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-339aa27b-e142-4172-a51b-4bab30e479c6 admin admin] Notify callbacks [] for security_group, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:18.242320 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-339aa27b-e142-4172-a51b-4bab30e479c6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:42:18.246688 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-339aa27b-e142-4172-a51b-4bab30e479c6 admin admin] Usage tracker for resource:security_group_rule and tenant:834c78f6fe1e4da3bcaa284865200eb2 is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:42:18.249796 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-339aa27b-e142-4172-a51b-4bab30e479c6 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:42:18.259815 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-339aa27b-e142-4172-a51b-4bab30e479c6 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:42:18.311214 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-144068ab-ac0d-4c3a-a29a-838c35f0f378 admin admin] Made reservation on behalf of 5b2f6ca8c5b94c2f8894c04f297b5f8b for: {'network': 1} {{(pid=99027) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 17:42:18.313862 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-144068ab-ac0d-4c3a-a29a-838c35f0f378 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-1465344'] for network, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:18.332786 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-144068ab-ac0d-4c3a-a29a-838c35f0f378 admin admin] Notify callbacks [] for security_group, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:18.363600 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.v2.base [None req-904e32c8-a8a4-4c07-995f-ee8fbea79424 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeTestJSON-1986395052-network', 'tenant_id': 'b4cdc54b260f4e79b87fdf4a43b12e16'}} {{(pid=99027) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:42:18.374610 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-904e32c8-a8a4-4c07-995f-ee8fbea79424 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:42:18.379148 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-144068ab-ac0d-4c3a-a29a-838c35f0f378 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:42:18.381607 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-904e32c8-a8a4-4c07-995f-ee8fbea79424 admin admin] Usage tracker for resource:network and tenant:b4cdc54b260f4e79b87fdf4a43b12e16 is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:42:18.385515 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-904e32c8-a8a4-4c07-995f-ee8fbea79424 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:42:18.391801 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-904e32c8-a8a4-4c07-995f-ee8fbea79424 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:42:18.410311 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-144068ab-ac0d-4c3a-a29a-838c35f0f378 admin admin] Usage tracker for resource:security_group_rule and tenant:5b2f6ca8c5b94c2f8894c04f297b5f8b is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:42:18.416104 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-144068ab-ac0d-4c3a-a29a-838c35f0f378 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:42:18.430587 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-144068ab-ac0d-4c3a-a29a-838c35f0f378 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:42:18.437028 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-339aa27b-e142-4172-a51b-4bab30e479c6 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:18.465072 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-42f178f9-38ed-4412-827f-25a67a52c917 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114466', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411'] for subnet, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:18.466175 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-0ce2fcfb-6f6b-4875-97e5-5c30902b5da6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114466', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411'] for subnet, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:18.470667 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-904e32c8-a8a4-4c07-995f-ee8fbea79424 admin admin] Made reservation on behalf of b4cdc54b260f4e79b87fdf4a43b12e16 for: {'network': 1} {{(pid=99027) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 17:42:18.471867 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-2bb2ee96-d1ef-4960-b0c3-9a951ed4d2e2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:18.475585 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-904e32c8-a8a4-4c07-995f-ee8fbea79424 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-1465344'] for network, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:18.494445 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-904e32c8-a8a4-4c07-995f-ee8fbea79424 admin admin] Notify callbacks [] for security_group, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:18.517728 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-904e32c8-a8a4-4c07-995f-ee8fbea79424 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:42:18.524971 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-904e32c8-a8a4-4c07-995f-ee8fbea79424 admin admin] Usage tracker for resource:security_group_rule and tenant:b4cdc54b260f4e79b87fdf4a43b12e16 is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:42:18.531866 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-904e32c8-a8a4-4c07-995f-ee8fbea79424 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:42:18.534121 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42f178f9-38ed-4412-827f-25a67a52c917 admin admin] Pushing event updated for resources: {'Subnet': ['ID=279772c8-d366-4fc6-9c34-e6ddf99b5e08,revision_number=0']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:18.543742 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-904e32c8-a8a4-4c07-995f-ee8fbea79424 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:42:18.566052 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-339aa27b-e142-4172-a51b-4bab30e479c6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:18.583869 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-8b18666f-ad90-48d2-8753-670d885a401a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:18.610842 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ce2fcfb-6f6b-4875-97e5-5c30902b5da6 admin admin] Pushing event updated for resources: {'Subnet': ['ID=d821d422-628c-4d27-a03e-94485f09826d,revision_number=0']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:18.622881 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-0ce2fcfb-6f6b-4875-97e5-5c30902b5da6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.151s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:18.624990 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.015s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:18.625458 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:18.630171 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-42f178f9-38ed-4412-827f-25a67a52c917 admin admin] Checking segment: {'id': '87df170f-54cc-461b-a7ac-79e125fc526b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1304, 'network_id': '6c7eca3b-72f3-4ba8-9e95-614d64496512'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=99026) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 17:42:18.630753 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-42f178f9-38ed-4412-827f-25a67a52c917 admin admin] Network hostable DHCP agents. Network: 6c7eca3b-72f3-4ba8-9e95-614d64496512, hostable agents: ['c8b0a350-254b-4562-874b-120ecdef0e25'], hosted agents: [] {{(pid=99026) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 25 17:42:18.639335 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-339aa27b-e142-4172-a51b-4bab30e479c6 admin admin] vlan segment allocate from pool success with {'vlan_id': 1337, 'physical_network': 'physnet1'}  {{(pid=99027) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 25 17:42:18.645771 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-144068ab-ac0d-4c3a-a29a-838c35f0f378 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:18.669879 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-339aa27b-e142-4172-a51b-4bab30e479c6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1469168'] for segment, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:18.670223 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.db.segments_db [None req-339aa27b-e142-4172-a51b-4bab30e479c6 admin admin] Added segment 24ef52a3-71f5-4354-8441-5f5dae329da1 of type vlan for network 20f9a6bc-29c0-49ed-a2fb-d197360212a9
May 25 17:42:18.685163 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0ce2fcfb-6f6b-4875-97e5-5c30902b5da6 admin admin] Checking segment: {'id': 'cc9a1d0a-1ce8-490e-886f-4f9fc5e8fc3d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1333, 'network_id': '58926b0f-c6c9-44b1-aa59-d580f9359c87'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=99026) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 17:42:18.685817 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0ce2fcfb-6f6b-4875-97e5-5c30902b5da6 admin admin] Network hostable DHCP agents. Network: 58926b0f-c6c9-44b1-aa59-d580f9359c87, hostable agents: ['c8b0a350-254b-4562-874b-120ecdef0e25'], hosted agents: [] {{(pid=99026) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 25 17:42:18.710132 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-339aa27b-e142-4172-a51b-4bab30e479c6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6726d4e1-f2e8-454c-8eb5-fe9d63052d6d,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:18.711104 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-339aa27b-e142-4172-a51b-4bab30e479c6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.127s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:18.738693 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-42f178f9-38ed-4412-827f-25a67a52c917 admin admin] Network 6c7eca3b-72f3-4ba8-9e95-614d64496512 is scheduled to be hosted by DHCP agent c8b0a350-254b-4562-874b-120ecdef0e25 with binding_index 1 {{(pid=99026) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 25 17:42:18.747367 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-144068ab-ac0d-4c3a-a29a-838c35f0f378 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:18.763723 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-339aa27b-e142-4172-a51b-4bab30e479c6 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8781840806997'] for network, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:18.767630 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-cb6fe376-d1fa-4bc5-9cbc-18073d1d7f88 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:18.807712 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0ce2fcfb-6f6b-4875-97e5-5c30902b5da6 admin admin] Network 58926b0f-c6c9-44b1-aa59-d580f9359c87 is scheduled to be hosted by DHCP agent c8b0a350-254b-4562-874b-120ecdef0e25 with binding_index 1 {{(pid=99026) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 25 17:42:18.826856 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-904e32c8-a8a4-4c07-995f-ee8fbea79424 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:18.827697 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-144068ab-ac0d-4c3a-a29a-838c35f0f378 admin admin] vlan segment allocate from pool success with {'vlan_id': 1329, 'physical_network': 'physnet1'}  {{(pid=99027) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 25 17:42:18.829836 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-144068ab-ac0d-4c3a-a29a-838c35f0f378 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=aec354c8-23d0-4d5f-ac17-f81c620a2f17,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:18.833177 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-144068ab-ac0d-4c3a-a29a-838c35f0f378 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.066s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:18.855053 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-144068ab-ac0d-4c3a-a29a-838c35f0f378 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1469168'] for segment, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:18.855398 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.db.segments_db [None req-144068ab-ac0d-4c3a-a29a-838c35f0f378 admin admin] Added segment d619a116-4277-4bad-a1ec-8ca0357dd129 of type vlan for network 2abe381d-082b-4294-8193-c6556a56adb4
May 25 17:42:18.889642 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-144068ab-ac0d-4c3a-a29a-838c35f0f378 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8781840806997'] for network, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:18.905139 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.scheduler.base_scheduler [None req-0ce2fcfb-6f6b-4875-97e5-5c30902b5da6 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-789564-2-iscsi, 58926b0f-c6c9-44b1-aa59-d580f9359c87) {{(pid=99026) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 17:42:18.906684 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.scheduler.base_scheduler [None req-42f178f9-38ed-4412-827f-25a67a52c917 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-789564-2-iscsi, 6c7eca3b-72f3-4ba8-9e95-614d64496512) {{(pid=99026) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 17:42:18.914120 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2fc58ab6-c53a-4ef7-9f64-75d7c451e1d5 None None] Network 58926b0f-c6c9-44b1-aa59-d580f9359c87 requested from dv-cinder-789564-2-iscsi {{(pid=99028) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 17:42:18.937232 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0ce2fcfb-6f6b-4875-97e5-5c30902b5da6 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:42:18.938027 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-0ce2fcfb-6f6b-4875-97e5-5c30902b5da6 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for subnet, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:18.938376 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-339aa27b-e142-4172-a51b-4bab30e479c6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-459299', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551400'] for network, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:18.939442 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-904e32c8-a8a4-4c07-995f-ee8fbea79424 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:18.941190 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-339aa27b-e142-4172-a51b-4bab30e479c6 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:42:18.941844 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-339aa27b-e142-4172-a51b-4bab30e479c6 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for network, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:18.947704 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-8b18666f-ad90-48d2-8753-670d885a401a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:18.969354 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-42f178f9-38ed-4412-827f-25a67a52c917 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:42:18.970220 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-42f178f9-38ed-4412-827f-25a67a52c917 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for subnet, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:19.057843 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-339aa27b-e142-4172-a51b-4bab30e479c6 admin admin] Pushing event updated for resources: {'Network': ['ID=20f9a6bc-29c0-49ed-a2fb-d197360212a9,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:19.063456 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-144068ab-ac0d-4c3a-a29a-838c35f0f378 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-459299', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551400'] for network, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:19.066142 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-339aa27b-e142-4172-a51b-4bab30e479c6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.119s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:19.066622 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.007s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:19.078266 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-0ce2fcfb-6f6b-4875-97e5-5c30902b5da6 admin admin] 10.222.0.122 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 849 time: 1.6055303
May 25 17:42:19.099626 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-144068ab-ac0d-4c3a-a29a-838c35f0f378 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:42:19.103526 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-144068ab-ac0d-4c3a-a29a-838c35f0f378 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for network, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:19.104257 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-904e32c8-a8a4-4c07-995f-ee8fbea79424 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d5f76a5d-1e9e-4434-8249-d13ef3e3fa1b,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:19.116614 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-904e32c8-a8a4-4c07-995f-ee8fbea79424 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:19.117285 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-904e32c8-a8a4-4c07-995f-ee8fbea79424 admin admin] vlan segment allocate from pool success with {'vlan_id': 1316, 'physical_network': 'physnet1'}  {{(pid=99027) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 25 17:42:19.119305 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-339aa27b-e142-4172-a51b-4bab30e479c6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.006s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:19.146304 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-42f178f9-38ed-4412-827f-25a67a52c917 admin admin] 10.222.0.122 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 851 time: 1.5376348
May 25 17:42:19.194058 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3db1d633-0bc2-4a66-ad6d-647b92d69659 None None] Network 6c7eca3b-72f3-4ba8-9e95-614d64496512 requested from dv-cinder-789564-2-iscsi {{(pid=99028) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 17:42:19.248363 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-904e32c8-a8a4-4c07-995f-ee8fbea79424 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1469168'] for segment, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:19.248713 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.db.segments_db [None req-904e32c8-a8a4-4c07-995f-ee8fbea79424 admin admin] Added segment 9ffd894c-b357-4c03-93af-a222f8984466 of type vlan for network defaef08-c0f9-4608-b66d-b97e06e185bf
May 25 17:42:19.268186 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-144068ab-ac0d-4c3a-a29a-838c35f0f378 admin admin] Pushing event updated for resources: {'Network': ['ID=2abe381d-082b-4294-8193-c6556a56adb4,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:19.281227 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-144068ab-ac0d-4c3a-a29a-838c35f0f378 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.162s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:19.297720 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Network 20f9a6bc-29c0-49ed-a2fb-d197360212a9 details requested by agent ovs-agent-dv-cinder-789564-2-iscsi with host dv-cinder-789564-2-iscsi {{(pid=99028) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 25 17:42:19.301877 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-904e32c8-a8a4-4c07-995f-ee8fbea79424 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8781840806997'] for network, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:19.411790 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-339aa27b-e142-4172-a51b-4bab30e479c6 admin admin] 10.222.0.122 "POST /v2.0/networks HTTP/1.1" status: 201  len: 899 time: 1.6952188
May 25 17:42:19.414912 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 39776) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:42:19.421463 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.v2.base [None req-aadab2b8-7c8b-42bb-b423-75530f010fce admin admin] Request body: {'subnet': {'network_id': '20f9a6bc-29c0-49ed-a2fb-d197360212a9', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-2078758342-subnet', 'tenant_id': '834c78f6fe1e4da3bcaa284865200eb2', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=99027) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:42:19.432732 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-aadab2b8-7c8b-42bb-b423-75530f010fce admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:42:19.444016 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-aadab2b8-7c8b-42bb-b423-75530f010fce admin admin] Usage tracker for resource:subnet and tenant:834c78f6fe1e4da3bcaa284865200eb2 is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:42:19.454486 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-144068ab-ac0d-4c3a-a29a-838c35f0f378 admin admin] 10.222.0.122 "POST /v2.0/networks HTTP/1.1" status: 201  len: 892 time: 1.6991644
May 25 17:42:19.455664 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-aadab2b8-7c8b-42bb-b423-75530f010fce admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:42:19.457939 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 39780) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:42:19.464978 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.v2.base [None req-f373dbcb-da00-493f-8375-bead7b8bc9e6 admin admin] Request body: {'subnet': {'network_id': '2abe381d-082b-4294-8193-c6556a56adb4', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerRescueNegativeTestJSON-301463405-subnet', 'tenant_id': '5b2f6ca8c5b94c2f8894c04f297b5f8b', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=99026) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:42:19.473593 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-f373dbcb-da00-493f-8375-bead7b8bc9e6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:42:19.484465 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-aadab2b8-7c8b-42bb-b423-75530f010fce admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:42:19.484465 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-904e32c8-a8a4-4c07-995f-ee8fbea79424 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-459299', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551400'] for network, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:19.485967 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-f373dbcb-da00-493f-8375-bead7b8bc9e6 admin admin] Usage tracker for resource:subnet and tenant:5b2f6ca8c5b94c2f8894c04f297b5f8b is out of sync, need to count used quota {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:42:19.490998 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-904e32c8-a8a4-4c07-995f-ee8fbea79424 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:42:19.493415 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-f373dbcb-da00-493f-8375-bead7b8bc9e6 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:42:19.494756 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-904e32c8-a8a4-4c07-995f-ee8fbea79424 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for network, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:19.500803 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:19.516974 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-f373dbcb-da00-493f-8375-bead7b8bc9e6 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:42:19.532629 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Network 2abe381d-082b-4294-8193-c6556a56adb4 details requested by agent ovs-agent-dv-cinder-789564-2-iscsi with host dv-cinder-789564-2-iscsi {{(pid=99028) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 25 17:42:19.548522 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2354b8a0-642d-4128-9901-0687410f999b None None] Network 58926b0f-c6c9-44b1-aa59-d580f9359c87 requested from dv-cinder-789564-2-iscsi {{(pid=99028) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 17:42:19.601396 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f373dbcb-da00-493f-8375-bead7b8bc9e6 admin admin] Made reservation on behalf of 5b2f6ca8c5b94c2f8894c04f297b5f8b for: {'subnet': 1} {{(pid=99026) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 17:42:19.604744 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-f373dbcb-da00-493f-8375-bead7b8bc9e6 admin admin] Notify callbacks [] for subnet, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:19.707813 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-aadab2b8-7c8b-42bb-b423-75530f010fce admin admin] Made reservation on behalf of 834c78f6fe1e4da3bcaa284865200eb2 for: {'subnet': 1} {{(pid=99027) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 17:42:19.710164 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-aadab2b8-7c8b-42bb-b423-75530f010fce admin admin] Notify callbacks [] for subnet, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:19.810415 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-904e32c8-a8a4-4c07-995f-ee8fbea79424 admin admin] 10.222.0.122 "POST /v2.0/networks HTTP/1.1" status: 201  len: 885 time: 1.6604426
May 25 17:42:19.815199 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 39802) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:42:19.831749 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.v2.base [None req-0ce6b685-ba4d-432d-819d-068e17ad6649 admin admin] Request body: {'subnet': {'network_id': 'defaef08-c0f9-4608-b66d-b97e06e185bf', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeTestJSON-1986395052-subnet', 'tenant_id': 'b4cdc54b260f4e79b87fdf4a43b12e16', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=99027) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:42:19.847677 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-0ce6b685-ba4d-432d-819d-068e17ad6649 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:42:19.859689 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-0ce6b685-ba4d-432d-819d-068e17ad6649 admin admin] Usage tracker for resource:subnet and tenant:b4cdc54b260f4e79b87fdf4a43b12e16 is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:42:19.864162 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-904e32c8-a8a4-4c07-995f-ee8fbea79424 admin admin] Pushing event updated for resources: {'Network': ['ID=defaef08-c0f9-4608-b66d-b97e06e185bf,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:19.870644 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-0ce6b685-ba4d-432d-819d-068e17ad6649 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:42:19.873713 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-904e32c8-a8a4-4c07-995f-ee8fbea79424 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.373s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:19.887601 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-0ce6b685-ba4d-432d-819d-068e17ad6649 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:42:19.897484 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Network defaef08-c0f9-4608-b66d-b97e06e185bf details requested by agent ovs-agent-dv-cinder-789564-2-iscsi with host dv-cinder-789564-2-iscsi {{(pid=99028) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 25 17:42:19.953346 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d3164351-4135-48ab-8010-3142682d3bf6 None None] Network 6c7eca3b-72f3-4ba8-9e95-614d64496512 requested from dv-cinder-789564-2-iscsi {{(pid=99028) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 17:42:20.008975 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0ce6b685-ba4d-432d-819d-068e17ad6649 admin admin] Made reservation on behalf of b4cdc54b260f4e79b87fdf4a43b12e16 for: {'subnet': 1} {{(pid=99027) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 17:42:20.011316 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-0ce6b685-ba4d-432d-819d-068e17ad6649 admin admin] Notify callbacks [] for subnet, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:20.407233 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-f373dbcb-da00-493f-8375-bead7b8bc9e6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114466', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411'] for subnet, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:20.413643 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:20.447722 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 39844) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:42:20.456138 dv-cinder-789564-2-iscsi neutron-server[99027]: WARNING keystonemiddleware.auth_token [-] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases.
May 25 17:42:20.533256 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f373dbcb-da00-493f-8375-bead7b8bc9e6 admin admin] Checking segment: {'id': 'd619a116-4277-4bad-a1ec-8ca0357dd129', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1329, 'network_id': '2abe381d-082b-4294-8193-c6556a56adb4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=99026) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 17:42:20.533734 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f373dbcb-da00-493f-8375-bead7b8bc9e6 admin admin] Network hostable DHCP agents. Network: 2abe381d-082b-4294-8193-c6556a56adb4, hostable agents: ['c8b0a350-254b-4562-874b-120ecdef0e25'], hosted agents: [] {{(pid=99026) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 25 17:42:20.566296 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f373dbcb-da00-493f-8375-bead7b8bc9e6 admin admin] Pushing event updated for resources: {'Subnet': ['ID=e7ef8006-ae0e-4a18-b5c7-707d13fb7031,revision_number=0']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:20.575838 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-f373dbcb-da00-493f-8375-bead7b8bc9e6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.162s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:20.614615 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 39864) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:42:20.618745 dv-cinder-789564-2-iscsi neutron-server[99026]: WARNING keystonemiddleware.auth_token [-] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases.
May 25 17:42:20.663009 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-8bd223fc-5b1c-477f-b05c-ba141912fd13 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:20.732389 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f373dbcb-da00-493f-8375-bead7b8bc9e6 admin admin] Network 2abe381d-082b-4294-8193-c6556a56adb4 is scheduled to be hosted by DHCP agent c8b0a350-254b-4562-874b-120ecdef0e25 with binding_index 1 {{(pid=99026) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 25 17:42:20.779794 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1255886-2c4e-4d60-b056-4e6d8e856d9f req-13d737b7-dfe2-49de-8774-cad696f5fe67 tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:42:20.781250 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-c1255886-2c4e-4d60-b056-4e6d8e856d9f req-13d737b7-dfe2-49de-8774-cad696f5fe67 tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] 10.222.0.122 "GET /v2.0/networks?id=58926b0f-c6c9-44b1-aa59-d580f9359c87 HTTP/1.1" status: 200  len: 812 time: 0.3324127
May 25 17:42:20.808247 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-c1255886-2c4e-4d60-b056-4e6d8e856d9f req-69e64827-3f09-419d-bdae-f57d38758570 tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] 10.222.0.122 "GET /v2.0/quotas/fb338a290a2242fea3a4b8ae2bc4a14c HTTP/1.1" status: 200  len: 375 time: 0.0144663
May 25 17:42:20.827948 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6e0a943-86f9-41f6-bd28-c558d49f9891 req-a90be27e-f0da-4501-a2eb-a65d3ab93873 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:42:20.829624 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-c6e0a943-86f9-41f6-bd28-c558d49f9891 req-a90be27e-f0da-4501-a2eb-a65d3ab93873 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/networks?id=6c7eca3b-72f3-4ba8-9e95-614d64496512 HTTP/1.1" status: 200  len: 814 time: 0.2138836
May 25 17:42:20.845725 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-c6e0a943-86f9-41f6-bd28-c558d49f9891 req-c8a9fce3-7aa0-4b59-ba69-fd76c1ba54cf tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/quotas/5ae575cfd07c4a88aa626c15e6bccfd9 HTTP/1.1" status: 200  len: 375 time: 0.0103207
May 25 17:42:20.861829 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-c1255886-2c4e-4d60-b056-4e6d8e856d9f req-4bc9fa73-866a-43fd-94bf-71d0338dd385 tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] 10.222.0.122 "GET /v2.0/ports?tenant_id=fb338a290a2242fea3a4b8ae2bc4a14c&fields=id HTTP/1.1" status: 200  len: 210 time: 0.0460856
May 25 17:42:20.884754 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.scheduler.base_scheduler [None req-f373dbcb-da00-493f-8375-bead7b8bc9e6 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-789564-2-iscsi, 2abe381d-082b-4294-8193-c6556a56adb4) {{(pid=99026) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 17:42:20.889355 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:20.889727 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f373dbcb-da00-493f-8375-bead7b8bc9e6 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:42:20.890302 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-f373dbcb-da00-493f-8375-bead7b8bc9e6 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for subnet, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:20.898663 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a02ed4fb-62c9-4442-ba6e-707722fba7a6 None None] Network 2abe381d-082b-4294-8193-c6556a56adb4 requested from dv-cinder-789564-2-iscsi {{(pid=99028) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 17:42:20.912040 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-c6e0a943-86f9-41f6-bd28-c558d49f9891 req-110c51dc-fbe7-40ee-99f5-6c6c773feb17 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/ports?tenant_id=5ae575cfd07c4a88aa626c15e6bccfd9&fields=id HTTP/1.1" status: 200  len: 210 time: 0.0599525
May 25 17:42:20.930306 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-aadab2b8-7c8b-42bb-b423-75530f010fce admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114466', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411'] for subnet, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:20.952716 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:21.010929 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aadab2b8-7c8b-42bb-b423-75530f010fce admin admin] Pushing event updated for resources: {'Subnet': ['ID=ca4c4fe6-6443-482e-8132-d47a672f12e8,revision_number=0']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:21.021685 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-f373dbcb-da00-493f-8375-bead7b8bc9e6 admin admin] 10.222.0.122 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 855 time: 1.5597506
May 25 17:42:21.022429 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 39890) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:42:21.029247 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.v2.base [None req-2b87807e-cf35-4a87-ba05-003eda785159 admin admin] Request body: {'router': {'name': 'tempest-ServerRescueNegativeTestJSON-301463405-router', 'tenant_id': '5b2f6ca8c5b94c2f8894c04f297b5f8b', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb'}}} {{(pid=99026) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:42:21.038782 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-2b87807e-cf35-4a87-ba05-003eda785159 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:42:21.048327 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-2b87807e-cf35-4a87-ba05-003eda785159 admin admin] Usage tracker for resource:router and tenant:5b2f6ca8c5b94c2f8894c04f297b5f8b is out of sync, need to count used quota {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:42:21.056418 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-2b87807e-cf35-4a87-ba05-003eda785159 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:42:21.073308 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-2b87807e-cf35-4a87-ba05-003eda785159 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:42:21.076734 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-aadab2b8-7c8b-42bb-b423-75530f010fce admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.124s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:21.143357 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aadab2b8-7c8b-42bb-b423-75530f010fce admin admin] Checking segment: {'id': '24ef52a3-71f5-4354-8441-5f5dae329da1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1337, 'network_id': '20f9a6bc-29c0-49ed-a2fb-d197360212a9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=99027) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 17:42:21.143772 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-aadab2b8-7c8b-42bb-b423-75530f010fce admin admin] Network hostable DHCP agents. Network: 20f9a6bc-29c0-49ed-a2fb-d197360212a9, hostable agents: ['c8b0a350-254b-4562-874b-120ecdef0e25'], hosted agents: [] {{(pid=99027) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 25 17:42:21.208080 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [req-c1255886-2c4e-4d60-b056-4e6d8e856d9f req-3615fdd6-6e5f-4f2f-a967-a8d9747bd74e service neutron] http://10.222.0.122:9696/v2.0/extensions returned with HTTP 200 {{(pid=99027) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 25 17:42:21.211652 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-c1255886-2c4e-4d60-b056-4e6d8e856d9f req-3615fdd6-6e5f-4f2f-a967-a8d9747bd74e service neutron] 10.222.0.122 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.0852859
May 25 17:42:21.211786 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [req-c6e0a943-86f9-41f6-bd28-c558d49f9891 req-0e1119d6-404a-423e-9498-c5f4866f5b56 service neutron] http://10.222.0.122:9696/v2.0/extensions returned with HTTP 200 {{(pid=99026) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 25 17:42:21.218962 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-c6e0a943-86f9-41f6-bd28-c558d49f9891 req-0e1119d6-404a-423e-9498-c5f4866f5b56 service neutron] 10.222.0.122 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.0653312
May 25 17:42:21.240289 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-99d4dbbf-0daa-4fe8-9102-9ef9a148f2d9 None None] Network 2abe381d-082b-4294-8193-c6556a56adb4 requested from dv-cinder-789564-2-iscsi {{(pid=99028) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 17:42:21.250520 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-2b87807e-cf35-4a87-ba05-003eda785159 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-415064', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-6983'] for router, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:21.251992 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-2b87807e-cf35-4a87-ba05-003eda785159 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-414296', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-419975', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-491114', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-6988'] for router, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:21.274301 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-2b87807e-cf35-4a87-ba05-003eda785159 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:21.317331 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-aadab2b8-7c8b-42bb-b423-75530f010fce admin admin] Network 20f9a6bc-29c0-49ed-a2fb-d197360212a9 is scheduled to be hosted by DHCP agent c8b0a350-254b-4562-874b-120ecdef0e25 with binding_index 1 {{(pid=99027) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 25 17:42:21.452899 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-c1255886-2c4e-4d60-b056-4e6d8e856d9f req-1f860838-7b66-45d5-81f9-65b89b3b106c service neutron] 10.222.0.122 "GET /v2.0/networks/58926b0f-c6c9-44b1-aa59-d580f9359c87?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2326295
May 25 17:42:21.453620 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.base_scheduler [None req-aadab2b8-7c8b-42bb-b423-75530f010fce admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-789564-2-iscsi, 20f9a6bc-29c0-49ed-a2fb-d197360212a9) {{(pid=99027) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 17:42:21.462562 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-c6e0a943-86f9-41f6-bd28-c558d49f9891 req-66e7470d-0ead-4a89-96c5-5907c54d2635 service neutron] 10.222.0.122 "GET /v2.0/networks/6c7eca3b-72f3-4ba8-9e95-614d64496512?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2426794
May 25 17:42:21.465925 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e8e18335-b5e7-4326-9fbe-879ce159006b None None] Network 20f9a6bc-29c0-49ed-a2fb-d197360212a9 requested from dv-cinder-789564-2-iscsi {{(pid=99028) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 17:42:21.489809 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-aadab2b8-7c8b-42bb-b423-75530f010fce admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:42:21.490510 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-aadab2b8-7c8b-42bb-b423-75530f010fce admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for subnet, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:21.595537 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-0ce6b685-ba4d-432d-819d-068e17ad6649 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114466', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411'] for subnet, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:21.614941 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:21.699137 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-c1255886-2c4e-4d60-b056-4e6d8e856d9f req-342b694a-2bf8-4f76-b2da-4cacf52175f8 service neutron] 10.222.0.122 "GET /v2.0/networks/58926b0f-c6c9-44b1-aa59-d580f9359c87?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2331808
May 25 17:42:21.708477 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-aadab2b8-7c8b-42bb-b423-75530f010fce admin admin] 10.222.0.122 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 862 time: 2.2918105
May 25 17:42:21.716005 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ce6b685-ba4d-432d-819d-068e17ad6649 admin admin] Pushing event updated for resources: {'Subnet': ['ID=5be08358-9d04-4ee9-91ac-104e66e66e20,revision_number=0']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:21.720045 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-0ce6b685-ba4d-432d-819d-068e17ad6649 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.105s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:21.730740 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0ce6b685-ba4d-432d-819d-068e17ad6649 admin admin] Checking segment: {'id': '9ffd894c-b357-4c03-93af-a222f8984466', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1316, 'network_id': 'defaef08-c0f9-4608-b66d-b97e06e185bf'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=99027) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 17:42:21.738626 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0ce6b685-ba4d-432d-819d-068e17ad6649 admin admin] Network hostable DHCP agents. Network: defaef08-c0f9-4608-b66d-b97e06e185bf, hostable agents: ['c8b0a350-254b-4562-874b-120ecdef0e25'], hosted agents: [] {{(pid=99027) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 25 17:42:21.766574 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-7e261f94-b84f-443e-be49-3bc1ac903b55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:21.821001 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-071d4825-c747-4db7-b9de-181e43dc1d2d None None] Network 20f9a6bc-29c0-49ed-a2fb-d197360212a9 requested from dv-cinder-789564-2-iscsi {{(pid=99028) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 17:42:21.853000 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0ce6b685-ba4d-432d-819d-068e17ad6649 admin admin] Network defaef08-c0f9-4608-b66d-b97e06e185bf is scheduled to be hosted by DHCP agent c8b0a350-254b-4562-874b-120ecdef0e25 with binding_index 1 {{(pid=99027) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 25 17:42:21.902836 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-2b87807e-cf35-4a87-ba05-003eda785159 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-420002', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-415082', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-6970'] for router, precommit_update {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:21.912385 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-c6e0a943-86f9-41f6-bd28-c558d49f9891 req-a2cd25be-bc79-40b8-958f-0aff0aae39b5 service neutron] 10.222.0.122 "GET /v2.0/networks/6c7eca3b-72f3-4ba8-9e95-614d64496512?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.4489627
May 25 17:42:21.949635 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.base_scheduler [None req-0ce6b685-ba4d-432d-819d-068e17ad6649 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-789564-2-iscsi, defaef08-c0f9-4608-b66d-b97e06e185bf) {{(pid=99027) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 17:42:21.965460 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0ce6b685-ba4d-432d-819d-068e17ad6649 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:42:21.965460 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-0ce6b685-ba4d-432d-819d-068e17ad6649 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for subnet, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:22.018292 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1b3c3749-78c4-4b71-b008-6d8deb2b1b56 None None] Network defaef08-c0f9-4608-b66d-b97e06e185bf requested from dv-cinder-789564-2-iscsi {{(pid=99028) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 17:42:22.046212 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-0ce6b685-ba4d-432d-819d-068e17ad6649 admin admin] 10.222.0.122 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 847 time: 2.2296877
May 25 17:42:22.048628 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 39928) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:42:22.055701 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.v2.base [None req-be78354d-8a7a-498a-bef5-5a4295457f00 admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeTestJSON-1986395052-router', 'tenant_id': 'b4cdc54b260f4e79b87fdf4a43b12e16', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb'}}} {{(pid=99027) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:42:22.064676 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-be78354d-8a7a-498a-bef5-5a4295457f00 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:42:22.075914 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-be78354d-8a7a-498a-bef5-5a4295457f00 admin admin] Usage tracker for resource:router and tenant:b4cdc54b260f4e79b87fdf4a43b12e16 is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:42:22.083739 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-be78354d-8a7a-498a-bef5-5a4295457f00 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:42:22.099614 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-be78354d-8a7a-498a-bef5-5a4295457f00 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:42:22.181395 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 39940) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:42:22.220766 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-22211267-3c8f-44a6-8447-60caf973a840 req-c0780683-4c22-4168-bd87-afd7c41349fb tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] 10.222.0.122 "GET /v2.0/ports?device_id=cab9bd8d-5b7a-4fc2-85cd-9d4f9884b4ee HTTP/1.1" status: 200  len: 210 time: 0.0874121
May 25 17:42:22.223854 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-be78354d-8a7a-498a-bef5-5a4295457f00 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-415064', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-6983'] for router, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:22.227132 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-be78354d-8a7a-498a-bef5-5a4295457f00 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-414296', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-419975', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-491114', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-6988'] for router, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:22.299382 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-be78354d-8a7a-498a-bef5-5a4295457f00 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:22.442816 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-82c9a063-8ffd-4b7a-a437-cc97b290e03d None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpe415bc4a-81ee-5198-a7be-1f5e4adc5586-defaef08-c0f9-4608-b66d-b97e06e185bf', 'network_id': 'defaef08-c0f9-4608-b66d-b97e06e185bf', 'tenant_id': 'b4cdc54b260f4e79b87fdf4a43b12e16', 'fixed_ips': [{'subnet_id': '5be08358-9d04-4ee9-91ac-104e66e66e20'}]}} from dv-cinder-789564-2-iscsi. {{(pid=99028) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
May 25 17:42:22.445336 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-82c9a063-8ffd-4b7a-a437-cc97b290e03d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_create {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:22.704390 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-2c249941-003a-4b1f-964a-58069ab6dbf1 req-a188cb62-ccc9-4114-8a71-a2d417ba30e9 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/ports?device_id=3fb3211e-48f5-46f5-8035-ddbc35109aa8 HTTP/1.1" status: 200  len: 210 time: 0.1224599
May 25 17:42:22.759195 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-b3a3e16e-acca-4c51-96ed-8037a45effc3 admin admin] Notify callbacks [] for security_group, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:22.784650 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.db_base_plugin_common [None req-82c9a063-8ffd-4b7a-a437-cc97b290e03d None None] Allocated IP 172.20.0.2 (defaef08-c0f9-4608-b66d-b97e06e185bf/5be08358-9d04-4ee9-91ac-104e66e66e20/c581af52-ceeb-4e7f-aa17-780c5a994e5e) {{(pid=99028) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 17:42:22.794329 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-b3a3e16e-acca-4c51-96ed-8037a45effc3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:42:22.802008 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-b3a3e16e-acca-4c51-96ed-8037a45effc3 admin admin] Usage tracker for resource:security_group_rule and tenant:c0389e5080b743d682510640e26a0bae is out of sync, need to count used quota {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:42:22.808657 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-b3a3e16e-acca-4c51-96ed-8037a45effc3 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:42:22.811911 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-2b87807e-cf35-4a87-ba05-003eda785159 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:22.847002 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-2b87807e-cf35-4a87-ba05-003eda785159 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:22.849749 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-b3a3e16e-acca-4c51-96ed-8037a45effc3 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:42:22.969693 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-be78354d-8a7a-498a-bef5-5a4295457f00 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-420002', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-415082', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-6970'] for router, precommit_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:23.091836 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.db_base_plugin_common [None req-2b87807e-cf35-4a87-ba05-003eda785159 admin admin] Allocated IP 172.27.3.206 (eb7ec72b-a691-481b-8d7e-42c05e13a8cb/d6898f5f-da0b-4428-97b4-4cbe3e83caaa/ba3fdf48-5b50-4a04-9bed-01d9f2c8cf44) {{(pid=99026) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 17:42:23.122786 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-82c9a063-8ffd-4b7a-a437-cc97b290e03d None None] Notify callbacks [] for port, precommit_create {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:23.152520 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-82c9a063-8ffd-4b7a-a437-cc97b290e03d None None] Transition to ACTIVE for port object c581af52-ceeb-4e7f-aa17-780c5a994e5e will not be triggered until provisioned by entity L2. {{(pid=99028) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 17:42:23.195718 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-b3a3e16e-acca-4c51-96ed-8037a45effc3 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:23.252904 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-82c9a063-8ffd-4b7a-a437-cc97b290e03d None None] Transition to ACTIVE for port object c581af52-ceeb-4e7f-aa17-780c5a994e5e will not be triggered until provisioned by entity DHCP. {{(pid=99028) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 17:42:23.283994 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-b3a3e16e-acca-4c51-96ed-8037a45effc3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:23.322668 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-a801026f-b651-44ca-8e60-1210a688a32b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:23.351775 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-b3a3e16e-acca-4c51-96ed-8037a45effc3 admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=c0389e5080b743d682510640e26a0bae&name=default HTTP/1.1" status: 200  len: 2975 time: 1.1691217
May 25 17:42:23.354526 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3a3e16e-acca-4c51-96ed-8037a45effc3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=25c89e48-8e0b-4e8b-934e-270039bd6654,revision_number=1']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:23.358943 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-2b87807e-cf35-4a87-ba05-003eda785159 admin admin] Notify callbacks [] for port, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:23.361794 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 40018) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:42:23.371654 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-6df2b2a7-a54e-4d57-9be3-033078b9d5b3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:23.414480 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-b3a3e16e-acca-4c51-96ed-8037a45effc3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:23.417968 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-82c9a063-8ffd-4b7a-a437-cc97b290e03d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781840788179'] for port, after_create {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:23.422896 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:23.458370 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-da274ecf-17cd-4ce4-8e53-b2821b5d8f5d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:23.522030 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-da274ecf-17cd-4ce4-8e53-b2821b5d8f5d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:23.552186 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-82c9a063-8ffd-4b7a-a437-cc97b290e03d None None] Network defaef08-c0f9-4608-b66d-b97e06e185bf is already hosted by enough agents. {{(pid=99028) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 17:42:23.556111 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.scheduler.base_scheduler [None req-82c9a063-8ffd-4b7a-a437-cc97b290e03d None None] Resources bound (agent type, host, resource id):  {{(pid=99028) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 17:42:23.560192 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvrscheduler_db [None req-82c9a063-8ffd-4b7a-a437-cc97b290e03d None None] Received port after_create {{(pid=99028) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 17:42:23.563351 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 40028) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:42:23.581705 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 40034) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:42:23.622406 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82c9a063-8ffd-4b7a-a437-cc97b290e03d None None] Pushing event updated for resources: {'Port': ['ID=c581af52-ceeb-4e7f-aa17-780c5a994e5e,revision_number=1']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:23.669865 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.v2.base [None req-631cae27-696a-46e3-99df-a545a194da5d admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-356181528-network', 'tenant_id': 'fa5904b6048d43e9b34c88cb53735be3'}} {{(pid=99026) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:42:23.685141 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-6e59cc6a-ae81-4c0e-9de7-d54572aca5e6 req-2497781f-bb22-424e-a3e1-ffc8b2e97e74 tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] 10.222.0.122 "GET /v2.0/ports?device_id=cab9bd8d-5b7a-4fc2-85cd-9d4f9884b4ee HTTP/1.1" status: 200  len: 210 time: 0.3617473
May 25 17:42:23.686777 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-631cae27-696a-46e3-99df-a545a194da5d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:42:23.705142 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-631cae27-696a-46e3-99df-a545a194da5d admin admin] Usage tracker for resource:network and tenant:fa5904b6048d43e9b34c88cb53735be3 is out of sync, need to count used quota {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:42:23.712917 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-631cae27-696a-46e3-99df-a545a194da5d admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:42:23.728924 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.managers [None req-82c9a063-8ffd-4b7a-a437-cc97b290e03d None None] Attempting to bind port c581af52-ceeb-4e7f-aa17-780c5a994e5e on host dv-cinder-789564-2-iscsi for vnic_type normal with profile  {{(pid=99028) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 17:42:23.729661 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.managers [None req-82c9a063-8ffd-4b7a-a437-cc97b290e03d None None] Attempting to bind port c581af52-ceeb-4e7f-aa17-780c5a994e5e by drivers openvswitch,hyperv on host dv-cinder-789564-2-iscsi at level 0 using segments [{'id': '9ffd894c-b357-4c03-93af-a222f8984466', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1316, 'network_id': 'defaef08-c0f9-4608-b66d-b97e06e185bf'}] {{(pid=99028) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 17:42:23.730290 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-82c9a063-8ffd-4b7a-a437-cc97b290e03d None None] Attempting to bind port c581af52-ceeb-4e7f-aa17-780c5a994e5e on network defaef08-c0f9-4608-b66d-b97e06e185bf {{(pid=99028) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 17:42:23.733376 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82c9a063-8ffd-4b7a-a437-cc97b290e03d None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:42:23.733889 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82c9a063-8ffd-4b7a-a437-cc97b290e03d None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:42:23.736642 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82c9a063-8ffd-4b7a-a437-cc97b290e03d None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:42:23.736642 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82c9a063-8ffd-4b7a-a437-cc97b290e03d None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:42:23.736642 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82c9a063-8ffd-4b7a-a437-cc97b290e03d None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:42:23.736912 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82c9a063-8ffd-4b7a-a437-cc97b290e03d None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:42:23.737191 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82c9a063-8ffd-4b7a-a437-cc97b290e03d None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:42:23.737439 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82c9a063-8ffd-4b7a-a437-cc97b290e03d None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:42:23.738486 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82c9a063-8ffd-4b7a-a437-cc97b290e03d None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:42:23.738978 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82c9a063-8ffd-4b7a-a437-cc97b290e03d None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:42:23.739450 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82c9a063-8ffd-4b7a-a437-cc97b290e03d None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:42:23.739917 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82c9a063-8ffd-4b7a-a437-cc97b290e03d None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:42:23.742066 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-82c9a063-8ffd-4b7a-a437-cc97b290e03d None None] Tracked resource versions report:
May 25 17:42:23.742066 dv-cinder-789564-2-iscsi neutron-server[99028]: pushed versions:
May 25 17:42:23.742066 dv-cinder-789564-2-iscsi neutron-server[99028]: {   'AddressGroup': {'1.2'},
May 25 17:42:23.742066 dv-cinder-789564-2-iscsi neutron-server[99028]:     'ConntrackHelper': {'1.0'},
May 25 17:42:23.742066 dv-cinder-789564-2-iscsi neutron-server[99028]:     'Log': {'1.0'},
May 25 17:42:23.742066 dv-cinder-789564-2-iscsi neutron-server[99028]:     'Network': {'1.1'},
May 25 17:42:23.742066 dv-cinder-789564-2-iscsi neutron-server[99028]:     'Port': {'1.7'},
May 25 17:42:23.742066 dv-cinder-789564-2-iscsi neutron-server[99028]:     'PortForwarding': {'1.2'},
May 25 17:42:23.742066 dv-cinder-789564-2-iscsi neutron-server[99028]:     'QosPolicy': {'1.8'},
May 25 17:42:23.742066 dv-cinder-789564-2-iscsi neutron-server[99028]:     'SecurityGroup': {'1.4'},
May 25 17:42:23.742066 dv-cinder-789564-2-iscsi neutron-server[99028]:     'SecurityGroupRule': {'1.2'},
May 25 17:42:23.742066 dv-cinder-789564-2-iscsi neutron-server[99028]:     'SubPort': {'1.0'},
May 25 17:42:23.742066 dv-cinder-789564-2-iscsi neutron-server[99028]:     'Subnet': {'1.1'},
May 25 17:42:23.742066 dv-cinder-789564-2-iscsi neutron-server[99028]:     'Trunk': {'1.1'}}
May 25 17:42:23.742066 dv-cinder-789564-2-iscsi neutron-server[99028]: consumer versions:
May 25 17:42:23.742066 dv-cinder-789564-2-iscsi neutron-server[99028]: {   DHCP agent@dv-cinder-789564-2-iscsi: {},
May 25 17:42:23.742066 dv-cinder-789564-2-iscsi neutron-server[99028]:     HyperV agent@hv-cinder-78956: {},
May 25 17:42:23.742066 dv-cinder-789564-2-iscsi neutron-server[99028]:     L3 agent@dv-cinder-789564-2-iscsi: {},
May 25 17:42:23.742066 dv-cinder-789564-2-iscsi neutron-server[99028]:     Metadata agent@dv-cinder-789564-2-iscsi: {},
May 25 17:42:23.742066 dv-cinder-789564-2-iscsi neutron-server[99028]:     Metering agent@dv-cinder-789564-2-iscsi: {},
May 25 17:42:23.742066 dv-cinder-789564-2-iscsi neutron-server[99028]:     Open vSwitch agent@dv-cinder-789564-2-iscsi: {   'AddressGroup': '1.2',
May 25 17:42:23.742066 dv-cinder-789564-2-iscsi neutron-server[99028]:                                                      'ConntrackHelper': '1.0',
May 25 17:42:23.742066 dv-cinder-789564-2-iscsi neutron-server[99028]:                                                      'Log': '1.0',
May 25 17:42:23.742066 dv-cinder-789564-2-iscsi neutron-server[99028]:                                                      'Network': '1.1',
May 25 17:42:23.742066 dv-cinder-789564-2-iscsi neutron-server[99028]:                                                      'Port': '1.7',
May 25 17:42:23.742066 dv-cinder-789564-2-iscsi neutron-server[99028]:                                                      'PortForwarding': '1.2',
May 25 17:42:23.742066 dv-cinder-789564-2-iscsi neutron-server[99028]:                                                      'QosPolicy': '1.8',
May 25 17:42:23.742066 dv-cinder-789564-2-iscsi neutron-server[99028]:                                                      'SecurityGroup': '1.4',
May 25 17:42:23.742066 dv-cinder-789564-2-iscsi neutron-server[99028]:                                                      'SecurityGroupRule': '1.2',
May 25 17:42:23.742066 dv-cinder-789564-2-iscsi neutron-server[99028]:                                                      'SubPort': '1.0',
May 25 17:42:23.742066 dv-cinder-789564-2-iscsi neutron-server[99028]:                                                      'Subnet': '1.1',
May 25 17:42:23.742066 dv-cinder-789564-2-iscsi neutron-server[99028]:                                                      'Trunk': '1.1'}}
May 25 17:42:23.742066 dv-cinder-789564-2-iscsi neutron-server[99028]:  {{(pid=99028) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
May 25 17:42:23.751034 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-82c9a063-8ffd-4b7a-a437-cc97b290e03d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.328s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:23.754580 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-82c9a063-8ffd-4b7a-a437-cc97b290e03d None None] Checking agent: {'id': '7bb67520-1e97-4ad9-9b97-101068bbe1a3', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-789564-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 17, 34, 21), 'started_at': datetime.datetime(2021, 5, 25, 17, 34, 51), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 17, 42, 21), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-789564-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=99028) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 17:42:23.755162 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-82c9a063-8ffd-4b7a-a437-cc97b290e03d None None] Checking segment: {'id': '9ffd894c-b357-4c03-93af-a222f8984466', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1316, 'network_id': 'defaef08-c0f9-4608-b66d-b97e06e185bf'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=99028) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 17:42:23.755725 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-82c9a063-8ffd-4b7a-a437-cc97b290e03d None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:23.760081 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-631cae27-696a-46e3-99df-a545a194da5d admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:42:23.770120 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-82c9a063-8ffd-4b7a-a437-cc97b290e03d None None] Bound using segment: {'id': '9ffd894c-b357-4c03-93af-a222f8984466', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1316, 'network_id': 'defaef08-c0f9-4608-b66d-b97e06e185bf'} {{(pid=99028) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 17:42:23.770120 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.managers [None req-82c9a063-8ffd-4b7a-a437-cc97b290e03d None None] Bound port: c581af52-ceeb-4e7f-aa17-780c5a994e5e, host: dv-cinder-789564-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9ffd894c-b357-4c03-93af-a222f8984466', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1316, 'network_id': 'defaef08-c0f9-4608-b66d-b97e06e185bf'}}] {{(pid=99028) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 17:42:23.770120 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-82c9a063-8ffd-4b7a-a437-cc97b290e03d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:23.840956 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-be78354d-8a7a-498a-bef5-5a4295457f00 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:23.855661 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-097d7fd2-f258-4e65-a39e-4ec2fb136c73 req-0f929f1f-b3d9-4f46-a432-0f0987cdeecc tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/ports?device_id=3fb3211e-48f5-46f5-8035-ddbc35109aa8 HTTP/1.1" status: 200  len: 210 time: 0.0689936
May 25 17:42:23.893942 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-be78354d-8a7a-498a-bef5-5a4295457f00 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:23.927099 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-82c9a063-8ffd-4b7a-a437-cc97b290e03d None None] For port c581af52-ceeb-4e7f-aa17-780c5a994e5e, host dv-cinder-789564-2-iscsi, cleared binding levels {{(pid=99028) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 17:42:23.937070 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-82c9a063-8ffd-4b7a-a437-cc97b290e03d None None] For port c581af52-ceeb-4e7f-aa17-780c5a994e5e, host dv-cinder-789564-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=c581af52-ceeb-4e7f-aa17-780c5a994e5e,segment=NetworkSegment(9ffd894c-b357-4c03-93af-a222f8984466),segment_id=9ffd894c-b357-4c03-93af-a222f8984466)] {{(pid=99028) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 17:42:23.960604 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-631cae27-696a-46e3-99df-a545a194da5d admin admin] Made reservation on behalf of fa5904b6048d43e9b34c88cb53735be3 for: {'network': 1} {{(pid=99026) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 17:42:23.963096 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-631cae27-696a-46e3-99df-a545a194da5d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-1465344'] for network, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:23.977046 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-631cae27-696a-46e3-99df-a545a194da5d admin admin] Notify callbacks [] for security_group, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:24.005857 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-631cae27-696a-46e3-99df-a545a194da5d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:42:24.008175 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-59b56017-bf19-4545-ae95-6dcdc800972f admin admin] Notify callbacks [] for security_group, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:24.020659 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-631cae27-696a-46e3-99df-a545a194da5d admin admin] Usage tracker for resource:security_group_rule and tenant:fa5904b6048d43e9b34c88cb53735be3 is out of sync, need to count used quota {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:42:24.026799 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-631cae27-696a-46e3-99df-a545a194da5d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:42:24.028616 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-59b56017-bf19-4545-ae95-6dcdc800972f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:42:24.034335 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-631cae27-696a-46e3-99df-a545a194da5d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:42:24.036395 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-59b56017-bf19-4545-ae95-6dcdc800972f admin admin] Usage tracker for resource:security_group_rule and tenant:3d594402c1a1490c856c781b20bf6874 is out of sync, need to count used quota {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:42:24.041033 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-59b56017-bf19-4545-ae95-6dcdc800972f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:42:24.053534 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-2b87807e-cf35-4a87-ba05-003eda785159 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781840788179'] for port, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:24.055600 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-da274ecf-17cd-4ce4-8e53-b2821b5d8f5d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:24.055848 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-59b56017-bf19-4545-ae95-6dcdc800972f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:42:24.079258 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:24.114578 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-82c9a063-8ffd-4b7a-a437-cc97b290e03d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:24.119701 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-82c9a063-8ffd-4b7a-a437-cc97b290e03d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:24.157997 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2b87807e-cf35-4a87-ba05-003eda785159 admin admin] Network eb7ec72b-a691-481b-8d7e-42c05e13a8cb is already hosted by enough agents. {{(pid=99026) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 17:42:24.177531 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.scheduler.base_scheduler [None req-2b87807e-cf35-4a87-ba05-003eda785159 admin admin] Resources bound (agent type, host, resource id):  {{(pid=99026) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 17:42:24.184056 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.db_base_plugin_common [None req-be78354d-8a7a-498a-bef5-5a4295457f00 admin admin] Allocated IP 172.27.3.176 (eb7ec72b-a691-481b-8d7e-42c05e13a8cb/d6898f5f-da0b-4428-97b4-4cbe3e83caaa/9635c7b0-eb08-41ee-980e-3da56221f88d) {{(pid=99027) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 17:42:24.202299 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2b87807e-cf35-4a87-ba05-003eda785159 admin admin] Received port after_create {{(pid=99026) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 17:42:24.226726 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82c9a063-8ffd-4b7a-a437-cc97b290e03d None None] Pushing event updated for resources: {'Port': ['ID=c581af52-ceeb-4e7f-aa17-780c5a994e5e,revision_number=2']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:24.234688 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-82c9a063-8ffd-4b7a-a437-cc97b290e03d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.115s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:24.439329 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b87807e-cf35-4a87-ba05-003eda785159 admin admin] Pushing event updated for resources: {'Port': ['ID=ba3fdf48-5b50-4a04-9bed-01d9f2c8cf44,revision_number=1']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:24.448437 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-2b87807e-cf35-4a87-ba05-003eda785159 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.369s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:24.462451 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-be78354d-8a7a-498a-bef5-5a4295457f00 admin admin] Notify callbacks [] for port, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:24.485981 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.367s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:24.520386 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-da274ecf-17cd-4ce4-8e53-b2821b5d8f5d admin admin] Notify callbacks [] for security_group, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:24.525164 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-da274ecf-17cd-4ce4-8e53-b2821b5d8f5d admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/25c89e48-8e0b-4e8b-934e-270039bd6654 HTTP/1.1" status: 204  len: 168 time: 1.1623025
May 25 17:42:24.532891 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da274ecf-17cd-4ce4-8e53-b2821b5d8f5d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=25c89e48-8e0b-4e8b-934e-270039bd6654,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:24.535416 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-da274ecf-17cd-4ce4-8e53-b2821b5d8f5d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.061s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:24.609042 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-631cae27-696a-46e3-99df-a545a194da5d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:24.656858 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-59b56017-bf19-4545-ae95-6dcdc800972f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:24.671372 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-be78354d-8a7a-498a-bef5-5a4295457f00 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781840788179'] for port, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:24.678316 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:24.740957 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-be78354d-8a7a-498a-bef5-5a4295457f00 admin admin] Network eb7ec72b-a691-481b-8d7e-42c05e13a8cb is already hosted by enough agents. {{(pid=99027) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 17:42:24.742753 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.base_scheduler [None req-be78354d-8a7a-498a-bef5-5a4295457f00 admin admin] Resources bound (agent type, host, resource id):  {{(pid=99027) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 17:42:24.745431 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.l3_dvrscheduler_db [None req-be78354d-8a7a-498a-bef5-5a4295457f00 admin admin] Received port after_create {{(pid=99027) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 17:42:24.889499 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-631cae27-696a-46e3-99df-a545a194da5d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:24.899520 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-59b56017-bf19-4545-ae95-6dcdc800972f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:24.922749 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:24.985795 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be78354d-8a7a-498a-bef5-5a4295457f00 admin admin] Pushing event updated for resources: {'Port': ['ID=9635c7b0-eb08-41ee-980e-3da56221f88d,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:24.990152 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-be78354d-8a7a-498a-bef5-5a4295457f00 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.312s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:25.019492 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-3728157d-a85a-48f1-9df0-76bd6c2e79a4 req-e1660cd1-e4da-4620-a307-7530b2148399 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/ports?device_id=3fb3211e-48f5-46f5-8035-ddbc35109aa8 HTTP/1.1" status: 200  len: 210 time: 0.0843248
May 25 17:42:25.031846 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-631cae27-696a-46e3-99df-a545a194da5d admin admin] vlan segment allocate from pool success with {'vlan_id': 1323, 'physical_network': 'physnet1'}  {{(pid=99026) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 25 17:42:25.045073 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-7e28d2cd-2edb-41b9-8214-5257a58bde1e req-8852e8df-077a-4365-9c1b-7242caf57767 tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] 10.222.0.122 "GET /v2.0/ports?device_id=cab9bd8d-5b7a-4fc2-85cd-9d4f9884b4ee HTTP/1.1" status: 200  len: 210 time: 0.2382658
May 25 17:42:25.199272 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-2b87807e-cf35-4a87-ba05-003eda785159 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:25.242750 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device c581af52-ceeb-4e7f-aa17-780c5a994e5e up at agent ovs-agent-dv-cinder-789564-2-iscsi {{(pid=99028) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 17:42:25.422533 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Provisioning for port c581af52-ceeb-4e7f-aa17-780c5a994e5e completed by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 17:42:25.465136 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-be78354d-8a7a-498a-bef5-5a4295457f00 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:25.484972 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-631cae27-696a-46e3-99df-a545a194da5d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1469168'] for segment, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:25.486043 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.db.segments_db [None req-631cae27-696a-46e3-99df-a545a194da5d admin admin] Added segment 486f26bb-e6e6-4d42-9c99-59085f6a249d of type vlan for network ddc17283-66fe-4b17-b7ec-43aea38f7496
May 25 17:42:25.501710 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-631cae27-696a-46e3-99df-a545a194da5d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=57ae5d73-571c-4ded-af34-7b55bc6b5e18,revision_number=1']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:25.569566 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-59b56017-bf19-4545-ae95-6dcdc800972f admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=3d594402c1a1490c856c781b20bf6874&name=default HTTP/1.1" status: 200  len: 2975 time: 2.0024602
May 25 17:42:25.578156 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 40132) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:42:25.579751 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-631cae27-696a-46e3-99df-a545a194da5d admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8781840806997'] for network, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:25.587274 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-880cfe63-a924-4c63-a139-d2b6c1d9d946 None None] Network defaef08-c0f9-4608-b66d-b97e06e185bf requested from dv-cinder-789564-2-iscsi {{(pid=99028) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 17:42:25.637219 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59b56017-bf19-4545-ae95-6dcdc800972f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=741df100-3e8d-4c25-b61f-d7de445ea90e,revision_number=1']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:25.652798 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-59b56017-bf19-4545-ae95-6dcdc800972f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.730s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:25.656192 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.638s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:25.656192 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:25.730510 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 40136) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:42:25.780352 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-895a4e5d-1dee-4eaa-9901-7959a4c515d6 admin admin] Notify callbacks [] for security_group, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:25.839735 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-c384d012-fd13-489d-8474-3365467d3cb4 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:25.850213 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-d4dd3845-1f7f-45ee-8256-ebaa94faf8a8 None None] Provisioning for port c581af52-ceeb-4e7f-aa17-780c5a994e5e completed by entity DHCP. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 17:42:25.893885 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-c384d012-fd13-489d-8474-3365467d3cb4 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:25.915543 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-be78354d-8a7a-498a-bef5-5a4295457f00 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-415057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-420065'] for router, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:25.939239 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-631cae27-696a-46e3-99df-a545a194da5d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-459299', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551400'] for network, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:25.940134 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-d4dd3845-1f7f-45ee-8256-ebaa94faf8a8 None None] Provisioning complete for port c581af52-ceeb-4e7f-aa17-780c5a994e5e triggered by entity DHCP. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 17:42:25.940760 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-d4dd3845-1f7f-45ee-8256-ebaa94faf8a8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:25.950180 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-631cae27-696a-46e3-99df-a545a194da5d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:42:25.951167 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-631cae27-696a-46e3-99df-a545a194da5d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for network, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:25.978691 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-aa7f2d94-cb9f-46e8-b481-9db8fe60626a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:25.998266 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-2b87807e-cf35-4a87-ba05-003eda785159 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-415057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-420065'] for router, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:26.036319 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 40144) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:42:26.215388 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-895a4e5d-1dee-4eaa-9901-7959a4c515d6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:42:26.219221 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-895a4e5d-1dee-4eaa-9901-7959a4c515d6 admin admin] Usage tracker for resource:security_group_rule and tenant:3a33e72158834b0da1b828453ce52591 is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:42:26.222550 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-895a4e5d-1dee-4eaa-9901-7959a4c515d6 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:42:26.234469 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-895a4e5d-1dee-4eaa-9901-7959a4c515d6 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:42:26.238094 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-631cae27-696a-46e3-99df-a545a194da5d admin admin] 10.222.0.122 "POST /v2.0/networks HTTP/1.1" status: 201  len: 898 time: 2.6320300
May 25 17:42:26.263442 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 40154) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:42:26.276865 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.v2.base [None req-a85be3f4-de6f-4da0-80ce-eb213c6f8b3a admin admin] Request body: {'subnet': {'network_id': 'ddc17283-66fe-4b17-b7ec-43aea38f7496', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-356181528-subnet', 'tenant_id': 'fa5904b6048d43e9b34c88cb53735be3', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=99027) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:42:26.288921 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-a85be3f4-de6f-4da0-80ce-eb213c6f8b3a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:42:26.290697 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-d4dd3845-1f7f-45ee-8256-ebaa94faf8a8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:26.303724 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-a85be3f4-de6f-4da0-80ce-eb213c6f8b3a admin admin] Usage tracker for resource:subnet and tenant:fa5904b6048d43e9b34c88cb53735be3 is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:42:26.326350 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-a85be3f4-de6f-4da0-80ce-eb213c6f8b3a admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:42:26.345882 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-7b66a60b-3813-486a-b8ab-5487a7ea24d7 req-ffc8c5a5-74c5-44e0-ac63-f7bc812bc129 tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] 10.222.0.122 "GET /v2.0/ports?device_id=cab9bd8d-5b7a-4fc2-85cd-9d4f9884b4ee HTTP/1.1" status: 200  len: 210 time: 0.0890262
May 25 17:42:26.349230 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-631cae27-696a-46e3-99df-a545a194da5d admin admin] Pushing event updated for resources: {'Network': ['ID=ddc17283-66fe-4b17-b7ec-43aea38f7496,revision_number=1']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:26.368150 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-631cae27-696a-46e3-99df-a545a194da5d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.389s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:26.369434 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Network ddc17283-66fe-4b17-b7ec-43aea38f7496 details requested by agent ovs-agent-dv-cinder-789564-2-iscsi with host dv-cinder-789564-2-iscsi {{(pid=99028) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 25 17:42:26.414528 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-a85be3f4-de6f-4da0-80ce-eb213c6f8b3a admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:42:26.423543 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-556cdc30-7bfb-420b-9ffa-704a2eaa16e6 req-99bcc705-d36f-4daf-8438-2df33e504369 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/ports?device_id=3fb3211e-48f5-46f5-8035-ddbc35109aa8 HTTP/1.1" status: 200  len: 210 time: 0.0777359
May 25 17:42:26.469233 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-30ba8546-17e0-4e14-90a3-ab9c7e1764d0 admin admin] Notify callbacks [] for security_group, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:26.484087 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-c384d012-fd13-489d-8474-3365467d3cb4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:26.484087 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-da274ecf-17cd-4ce4-8e53-b2821b5d8f5d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:26.513528 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-30ba8546-17e0-4e14-90a3-ab9c7e1764d0 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:42:26.528158 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-30ba8546-17e0-4e14-90a3-ab9c7e1764d0 admin admin] Usage tracker for resource:security_group_rule and tenant:339c757c9d6140fab85827cf738adfb5 is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:42:26.530850 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-d4dd3845-1f7f-45ee-8256-ebaa94faf8a8 None None] For port c581af52-ceeb-4e7f-aa17-780c5a994e5e, host dv-cinder-789564-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=c581af52-ceeb-4e7f-aa17-780c5a994e5e,segment=NetworkSegment(9ffd894c-b357-4c03-93af-a222f8984466),segment_id=9ffd894c-b357-4c03-93af-a222f8984466)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:42:26.532860 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-30ba8546-17e0-4e14-90a3-ab9c7e1764d0 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:42:26.546066 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c384d012-fd13-489d-8474-3365467d3cb4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=741df100-3e8d-4c25-b61f-d7de445ea90e,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:26.549253 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-30ba8546-17e0-4e14-90a3-ab9c7e1764d0 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:42:26.557056 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-895a4e5d-1dee-4eaa-9901-7959a4c515d6 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:26.558056 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-c384d012-fd13-489d-8474-3365467d3cb4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.078s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:26.559573 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-c384d012-fd13-489d-8474-3365467d3cb4 admin admin] Notify callbacks [] for security_group, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:26.560888 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-c384d012-fd13-489d-8474-3365467d3cb4 admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/741df100-3e8d-4c25-b61f-d7de445ea90e HTTP/1.1" status: 204  len: 168 time: 0.9772897
May 25 17:42:26.586141 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a85be3f4-de6f-4da0-80ce-eb213c6f8b3a admin admin] Made reservation on behalf of fa5904b6048d43e9b34c88cb53735be3 for: {'subnet': 1} {{(pid=99027) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 17:42:26.586141 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-a85be3f4-de6f-4da0-80ce-eb213c6f8b3a admin admin] Notify callbacks [] for subnet, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:26.614685 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-d4dd3845-1f7f-45ee-8256-ebaa94faf8a8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:26.617975 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:26.619358 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-be78354d-8a7a-498a-bef5-5a4295457f00 admin admin] Router d71e624d-d858-442b-b878-577be49edd03 is scheduled to L3 agent eaeb6875-c4ed-43b6-8658-aa4e52324fdf with binding_index 1 {{(pid=99027) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
May 25 17:42:26.687822 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-895a4e5d-1dee-4eaa-9901-7959a4c515d6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:26.688075 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4dd3845-1f7f-45ee-8256-ebaa94faf8a8 None None] Pushing event updated for resources: {'Port': ['ID=c581af52-ceeb-4e7f-aa17-780c5a994e5e,revision_number=3']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:26.691551 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-d4dd3845-1f7f-45ee-8256-ebaa94faf8a8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:26.718189 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:26.723029 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2b87807e-cf35-4a87-ba05-003eda785159 admin admin] Router df4629e6-3b17-47f3-88e4-022b915a6a91 is scheduled to L3 agent eaeb6875-c4ed-43b6-8658-aa4e52324fdf with binding_index 1 {{(pid=99026) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
May 25 17:42:26.747153 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-ef232fb4-1d87-42e7-be74-f83f982a9955 None None] Provisioning complete for port c581af52-ceeb-4e7f-aa17-780c5a994e5e triggered by entity DHCP. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 17:42:26.748449 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-ef232fb4-1d87-42e7-be74-f83f982a9955 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:26.875865 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-895a4e5d-1dee-4eaa-9901-7959a4c515d6 admin admin] Synchronizing usage tracker for tenant:537bb945cac6475e8b1205f34ad1e207 on resource:security_group {{(pid=99027) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 17:42:26.920499 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-895a4e5d-1dee-4eaa-9901-7959a4c515d6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d9ce5b00-475d-4481-9535-a142e508045b,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:26.986215 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2b87807e-cf35-4a87-ba05-003eda785159 admin admin] Notify agent at l3_agent.dv-cinder-789564-2-iscsi the message routers_updated {{(pid=99026) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 25 17:42:27.001678 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fe4a6105-f6ae-4e06-894f-a05fd9ed4d4f None None] Sync routers for ids ['df4629e6-3b17-47f3-88e4-022b915a6a91'] in dv-cinder-789564-2-iscsi {{(pid=99029) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 25 17:42:27.014451 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-895a4e5d-1dee-4eaa-9901-7959a4c515d6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.295s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:27.025228 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fe4a6105-f6ae-4e06-894f-a05fd9ed4d4f None None] Routers {'df4629e6-3b17-47f3-88e4-022b915a6a91'} bound to L3 agent in host dv-cinder-789564-2-iscsi {{(pid=99029) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 17:42:27.026280 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_hamode_db [None req-fe4a6105-f6ae-4e06-894f-a05fd9ed4d4f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcae7ca2e20>, 'dv-cinder-789564-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-25T17:34:21Z,description=<?>,heartbeat_timestamp=2021-05-25T17:42:21Z,host='dv-cinder-789564-2-iscsi',id=eaeb6875-c4ed-43b6-8658-aa4e52324fdf,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T17:34:21Z,topic='l3_agent')) {'router_ids': ['df4629e6-3b17-47f3-88e4-022b915a6a91'], 'active': True} {{(pid=99029) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:42:27.122267 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device c581af52-ceeb-4e7f-aa17-780c5a994e5e up at agent ovs-agent-dv-cinder-789564-2-iscsi {{(pid=99028) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 17:42:27.130694 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-30ba8546-17e0-4e14-90a3-ab9c7e1764d0 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:27.145003 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-2b87807e-cf35-4a87-ba05-003eda785159 admin admin] Notify callbacks [] for router, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:27.146393 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-2b87807e-cf35-4a87-ba05-003eda785159 admin admin] 10.222.0.122 "POST /v2.0/routers HTTP/1.1" status: 201  len: 930 time: 6.1233389
May 25 17:42:27.147030 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.125', 55486) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:42:27.242948 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 40166) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:42:27.273424 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Provisioning complete for port c581af52-ceeb-4e7f-aa17-780c5a994e5e triggered by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 17:42:27.273972 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:27.280803 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-be78354d-8a7a-498a-bef5-5a4295457f00 admin admin] Notify agent at l3_agent.dv-cinder-789564-2-iscsi the message routers_updated {{(pid=99027) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 25 17:42:27.330036 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-30ba8546-17e0-4e14-90a3-ab9c7e1764d0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:27.338360 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-895a4e5d-1dee-4eaa-9901-7959a4c515d6 admin admin] Unset dirty status for tenant:537bb945cac6475e8b1205f34ad1e207 on resource:security_group {{(pid=99027) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 17:42:27.356216 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-895a4e5d-1dee-4eaa-9901-7959a4c515d6 admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=3a33e72158834b0da1b828453ce52591&name=default HTTP/1.1" status: 200  len: 2975 time: 1.6210365
May 25 17:42:27.379156 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 40176) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:42:27.383803 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9b65c929-8120-47be-bd66-c087f0799a54 None None] Sync routers for ids ['d71e624d-d858-442b-b878-577be49edd03'] in dv-cinder-789564-2-iscsi {{(pid=99028) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 25 17:42:27.400468 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:27.435786 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_dvr_db [None req-fe4a6105-f6ae-4e06-894f-a05fd9ed4d4f None None] Set router df4629e6-3b17-47f3-88e4-022b915a6a91 gateway port host: dv-cinder-789564-2-iscsi {{(pid=99029) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 17:42:27.440954 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9b65c929-8120-47be-bd66-c087f0799a54 None None] Routers {'d71e624d-d858-442b-b878-577be49edd03'} bound to L3 agent in host dv-cinder-789564-2-iscsi {{(pid=99028) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 17:42:27.445334 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-9b65c929-8120-47be-bd66-c087f0799a54 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcae71a7f70>, 'dv-cinder-789564-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-25T17:34:21Z,description=<?>,heartbeat_timestamp=2021-05-25T17:42:21Z,host='dv-cinder-789564-2-iscsi',id=eaeb6875-c4ed-43b6-8658-aa4e52324fdf,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T17:34:21Z,topic='l3_agent')) {'router_ids': ['d71e624d-d858-442b-b878-577be49edd03'], 'active': True} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:42:27.474521 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30ba8546-17e0-4e14-90a3-ab9c7e1764d0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1aefa01f-ff9b-4ff3-9ead-097ff813dbde,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:27.487578 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-30ba8546-17e0-4e14-90a3-ab9c7e1764d0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:27.621764 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-30ba8546-17e0-4e14-90a3-ab9c7e1764d0 admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=339c757c9d6140fab85827cf738adfb5&name=default HTTP/1.1" status: 200  len: 2978 time: 1.5757215
May 25 17:42:27.626942 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 40186) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:42:27.702233 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-dfbad891-e0b2-41f0-964b-21548010ee3f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:27.707413 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-be78354d-8a7a-498a-bef5-5a4295457f00 admin admin] Notify callbacks [] for router, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:27.711367 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-be78354d-8a7a-498a-bef5-5a4295457f00 admin admin] 10.222.0.122 "POST /v2.0/routers HTTP/1.1" status: 201  len: 923 time: 5.6587832
May 25 17:42:27.717294 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 40194) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:42:27.796956 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-7d332228-3a81-4e32-8835-c5cf780f995e req-449ac06e-aa78-4956-a06a-d3b9f5d99bc3 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/ports?device_id=3fb3211e-48f5-46f5-8035-ddbc35109aa8 HTTP/1.1" status: 200  len: 210 time: 0.0853603
May 25 17:42:27.851743 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvr_db [None req-9b65c929-8120-47be-bd66-c087f0799a54 None None] Set router d71e624d-d858-442b-b878-577be49edd03 gateway port host: dv-cinder-789564-2-iscsi {{(pid=99028) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 17:42:27.873321 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-de083a85-6c8d-42e7-b421-516eb2ff5663 req-fb1dbd4c-8bbb-446f-bd99-9920ae2eb09b tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] 10.222.0.122 "GET /v2.0/ports?device_id=cab9bd8d-5b7a-4fc2-85cd-9d4f9884b4ee HTTP/1.1" status: 200  len: 210 time: 0.1985037
May 25 17:42:27.972607 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-dfbad891-e0b2-41f0-964b-21548010ee3f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:28.004024 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1255886-2c4e-4d60-b056-4e6d8e856d9f req-532e85a0-e57f-46dd-a009-6b459d724b8e tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:42:28.004824 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [req-c1255886-2c4e-4d60-b056-4e6d8e856d9f req-532e85a0-e57f-46dd-a009-6b459d724b8e tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] Synchronizing usage tracker for tenant:fb338a290a2242fea3a4b8ae2bc4a14c on resource:network {{(pid=99026) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 17:42:28.094920 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_hamode_db [None req-fe4a6105-f6ae-4e06-894f-a05fd9ed4d4f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcae7ca2e20>, [{'id': 'df4629e6-3b17-47f3-88e4-022b915a6a91', 'name': 'tempest-ServerRescueNegativeTestJSON-301463405-router', 'tenant_id': '5b2f6ca8c5b94c2f8894c04f297b5f8b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.206'}], 'enable_snat': True}, 'gw_port_id': 'ba3fdf48-5b50-4a04-9bed-01d9f2c8cf44', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:42:21Z', 'updated_at': '2021-05-25T17:42:24Z', 'revision_number': 3, 'project_id': '5b2f6ca8c5b94c2f8894c04f297b5f8b', 'gw_port': {'id': 'ba3fdf48-5b50-4a04-9bed-01d9f2c8cf44', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:8b:8e:8a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'df4629e6-3b17-47f3-88e4-022b915a6a91', 'device_owner': 'network:router_gateway', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.206', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:42:22Z', 'updated_at': '2021-05-25T17:42:23Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi'}], 'dv-cinder-789564-2-iscsi', False) {} {{(pid=99029) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:42:28.102530 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.125', 55490) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:42:28.135077 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fe4a6105-f6ae-4e06-894f-a05fd9ed4d4f None None] Checking router: df4629e6-3b17-47f3-88e4-022b915a6a91 for host: dv-cinder-789564-2-iscsi {{(pid=99029) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 25 17:42:28.135433 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fe4a6105-f6ae-4e06-894f-a05fd9ed4d4f None None] Updating router df4629e6-3b17-47f3-88e4-022b915a6a91 port ba3fdf48-5b50-4a04-9bed-01d9f2c8cf44 binding host dv-cinder-789564-2-iscsi {{(pid=99029) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 25 17:42:28.200569 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-6905bc89-ce83-4675-b350-0c8385a730af admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:28.270446 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-6905bc89-ce83-4675-b350-0c8385a730af admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:28.348984 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [req-c1255886-2c4e-4d60-b056-4e6d8e856d9f req-532e85a0-e57f-46dd-a009-6b459d724b8e tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] Unset dirty status for tenant:fb338a290a2242fea3a4b8ae2bc4a14c on resource:network {{(pid=99026) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 17:42:28.353420 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-c1255886-2c4e-4d60-b056-4e6d8e856d9f req-532e85a0-e57f-46dd-a009-6b459d724b8e tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] 10.222.0.125 "GET /v2.0/networks?id=58926b0f-c6c9-44b1-aa59-d580f9359c87 HTTP/1.1" status: 200  len: 812 time: 1.2022271
May 25 17:42:28.376453 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-9b65c929-8120-47be-bd66-c087f0799a54 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcae71a7f70>, [{'id': 'd71e624d-d858-442b-b878-577be49edd03', 'name': 'tempest-AttachVolumeTestJSON-1986395052-router', 'tenant_id': 'b4cdc54b260f4e79b87fdf4a43b12e16', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.176'}], 'enable_snat': True}, 'gw_port_id': '9635c7b0-eb08-41ee-980e-3da56221f88d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:42:22Z', 'updated_at': '2021-05-25T17:42:25Z', 'revision_number': 3, 'project_id': 'b4cdc54b260f4e79b87fdf4a43b12e16', 'gw_port': {'id': '9635c7b0-eb08-41ee-980e-3da56221f88d', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:44:59', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd71e624d-d858-442b-b878-577be49edd03', 'device_owner': 'network:router_gateway', 'standard_attr_id': 80, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.176', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:42:23Z', 'updated_at': '2021-05-25T17:42:24Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi'}], 'dv-cinder-789564-2-iscsi', False) {} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:42:28.387769 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9b65c929-8120-47be-bd66-c087f0799a54 None None] Checking router: d71e624d-d858-442b-b878-577be49edd03 for host: dv-cinder-789564-2-iscsi {{(pid=99028) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 25 17:42:28.389109 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9b65c929-8120-47be-bd66-c087f0799a54 None None] Updating router d71e624d-d858-442b-b878-577be49edd03 port 9635c7b0-eb08-41ee-980e-3da56221f88d binding host dv-cinder-789564-2-iscsi {{(pid=99028) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 25 17:42:28.403739 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.v2.base [req-c1255886-2c4e-4d60-b056-4e6d8e856d9f req-3db83087-54b2-4cc5-a6a7-27a3a5dc87a9 tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] Request body: {'port': {'device_id': 'cab9bd8d-5b7a-4fc2-85cd-9d4f9884b4ee', 'network_id': '58926b0f-c6c9-44b1-aa59-d580f9359c87', 'admin_state_up': True, 'tenant_id': 'fb338a290a2242fea3a4b8ae2bc4a14c'}} {{(pid=99026) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:42:28.428050 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron_lib.callbacks.manager [None req-fe4a6105-f6ae-4e06-894f-a05fd9ed4d4f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99029) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:28.531600 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-9b65c929-8120-47be-bd66-c087f0799a54 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:28.654161 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-dfbad891-e0b2-41f0-964b-21548010ee3f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:28.701697 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:28.737545 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dfbad891-e0b2-41f0-964b-21548010ee3f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d9ce5b00-475d-4481-9535-a142e508045b,revision_number=None']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:28.740298 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-dfbad891-e0b2-41f0-964b-21548010ee3f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.039s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:28.755309 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [req-c1255886-2c4e-4d60-b056-4e6d8e856d9f req-3db83087-54b2-4cc5-a6a7-27a3a5dc87a9 tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:42:28.773046 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6e0a943-86f9-41f6-bd28-c558d49f9891 req-5bd76974-366e-4c4c-8fa0-c24f2734b564 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:42:28.774009 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-c6e0a943-86f9-41f6-bd28-c558d49f9891 req-5bd76974-366e-4c4c-8fa0-c24f2734b564 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Synchronizing usage tracker for tenant:5ae575cfd07c4a88aa626c15e6bccfd9 on resource:network {{(pid=99027) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 17:42:28.823170 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [req-c1255886-2c4e-4d60-b056-4e6d8e856d9f req-3db83087-54b2-4cc5-a6a7-27a3a5dc87a9 tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] Usage tracker for resource:port and tenant:fb338a290a2242fea3a4b8ae2bc4a14c is out of sync, need to count used quota {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:42:28.827559 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [req-c1255886-2c4e-4d60-b056-4e6d8e856d9f req-3db83087-54b2-4cc5-a6a7-27a3a5dc87a9 tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] Quota usage for port was recalculated. Used quota:0. {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:42:28.834802 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [req-c1255886-2c4e-4d60-b056-4e6d8e856d9f req-3db83087-54b2-4cc5-a6a7-27a3a5dc87a9 tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:42:28.847468 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-6905bc89-ce83-4675-b350-0c8385a730af admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:28.861895 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:28.885042 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6905bc89-ce83-4675-b350-0c8385a730af admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1aefa01f-ff9b-4ff3-9ead-097ff813dbde,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:28.900828 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-6905bc89-ce83-4675-b350-0c8385a730af admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.039s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:28.907359 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-dfbad891-e0b2-41f0-964b-21548010ee3f admin admin] Notify callbacks [] for security_group, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:28.908922 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-dfbad891-e0b2-41f0-964b-21548010ee3f admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/d9ce5b00-475d-4481-9535-a142e508045b HTTP/1.1" status: 204  len: 168 time: 1.4499936
May 25 17:42:28.913040 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-6905bc89-ce83-4675-b350-0c8385a730af admin admin] Notify callbacks [] for security_group, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:28.914550 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-6905bc89-ce83-4675-b350-0c8385a730af admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/1aefa01f-ff9b-4ff3-9ead-097ff813dbde HTTP/1.1" status: 204  len: 168 time: 1.2777951
May 25 17:42:28.974000 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-a85be3f4-de6f-4da0-80ce-eb213c6f8b3a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114466', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411'] for subnet, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:28.985679 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-0ce6b685-ba4d-432d-819d-068e17ad6649 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:29.051408 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-c1255886-2c4e-4d60-b056-4e6d8e856d9f req-3db83087-54b2-4cc5-a6a7-27a3a5dc87a9 tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] Made reservation on behalf of fb338a290a2242fea3a4b8ae2bc4a14c for: {'port': 1} {{(pid=99026) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 17:42:29.061656 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [req-c1255886-2c4e-4d60-b056-4e6d8e856d9f req-3db83087-54b2-4cc5-a6a7-27a3a5dc87a9 tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:29.137469 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron_lib.callbacks.manager [None req-fe4a6105-f6ae-4e06-894f-a05fd9ed4d4f None None] Notify callbacks [] for port, precommit_update {{(pid=99029) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:29.153382 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.provisioning_blocks [None req-fe4a6105-f6ae-4e06-894f-a05fd9ed4d4f None None] Transition to ACTIVE for port object ba3fdf48-5b50-4a04-9bed-01d9f2c8cf44 will not be triggered until provisioned by entity L2. {{(pid=99029) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 17:42:29.153593 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-c6e0a943-86f9-41f6-bd28-c558d49f9891 req-5bd76974-366e-4c4c-8fa0-c24f2734b564 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Unset dirty status for tenant:5ae575cfd07c4a88aa626c15e6bccfd9 on resource:network {{(pid=99027) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 17:42:29.154638 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-c6e0a943-86f9-41f6-bd28-c558d49f9891 req-5bd76974-366e-4c4c-8fa0-c24f2734b564 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.125 "GET /v2.0/networks?id=6c7eca3b-72f3-4ba8-9e95-614d64496512 HTTP/1.1" status: 200  len: 814 time: 1.0346212
May 25 17:42:29.173328 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-e5a3467d-e5fa-499c-ad31-7fa6ed52e1fc req-b66bfd16-1af2-4fc7-acb1-2f55cb8682b7 tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] 10.222.0.122 "GET /v2.0/ports?device_id=cab9bd8d-5b7a-4fc2-85cd-9d4f9884b4ee HTTP/1.1" status: 200  len: 210 time: 0.0744905
May 25 17:42:29.184315 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-5b133f54-ec94-43b4-8888-6d64ec44d0f0 req-4c83353e-fa2d-41c6-968d-9daacdcd6811 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/ports?device_id=3fb3211e-48f5-46f5-8035-ddbc35109aa8 HTTP/1.1" status: 200  len: 210 time: 0.1048253
May 25 17:42:29.196032 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.v2.base [req-c6e0a943-86f9-41f6-bd28-c558d49f9891 req-0dde2041-b4fe-432c-a00d-c074f6a8bdda tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Request body: {'port': {'device_id': '3fb3211e-48f5-46f5-8035-ddbc35109aa8', 'network_id': '6c7eca3b-72f3-4ba8-9e95-614d64496512', 'admin_state_up': True, 'tenant_id': '5ae575cfd07c4a88aa626c15e6bccfd9'}} {{(pid=99027) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:42:29.281265 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron_lib.callbacks.manager [None req-fe4a6105-f6ae-4e06-894f-a05fd9ed4d4f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99029) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:29.287998 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:29.330944 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-20656e40-86f4-4c3e-85c5-439b64c63cce admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:29.334041 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a85be3f4-de6f-4da0-80ce-eb213c6f8b3a admin admin] Pushing event updated for resources: {'Subnet': ['ID=f99fd53f-fad7-4980-b038-552d0ca98305,revision_number=0']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:29.363714 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-a85be3f4-de6f-4da0-80ce-eb213c6f8b3a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.378s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:29.412661 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91f8f6a8-9701-4a28-8be1-d06c4f5748ca None None] Pushing event updated for resources: {'Port': ['ID=ba3fdf48-5b50-4a04-9bed-01d9f2c8cf44,revision_number=2']} {{(pid=99029) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:29.424638 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91f8f6a8-9701-4a28-8be1-d06c4f5748ca None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99029) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:42:29.424945 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91f8f6a8-9701-4a28-8be1-d06c4f5748ca None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99029) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:42:29.425267 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91f8f6a8-9701-4a28-8be1-d06c4f5748ca None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99029) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:42:29.425599 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91f8f6a8-9701-4a28-8be1-d06c4f5748ca None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99029) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:42:29.425918 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91f8f6a8-9701-4a28-8be1-d06c4f5748ca None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99029) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:42:29.426236 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91f8f6a8-9701-4a28-8be1-d06c4f5748ca None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99029) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:42:29.426552 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91f8f6a8-9701-4a28-8be1-d06c4f5748ca None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99029) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:42:29.426915 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91f8f6a8-9701-4a28-8be1-d06c4f5748ca None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99029) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:42:29.427256 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91f8f6a8-9701-4a28-8be1-d06c4f5748ca None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99029) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:42:29.427629 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91f8f6a8-9701-4a28-8be1-d06c4f5748ca None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99029) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:42:29.427946 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91f8f6a8-9701-4a28-8be1-d06c4f5748ca None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99029) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:42:29.428258 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91f8f6a8-9701-4a28-8be1-d06c4f5748ca None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99029) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:42:29.429977 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91f8f6a8-9701-4a28-8be1-d06c4f5748ca None None] Tracked resource versions report:
May 25 17:42:29.429977 dv-cinder-789564-2-iscsi neutron-server[99029]: pushed versions:
May 25 17:42:29.429977 dv-cinder-789564-2-iscsi neutron-server[99029]: {   'AddressGroup': {'1.2'},
May 25 17:42:29.429977 dv-cinder-789564-2-iscsi neutron-server[99029]:     'ConntrackHelper': {'1.0'},
May 25 17:42:29.429977 dv-cinder-789564-2-iscsi neutron-server[99029]:     'Log': {'1.0'},
May 25 17:42:29.429977 dv-cinder-789564-2-iscsi neutron-server[99029]:     'Network': {'1.1'},
May 25 17:42:29.429977 dv-cinder-789564-2-iscsi neutron-server[99029]:     'Port': {'1.7'},
May 25 17:42:29.429977 dv-cinder-789564-2-iscsi neutron-server[99029]:     'PortForwarding': {'1.2'},
May 25 17:42:29.429977 dv-cinder-789564-2-iscsi neutron-server[99029]:     'QosPolicy': {'1.8'},
May 25 17:42:29.429977 dv-cinder-789564-2-iscsi neutron-server[99029]:     'SecurityGroup': {'1.4'},
May 25 17:42:29.429977 dv-cinder-789564-2-iscsi neutron-server[99029]:     'SecurityGroupRule': {'1.2'},
May 25 17:42:29.429977 dv-cinder-789564-2-iscsi neutron-server[99029]:     'SubPort': {'1.0'},
May 25 17:42:29.429977 dv-cinder-789564-2-iscsi neutron-server[99029]:     'Subnet': {'1.1'},
May 25 17:42:29.429977 dv-cinder-789564-2-iscsi neutron-server[99029]:     'Trunk': {'1.1'}}
May 25 17:42:29.429977 dv-cinder-789564-2-iscsi neutron-server[99029]: consumer versions:
May 25 17:42:29.429977 dv-cinder-789564-2-iscsi neutron-server[99029]: {   DHCP agent@dv-cinder-789564-2-iscsi: {},
May 25 17:42:29.429977 dv-cinder-789564-2-iscsi neutron-server[99029]:     HyperV agent@hv-cinder-78956: {},
May 25 17:42:29.429977 dv-cinder-789564-2-iscsi neutron-server[99029]:     L3 agent@dv-cinder-789564-2-iscsi: {},
May 25 17:42:29.429977 dv-cinder-789564-2-iscsi neutron-server[99029]:     Metadata agent@dv-cinder-789564-2-iscsi: {},
May 25 17:42:29.429977 dv-cinder-789564-2-iscsi neutron-server[99029]:     Metering agent@dv-cinder-789564-2-iscsi: {},
May 25 17:42:29.429977 dv-cinder-789564-2-iscsi neutron-server[99029]:     Open vSwitch agent@dv-cinder-789564-2-iscsi: {   'AddressGroup': '1.2',
May 25 17:42:29.429977 dv-cinder-789564-2-iscsi neutron-server[99029]:                                                      'ConntrackHelper': '1.0',
May 25 17:42:29.429977 dv-cinder-789564-2-iscsi neutron-server[99029]:                                                      'Log': '1.0',
May 25 17:42:29.429977 dv-cinder-789564-2-iscsi neutron-server[99029]:                                                      'Network': '1.1',
May 25 17:42:29.429977 dv-cinder-789564-2-iscsi neutron-server[99029]:                                                      'Port': '1.7',
May 25 17:42:29.429977 dv-cinder-789564-2-iscsi neutron-server[99029]:                                                      'PortForwarding': '1.2',
May 25 17:42:29.429977 dv-cinder-789564-2-iscsi neutron-server[99029]:                                                      'QosPolicy': '1.8',
May 25 17:42:29.429977 dv-cinder-789564-2-iscsi neutron-server[99029]:                                                      'SecurityGroup': '1.4',
May 25 17:42:29.429977 dv-cinder-789564-2-iscsi neutron-server[99029]:                                                      'SecurityGroupRule': '1.2',
May 25 17:42:29.429977 dv-cinder-789564-2-iscsi neutron-server[99029]:                                                      'SubPort': '1.0',
May 25 17:42:29.429977 dv-cinder-789564-2-iscsi neutron-server[99029]:                                                      'Subnet': '1.1',
May 25 17:42:29.429977 dv-cinder-789564-2-iscsi neutron-server[99029]:                                                      'Trunk': '1.1'}}
May 25 17:42:29.429977 dv-cinder-789564-2-iscsi neutron-server[99029]:  {{(pid=99029) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
May 25 17:42:29.446659 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG oslo_concurrency.lockutils [None req-91f8f6a8-9701-4a28-8be1-d06c4f5748ca None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.158s {{(pid=99029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:29.509955 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.db_base_plugin_common [req-c1255886-2c4e-4d60-b056-4e6d8e856d9f req-3db83087-54b2-4cc5-a6a7-27a3a5dc87a9 tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] Allocated IP 172.20.0.11 (58926b0f-c6c9-44b1-aa59-d580f9359c87/d821d422-628c-4d27-a03e-94485f09826d/4d583d58-a3d8-4d10-883a-5959fa74e40c) {{(pid=99026) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 17:42:29.516564 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.plugins.ml2.managers [None req-fe4a6105-f6ae-4e06-894f-a05fd9ed4d4f None None] Attempting to bind port ba3fdf48-5b50-4a04-9bed-01d9f2c8cf44 on host dv-cinder-789564-2-iscsi for vnic_type normal with profile  {{(pid=99029) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 17:42:29.517105 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.plugins.ml2.managers [None req-fe4a6105-f6ae-4e06-894f-a05fd9ed4d4f None None] Attempting to bind port ba3fdf48-5b50-4a04-9bed-01d9f2c8cf44 by drivers openvswitch,hyperv on host dv-cinder-789564-2-iscsi at level 0 using segments [{'id': '471771f9-c462-4865-800d-0d5029e9eb3e', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb'}] {{(pid=99029) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 17:42:29.519064 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fe4a6105-f6ae-4e06-894f-a05fd9ed4d4f None None] Attempting to bind port ba3fdf48-5b50-4a04-9bed-01d9f2c8cf44 on network eb7ec72b-a691-481b-8d7e-42c05e13a8cb {{(pid=99029) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 17:42:29.530795 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fe4a6105-f6ae-4e06-894f-a05fd9ed4d4f None None] Checking agent: {'id': '7bb67520-1e97-4ad9-9b97-101068bbe1a3', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-789564-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 17, 34, 21), 'started_at': datetime.datetime(2021, 5, 25, 17, 34, 51), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 17, 42, 21), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-789564-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=99029) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 17:42:29.534473 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fe4a6105-f6ae-4e06-894f-a05fd9ed4d4f None None] Checking segment: {'id': '471771f9-c462-4865-800d-0d5029e9eb3e', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=99029) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 17:42:29.534920 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron_lib.callbacks.manager [None req-fe4a6105-f6ae-4e06-894f-a05fd9ed4d4f None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=99029) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:29.539460 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fe4a6105-f6ae-4e06-894f-a05fd9ed4d4f None None] Bound using segment: {'id': '471771f9-c462-4865-800d-0d5029e9eb3e', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb'} {{(pid=99029) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 17:42:29.539460 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.plugins.ml2.managers [None req-fe4a6105-f6ae-4e06-894f-a05fd9ed4d4f None None] Bound port: ba3fdf48-5b50-4a04-9bed-01d9f2c8cf44, host: dv-cinder-789564-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '471771f9-c462-4865-800d-0d5029e9eb3e', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb'}}] {{(pid=99029) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 17:42:29.539460 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron_lib.callbacks.manager [None req-fe4a6105-f6ae-4e06-894f-a05fd9ed4d4f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99029) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:29.545646 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a85be3f4-de6f-4da0-80ce-eb213c6f8b3a admin admin] Checking segment: {'id': '486f26bb-e6e6-4d42-9c99-59085f6a249d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1323, 'network_id': 'ddc17283-66fe-4b17-b7ec-43aea38f7496'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=99027) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 17:42:29.546128 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a85be3f4-de6f-4da0-80ce-eb213c6f8b3a admin admin] Network hostable DHCP agents. Network: ddc17283-66fe-4b17-b7ec-43aea38f7496, hostable agents: ['c8b0a350-254b-4562-874b-120ecdef0e25'], hosted agents: [] {{(pid=99027) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 25 17:42:29.661036 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.plugins.ml2.db [None req-fe4a6105-f6ae-4e06-894f-a05fd9ed4d4f None None] For port ba3fdf48-5b50-4a04-9bed-01d9f2c8cf44, host dv-cinder-789564-2-iscsi, cleared binding levels {{(pid=99029) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 17:42:29.665404 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.plugins.ml2.db [None req-fe4a6105-f6ae-4e06-894f-a05fd9ed4d4f None None] For port ba3fdf48-5b50-4a04-9bed-01d9f2c8cf44, host dv-cinder-789564-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=ba3fdf48-5b50-4a04-9bed-01d9f2c8cf44,segment=NetworkSegment(471771f9-c462-4865-800d-0d5029e9eb3e),segment_id=471771f9-c462-4865-800d-0d5029e9eb3e)] {{(pid=99029) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 17:42:29.694782 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-9b65c929-8120-47be-bd66-c087f0799a54 None None] Notify callbacks [] for port, precommit_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:29.702211 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [req-c6e0a943-86f9-41f6-bd28-c558d49f9891 req-0dde2041-b4fe-432c-a00d-c074f6a8bdda tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:42:29.704340 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a85be3f4-de6f-4da0-80ce-eb213c6f8b3a admin admin] Network ddc17283-66fe-4b17-b7ec-43aea38f7496 is scheduled to be hosted by DHCP agent c8b0a350-254b-4562-874b-120ecdef0e25 with binding_index 1 {{(pid=99027) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 25 17:42:29.715958 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-9b65c929-8120-47be-bd66-c087f0799a54 None None] Transition to ACTIVE for port object 9635c7b0-eb08-41ee-980e-3da56221f88d will not be triggered until provisioned by entity L2. {{(pid=99028) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 17:42:29.732443 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron_lib.callbacks.manager [None req-fe4a6105-f6ae-4e06-894f-a05fd9ed4d4f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99029) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:29.738810 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG oslo_concurrency.lockutils [None req-91f8f6a8-9701-4a28-8be1-d06c4f5748ca None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:29.742207 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-c6e0a943-86f9-41f6-bd28-c558d49f9891 req-0dde2041-b4fe-432c-a00d-c074f6a8bdda tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Usage tracker for resource:port and tenant:5ae575cfd07c4a88aa626c15e6bccfd9 is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:42:29.750402 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-c6e0a943-86f9-41f6-bd28-c558d49f9891 req-0dde2041-b4fe-432c-a00d-c074f6a8bdda tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Quota usage for port was recalculated. Used quota:0. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:42:29.768598 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [req-c6e0a943-86f9-41f6-bd28-c558d49f9891 req-0dde2041-b4fe-432c-a00d-c074f6a8bdda tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:42:29.776102 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-55b80181-8e60-4e61-ab9c-da578f53923f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:29.816515 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.db_base_plugin_common [None req-20656e40-86f4-4c3e-85c5-439b64c63cce admin admin] Allocated IP 172.20.0.1 (2abe381d-082b-4294-8193-c6556a56adb4/e7ef8006-ae0e-4a18-b5c7-707d13fb7031/f7fc9e77-51db-43c8-9f03-ac0ca1040af2) {{(pid=99026) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 17:42:29.817244 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-9b65c929-8120-47be-bd66-c087f0799a54 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:29.824989 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:29.873413 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fe4a6105-f6ae-4e06-894f-a05fd9ed4d4f None None] Routers {'df4629e6-3b17-47f3-88e4-022b915a6a91'} bound to L3 agent in host dv-cinder-789564-2-iscsi {{(pid=99029) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 17:42:29.874045 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_hamode_db [None req-fe4a6105-f6ae-4e06-894f-a05fd9ed4d4f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcae7ca2e20>, 'dv-cinder-789564-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-25T17:34:21Z,description=<?>,heartbeat_timestamp=2021-05-25T17:42:21Z,host='dv-cinder-789564-2-iscsi',id=eaeb6875-c4ed-43b6-8658-aa4e52324fdf,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T17:34:21Z,topic='l3_agent')) {'router_ids': ['df4629e6-3b17-47f3-88e4-022b915a6a91'], 'active': True} {{(pid=99029) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:42:29.925241 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.base_scheduler [None req-a85be3f4-de6f-4da0-80ce-eb213c6f8b3a admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-789564-2-iscsi, ddc17283-66fe-4b17-b7ec-43aea38f7496) {{(pid=99027) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 17:42:29.925530 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91f8f6a8-9701-4a28-8be1-d06c4f5748ca None None] Pushing event updated for resources: {'Port': ['ID=ba3fdf48-5b50-4a04-9bed-01d9f2c8cf44,revision_number=3']} {{(pid=99029) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:29.934597 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a85be3f4-de6f-4da0-80ce-eb213c6f8b3a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:42:29.942032 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-a85be3f4-de6f-4da0-80ce-eb213c6f8b3a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for subnet, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:29.943291 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG oslo_concurrency.lockutils [None req-91f8f6a8-9701-4a28-8be1-d06c4f5748ca None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.198s {{(pid=99029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:29.981811 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-c6e0a943-86f9-41f6-bd28-c558d49f9891 req-0dde2041-b4fe-432c-a00d-c074f6a8bdda tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Made reservation on behalf of 5ae575cfd07c4a88aa626c15e6bccfd9 for: {'port': 1} {{(pid=99027) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 17:42:29.987767 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-c6e0a943-86f9-41f6-bd28-c558d49f9891 req-0dde2041-b4fe-432c-a00d-c074f6a8bdda tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:30.090044 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [req-c1255886-2c4e-4d60-b056-4e6d8e856d9f req-3db83087-54b2-4cc5-a6a7-27a3a5dc87a9 tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] Notify callbacks [] for port, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:30.134416 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-a85be3f4-de6f-4da0-80ce-eb213c6f8b3a admin admin] 10.222.0.122 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 861 time: 3.8701172
May 25 17:42:30.218637 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6d42c249-23c6-48dd-9ba5-daa10a656a27 None None] Network ddc17283-66fe-4b17-b7ec-43aea38f7496 requested from dv-cinder-789564-2-iscsi {{(pid=99028) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 17:42:30.290288 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_dvr_db [None req-fe4a6105-f6ae-4e06-894f-a05fd9ed4d4f None None] Set router df4629e6-3b17-47f3-88e4-022b915a6a91 gateway port host: dv-cinder-789564-2-iscsi {{(pid=99029) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 17:42:30.343190 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-20656e40-86f4-4c3e-85c5-439b64c63cce admin admin] Notify callbacks [] for port, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:30.396912 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [req-c1255886-2c4e-4d60-b056-4e6d8e856d9f req-3db83087-54b2-4cc5-a6a7-27a3a5dc87a9 tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781840788179'] for port, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:30.411807 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:30.518972 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 40276) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:42:30.702372 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-c1255886-2c4e-4d60-b056-4e6d8e856d9f req-3db83087-54b2-4cc5-a6a7-27a3a5dc87a9 tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] Network 58926b0f-c6c9-44b1-aa59-d580f9359c87 is already hosted by enough agents. {{(pid=99026) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 17:42:30.707803 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.scheduler.base_scheduler [req-c1255886-2c4e-4d60-b056-4e6d8e856d9f req-3db83087-54b2-4cc5-a6a7-27a3a5dc87a9 tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] Resources bound (agent type, host, resource id):  {{(pid=99026) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 17:42:30.725204 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.l3_dvrscheduler_db [req-c1255886-2c4e-4d60-b056-4e6d8e856d9f req-3db83087-54b2-4cc5-a6a7-27a3a5dc87a9 tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] Received port after_create {{(pid=99026) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 17:42:30.735075 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1255886-2c4e-4d60-b056-4e6d8e856d9f req-3db83087-54b2-4cc5-a6a7-27a3a5dc87a9 tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:42:30.736170 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [req-c1255886-2c4e-4d60-b056-4e6d8e856d9f req-3db83087-54b2-4cc5-a6a7-27a3a5dc87a9 tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-239387', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for port, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:30.751507 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-20656e40-86f4-4c3e-85c5-439b64c63cce admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781840788179'] for port, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:30.756448 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.managers [None req-9b65c929-8120-47be-bd66-c087f0799a54 None None] Attempting to bind port 9635c7b0-eb08-41ee-980e-3da56221f88d on host dv-cinder-789564-2-iscsi for vnic_type normal with profile  {{(pid=99028) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 17:42:30.757374 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.managers [None req-9b65c929-8120-47be-bd66-c087f0799a54 None None] Attempting to bind port 9635c7b0-eb08-41ee-980e-3da56221f88d by drivers openvswitch,hyperv on host dv-cinder-789564-2-iscsi at level 0 using segments [{'id': '471771f9-c462-4865-800d-0d5029e9eb3e', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb'}] {{(pid=99028) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 17:42:30.757920 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9b65c929-8120-47be-bd66-c087f0799a54 None None] Attempting to bind port 9635c7b0-eb08-41ee-980e-3da56221f88d on network eb7ec72b-a691-481b-8d7e-42c05e13a8cb {{(pid=99028) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 17:42:30.762699 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3db83087-54b2-4cc5-a6a7-27a3a5dc87a9 tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] Pushing event updated for resources: {'Port': ['ID=4d583d58-a3d8-4d10-883a-5959fa74e40c,revision_number=1']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:30.775298 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f51fe2b-b9ae-49f6-9a08-7db018f3258b None None] Pushing event updated for resources: {'Port': ['ID=9635c7b0-eb08-41ee-980e-3da56221f88d,revision_number=2']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:30.785790 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-3db83087-54b2-4cc5-a6a7-27a3a5dc87a9 tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.374s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:30.786566 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-3db83087-54b2-4cc5-a6a7-27a3a5dc87a9 tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:30.824222 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-2f51fe2b-b9ae-49f6-9a08-7db018f3258b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.999s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:30.828095 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 40282) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:42:30.832026 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.db_base_plugin_common [req-c6e0a943-86f9-41f6-bd28-c558d49f9891 req-0dde2041-b4fe-432c-a00d-c074f6a8bdda tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Allocated IP 172.20.0.14 (6c7eca3b-72f3-4ba8-9e95-614d64496512/279772c8-d366-4fc6-9c34-e6ddf99b5e08/4698ed19-7e41-4457-a1fd-16d5f606084a) {{(pid=99027) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 17:42:30.832597 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9b65c929-8120-47be-bd66-c087f0799a54 None None] Checking agent: {'id': '7bb67520-1e97-4ad9-9b97-101068bbe1a3', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-789564-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 17, 34, 21), 'started_at': datetime.datetime(2021, 5, 25, 17, 34, 51), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 17, 42, 21), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-789564-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=99028) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 17:42:30.832869 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9b65c929-8120-47be-bd66-c087f0799a54 None None] Checking segment: {'id': '471771f9-c462-4865-800d-0d5029e9eb3e', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=99028) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 17:42:30.833435 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-9b65c929-8120-47be-bd66-c087f0799a54 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:30.833862 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9b65c929-8120-47be-bd66-c087f0799a54 None None] Bound using segment: {'id': '471771f9-c462-4865-800d-0d5029e9eb3e', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb'} {{(pid=99028) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 17:42:30.838163 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.managers [None req-9b65c929-8120-47be-bd66-c087f0799a54 None None] Bound port: 9635c7b0-eb08-41ee-980e-3da56221f88d, host: dv-cinder-789564-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '471771f9-c462-4865-800d-0d5029e9eb3e', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb'}}] {{(pid=99028) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 17:42:30.839498 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-9b65c929-8120-47be-bd66-c087f0799a54 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:30.989744 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-20656e40-86f4-4c3e-85c5-439b64c63cce admin admin] Network 2abe381d-082b-4294-8193-c6556a56adb4 is already hosted by enough agents. {{(pid=99026) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 17:42:31.009742 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.scheduler.base_scheduler [None req-20656e40-86f4-4c3e-85c5-439b64c63cce admin admin] Resources bound (agent type, host, resource id):  {{(pid=99026) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 17:42:31.015820 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.l3_dvrscheduler_db [None req-20656e40-86f4-4c3e-85c5-439b64c63cce admin admin] Received port after_create {{(pid=99026) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 17:42:31.015820 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-20656e40-86f4-4c3e-85c5-439b64c63cce admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-421008'] for router_interface, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:31.026318 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-f9633d10-b414-4aa5-b9fe-0b1f0347b54c req-46fd9ab5-e278-4a1a-b20f-4f46b3c64e7f tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/ports?device_id=3fb3211e-48f5-46f5-8035-ddbc35109aa8 HTTP/1.1" status: 200  len: 210 time: 0.5061426
May 25 17:42:31.060217 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20656e40-86f4-4c3e-85c5-439b64c63cce admin admin] Pushing event updated for resources: {'Port': ['ID=f7fc9e77-51db-43c8-9f03-ac0ca1040af2,revision_number=1']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:31.078450 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-20656e40-86f4-4c3e-85c5-439b64c63cce admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.290s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:31.087075 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-c1255886-2c4e-4d60-b056-4e6d8e856d9f req-3db83087-54b2-4cc5-a6a7-27a3a5dc87a9 tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] 10.222.0.125 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 2.6887116
May 25 17:42:31.111900 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.db_base_plugin_v2 [None req-b3224bc6-79fd-4b27-a845-dbd626c2ff4a admin admin] Deleting subnet ca4c4fe6-6443-482e-8132-d47a672f12e8 {{(pid=99026) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 25 17:42:31.114849 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-f4403198-4bc3-42de-9547-6cb2ce5ac477 admin admin] Notify callbacks [] for security_group, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:31.138279 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa871090-019c-4427-8fd5-9126ea43b147 req-d979392b-df44-44b0-ba3c-55069c8ef637 tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:42:31.139034 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [req-aa871090-019c-4427-8fd5-9126ea43b147 req-d979392b-df44-44b0-ba3c-55069c8ef637 tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] Synchronizing usage tracker for tenant:fb338a290a2242fea3a4b8ae2bc4a14c on resource:port {{(pid=99026) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 17:42:31.151851 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [req-c1255886-2c4e-4d60-b056-4e6d8e856d9f req-19875c52-b5c0-43b8-bf4e-3bae1e97fc30 tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] http://10.222.0.122:9696/v2.0/extensions returned with HTTP 200 {{(pid=99026) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 25 17:42:31.152861 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-c1255886-2c4e-4d60-b056-4e6d8e856d9f req-19875c52-b5c0-43b8-bf4e-3bae1e97fc30 tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] 10.222.0.125 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.0463998
May 25 17:42:31.162382 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0d6fdabe-f8dd-4d76-bcb5-824abf12d2c0 None None] Network ddc17283-66fe-4b17-b7ec-43aea38f7496 requested from dv-cinder-789564-2-iscsi {{(pid=99028) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 17:42:31.174093 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-b3224bc6-79fd-4b27-a845-dbd626c2ff4a admin admin] Notify callbacks [] for subnet, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:31.178404 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.db_base_plugin_common [None req-55b80181-8e60-4e61-ab9c-da578f53923f admin admin] Allocated IP 172.20.0.1 (defaef08-c0f9-4608-b66d-b97e06e185bf/5be08358-9d04-4ee9-91ac-104e66e66e20/d13f3233-9e09-41c7-8315-4eae735fe605) {{(pid=99027) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 17:42:31.237116 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-f4403198-4bc3-42de-9547-6cb2ce5ac477 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:42:31.264392 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-f4403198-4bc3-42de-9547-6cb2ce5ac477 admin admin] Usage tracker for resource:security_group_rule and tenant:e125b0d41d9f472d8ca31cc39504a2b3 is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:42:31.306806 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-b3224bc6-79fd-4b27-a845-dbd626c2ff4a admin admin] Notify callbacks [] for subnet, precommit_delete_associations {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:31.357517 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-b3224bc6-79fd-4b27-a845-dbd626c2ff4a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1474503'] for subnet, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:31.398841 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-f4403198-4bc3-42de-9547-6cb2ce5ac477 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:42:31.454609 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [req-aa871090-019c-4427-8fd5-9126ea43b147 req-d979392b-df44-44b0-ba3c-55069c8ef637 tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] Unset dirty status for tenant:fb338a290a2242fea3a4b8ae2bc4a14c on resource:port {{(pid=99026) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 17:42:31.456549 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-aa871090-019c-4427-8fd5-9126ea43b147 req-d979392b-df44-44b0-ba3c-55069c8ef637 tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] 10.222.0.122 "GET /v2.0/ports?device_id=cab9bd8d-5b7a-4fc2-85cd-9d4f9884b4ee HTTP/1.1" status: 200  len: 932 time: 0.8590069
May 25 17:42:31.546191 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_hamode_db [None req-fe4a6105-f6ae-4e06-894f-a05fd9ed4d4f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcae7ca2e20>, [{'id': 'df4629e6-3b17-47f3-88e4-022b915a6a91', 'name': 'tempest-ServerRescueNegativeTestJSON-301463405-router', 'tenant_id': '5b2f6ca8c5b94c2f8894c04f297b5f8b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.206'}], 'enable_snat': True}, 'gw_port_id': 'ba3fdf48-5b50-4a04-9bed-01d9f2c8cf44', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:42:21Z', 'updated_at': '2021-05-25T17:42:24Z', 'revision_number': 3, 'project_id': '5b2f6ca8c5b94c2f8894c04f297b5f8b', 'gw_port': {'id': 'ba3fdf48-5b50-4a04-9bed-01d9f2c8cf44', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:8b:8e:8a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'df4629e6-3b17-47f3-88e4-022b915a6a91', 'device_owner': 'network:router_gateway', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.206', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:42:22Z', 'updated_at': '2021-05-25T17:42:29Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi'}], 'dv-cinder-789564-2-iscsi', False) {} {{(pid=99029) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:42:31.555294 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fe4a6105-f6ae-4e06-894f-a05fd9ed4d4f None None] The sync data for ids ['df4629e6-3b17-47f3-88e4-022b915a6a91'] in dv-cinder-789564-2-iscsi is: [{'id': 'df4629e6-3b17-47f3-88e4-022b915a6a91', 'name': 'tempest-ServerRescueNegativeTestJSON-301463405-router', 'tenant_id': '5b2f6ca8c5b94c2f8894c04f297b5f8b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.206'}], 'enable_snat': True}, 'gw_port_id': 'ba3fdf48-5b50-4a04-9bed-01d9f2c8cf44', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:42:21Z', 'updated_at': '2021-05-25T17:42:24Z', 'revision_number': 3, 'project_id': '5b2f6ca8c5b94c2f8894c04f297b5f8b', 'gw_port': {'id': 'ba3fdf48-5b50-4a04-9bed-01d9f2c8cf44', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:8b:8e:8a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'df4629e6-3b17-47f3-88e4-022b915a6a91', 'device_owner': 'network:router_gateway', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.206', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:42:22Z', 'updated_at': '2021-05-25T17:42:29Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi'}] {{(pid=99029) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 25 17:42:31.587708 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-9b65c929-8120-47be-bd66-c087f0799a54 None None] For port 9635c7b0-eb08-41ee-980e-3da56221f88d, host dv-cinder-789564-2-iscsi, cleared binding levels {{(pid=99028) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 17:42:31.595227 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-9b65c929-8120-47be-bd66-c087f0799a54 None None] For port 9635c7b0-eb08-41ee-980e-3da56221f88d, host dv-cinder-789564-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=9635c7b0-eb08-41ee-980e-3da56221f88d,segment=NetworkSegment(471771f9-c462-4865-800d-0d5029e9eb3e),segment_id=471771f9-c462-4865-800d-0d5029e9eb3e)] {{(pid=99028) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 17:42:31.711387 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-9b65c929-8120-47be-bd66-c087f0799a54 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:31.773054 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.v2.base [req-c1255886-2c4e-4d60-b056-4e6d8e856d9f req-b611e140-088e-47fd-bbe8-b23e0caa8988 service neutron] Request body: {'port': {'device_id': 'cab9bd8d-5b7a-4fc2-85cd-9d4f9884b4ee', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78956'}} {{(pid=99026) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:42:31.806841 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:31.932966 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f51fe2b-b9ae-49f6-9a08-7db018f3258b None None] Pushing event updated for resources: {'Port': ['ID=9635c7b0-eb08-41ee-980e-3da56221f88d,revision_number=3']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:31.990835 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-2f51fe2b-b9ae-49f6-9a08-7db018f3258b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.184s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:32.015009 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9b65c929-8120-47be-bd66-c087f0799a54 None None] Routers {'d71e624d-d858-442b-b878-577be49edd03'} bound to L3 agent in host dv-cinder-789564-2-iscsi {{(pid=99028) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 17:42:32.015967 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-9b65c929-8120-47be-bd66-c087f0799a54 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcae71a7f70>, 'dv-cinder-789564-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-25T17:34:21Z,description=<?>,heartbeat_timestamp=2021-05-25T17:42:21Z,host='dv-cinder-789564-2-iscsi',id=eaeb6875-c4ed-43b6-8658-aa4e52324fdf,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T17:34:21Z,topic='l3_agent')) {'router_ids': ['d71e624d-d858-442b-b878-577be49edd03'], 'active': True} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:42:32.066122 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [req-aa871090-019c-4427-8fd5-9126ea43b147 req-5d817aa1-3581-4743-a616-efdac0f75e11 tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] Synchronizing usage tracker for tenant:fb338a290a2242fea3a4b8ae2bc4a14c on resource:security_group {{(pid=99026) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 17:42:32.183838 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-f4403198-4bc3-42de-9547-6cb2ce5ac477 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:42:32.421367 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-20656e40-86f4-4c3e-85c5-439b64c63cce admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:32.464315 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [req-aa871090-019c-4427-8fd5-9126ea43b147 req-5d817aa1-3581-4743-a616-efdac0f75e11 tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] Unset dirty status for tenant:fb338a290a2242fea3a4b8ae2bc4a14c on resource:security_group {{(pid=99026) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 17:42:32.467234 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-aa871090-019c-4427-8fd5-9126ea43b147 req-5d817aa1-3581-4743-a616-efdac0f75e11 tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] 10.222.0.122 "GET /v2.0/security-groups?id=36f94dea-f495-4a32-ab2e-aef5450d5564&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.9662864
May 25 17:42:32.571674 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-7e2d90ab-6a91-416e-9430-f9ee70943fca req-9c892d14-8a64-40f7-8c31-91ac8a4dd1bb tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/ports?device_id=3fb3211e-48f5-46f5-8035-ddbc35109aa8 HTTP/1.1" status: 200  len: 210 time: 0.1576796
May 25 17:42:32.658207 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvr_db [None req-9b65c929-8120-47be-bd66-c087f0799a54 None None] Set router d71e624d-d858-442b-b878-577be49edd03 gateway port host: dv-cinder-789564-2-iscsi {{(pid=99028) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 17:42:32.701806 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [req-c1255886-2c4e-4d60-b056-4e6d8e856d9f req-b611e140-088e-47fd-bbe8-b23e0caa8988 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:32.730323 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-c6e0a943-86f9-41f6-bd28-c558d49f9891 req-0dde2041-b4fe-432c-a00d-c074f6a8bdda tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Notify callbacks [] for port, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:32.740266 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-55b80181-8e60-4e61-ab9c-da578f53923f admin admin] Notify callbacks [] for port, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:32.779111 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.provisioning_blocks [None req-55b80181-8e60-4e61-ab9c-da578f53923f admin admin] Transition to ACTIVE for port object d13f3233-9e09-41c7-8315-4eae735fe605 will not be triggered until provisioned by entity DHCP. {{(pid=99027) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 17:42:32.951362 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-f4403198-4bc3-42de-9547-6cb2ce5ac477 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:33.044945 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-f4403198-4bc3-42de-9547-6cb2ce5ac477 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:33.073252 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:33.203086 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4403198-4bc3-42de-9547-6cb2ce5ac477 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a9801022-0d86-4bbb-92ba-b3faef5a5f17,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:33.225987 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-c6e0a943-86f9-41f6-bd28-c558d49f9891 req-0dde2041-b4fe-432c-a00d-c074f6a8bdda tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781840788179'] for port, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:33.587746 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-55b80181-8e60-4e61-ab9c-da578f53923f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781840788179'] for port, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:33.587746 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-f4403198-4bc3-42de-9547-6cb2ce5ac477 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.205s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:33.590196 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device ba3fdf48-5b50-4a04-9bed-01d9f2c8cf44 up at agent ovs-agent-dv-cinder-789564-2-iscsi {{(pid=99028) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 17:42:33.591038 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:33.591038 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-f4403198-4bc3-42de-9547-6cb2ce5ac477 admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=e125b0d41d9f472d8ca31cc39504a2b3&name=default HTTP/1.1" status: 200  len: 2979 time: 2.8542037
May 25 17:42:33.591038 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 40322) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:42:33.591038 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-55b80181-8e60-4e61-ab9c-da578f53923f admin admin] Network defaef08-c0f9-4608-b66d-b97e06e185bf is already hosted by enough agents. {{(pid=99027) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 17:42:33.591038 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.base_scheduler [None req-55b80181-8e60-4e61-ab9c-da578f53923f admin admin] Resources bound (agent type, host, resource id):  {{(pid=99027) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 17:42:33.591593 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-9b65c929-8120-47be-bd66-c087f0799a54 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcae71a7f70>, [{'id': 'd71e624d-d858-442b-b878-577be49edd03', 'name': 'tempest-AttachVolumeTestJSON-1986395052-router', 'tenant_id': 'b4cdc54b260f4e79b87fdf4a43b12e16', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.176'}], 'enable_snat': True}, 'gw_port_id': '9635c7b0-eb08-41ee-980e-3da56221f88d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:42:22Z', 'updated_at': '2021-05-25T17:42:25Z', 'revision_number': 3, 'project_id': 'b4cdc54b260f4e79b87fdf4a43b12e16', 'gw_port': {'id': '9635c7b0-eb08-41ee-980e-3da56221f88d', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:44:59', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd71e624d-d858-442b-b878-577be49edd03', 'device_owner': 'network:router_gateway', 'standard_attr_id': 80, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.176', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:42:23Z', 'updated_at': '2021-05-25T17:42:31Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi'}], 'dv-cinder-789564-2-iscsi', False) {} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:42:33.591593 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9b65c929-8120-47be-bd66-c087f0799a54 None None] The sync data for ids ['d71e624d-d858-442b-b878-577be49edd03'] in dv-cinder-789564-2-iscsi is: [{'id': 'd71e624d-d858-442b-b878-577be49edd03', 'name': 'tempest-AttachVolumeTestJSON-1986395052-router', 'tenant_id': 'b4cdc54b260f4e79b87fdf4a43b12e16', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.176'}], 'enable_snat': True}, 'gw_port_id': '9635c7b0-eb08-41ee-980e-3da56221f88d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:42:22Z', 'updated_at': '2021-05-25T17:42:25Z', 'revision_number': 3, 'project_id': 'b4cdc54b260f4e79b87fdf4a43b12e16', 'gw_port': {'id': '9635c7b0-eb08-41ee-980e-3da56221f88d', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:44:59', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd71e624d-d858-442b-b878-577be49edd03', 'device_owner': 'network:router_gateway', 'standard_attr_id': 80, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.176', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:42:23Z', 'updated_at': '2021-05-25T17:42:31Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi'}] {{(pid=99028) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 25 17:42:33.639983 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-b3224bc6-79fd-4b27-a845-dbd626c2ff4a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1473138', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114466', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411'] for subnet, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:33.680829 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Provisioning for port ba3fdf48-5b50-4a04-9bed-01d9f2c8cf44 completed by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 17:42:33.687194 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Provisioning complete for port ba3fdf48-5b50-4a04-9bed-01d9f2c8cf44 triggered by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 17:42:33.687577 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:33.687982 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.l3_dvrscheduler_db [None req-55b80181-8e60-4e61-ab9c-da578f53923f admin admin] Received port after_create {{(pid=99027) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 17:42:33.698990 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-55b80181-8e60-4e61-ab9c-da578f53923f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-421008'] for router_interface, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:33.727619 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:33.786339 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3224bc6-79fd-4b27-a845-dbd626c2ff4a admin admin] Pushing event deleted for resources: {'Subnet': ['ID=ca4c4fe6-6443-482e-8132-d47a672f12e8,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:33.794110 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-b3224bc6-79fd-4b27-a845-dbd626c2ff4a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.066s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:33.874329 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:33.909073 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] For port ba3fdf48-5b50-4a04-9bed-01d9f2c8cf44, host dv-cinder-789564-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=ba3fdf48-5b50-4a04-9bed-01d9f2c8cf44,segment=NetworkSegment(471771f9-c462-4865-800d-0d5029e9eb3e),segment_id=471771f9-c462-4865-800d-0d5029e9eb3e)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:42:33.994862 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:34.003026 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-d4dd3845-1f7f-45ee-8256-ebaa94faf8a8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:34.048596 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-b3224bc6-79fd-4b27-a845-dbd626c2ff4a admin admin] Notify callbacks [] for subnet, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:34.152501 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-b3224bc6-79fd-4b27-a845-dbd626c2ff4a admin admin] 10.222.0.122 "DELETE /v2.0/subnets/ca4c4fe6-6443-482e-8132-d47a672f12e8 HTTP/1.1" status: 204  len: 168 time: 3.3026721
May 25 17:42:34.183246 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 40338) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:42:34.239236 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Pushing event updated for resources: {'Port': ['ID=ba3fdf48-5b50-4a04-9bed-01d9f2c8cf44,revision_number=4']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:34.248950 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.243s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:34.302583 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-b4508a66-4b7e-451a-a8a0-8a7619776acd None None] Provisioning for port d13f3233-9e09-41c7-8315-4eae735fe605 completed by entity DHCP. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 17:42:34.309066 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-b4508a66-4b7e-451a-a8a0-8a7619776acd None None] Provisioning complete for port d13f3233-9e09-41c7-8315-4eae735fe605 triggered by entity DHCP. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 17:42:34.309609 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-b4508a66-4b7e-451a-a8a0-8a7619776acd None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:34.448802 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.plugin [None req-b4508a66-4b7e-451a-a8a0-8a7619776acd None None] Port d13f3233-9e09-41c7-8315-4eae735fe605 cannot update to ACTIVE because it is not bound. {{(pid=99028) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 25 17:42:34.499081 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55b80181-8e60-4e61-ab9c-da578f53923f admin admin] Pushing event updated for resources: {'Port': ['ID=d13f3233-9e09-41c7-8315-4eae735fe605,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:34.585960 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-55b80181-8e60-4e61-ab9c-da578f53923f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 1.289s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:34.603830 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-be78354d-8a7a-498a-bef5-5a4295457f00 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.304s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:34.661075 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-c6e0a943-86f9-41f6-bd28-c558d49f9891 req-0dde2041-b4fe-432c-a00d-c074f6a8bdda tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Network 6c7eca3b-72f3-4ba8-9e95-614d64496512 is already hosted by enough agents. {{(pid=99027) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 17:42:34.662185 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-d9e62ef8-202c-4c2c-8106-4aa04c9760b2 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:34.686662 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.base_scheduler [req-c6e0a943-86f9-41f6-bd28-c558d49f9891 req-0dde2041-b4fe-432c-a00d-c074f6a8bdda tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Resources bound (agent type, host, resource id):  {{(pid=99027) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 17:42:34.695305 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.l3_dvrscheduler_db [req-c6e0a943-86f9-41f6-bd28-c558d49f9891 req-0dde2041-b4fe-432c-a00d-c074f6a8bdda tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Received port after_create {{(pid=99027) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 17:42:34.700949 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6e0a943-86f9-41f6-bd28-c558d49f9891 req-0dde2041-b4fe-432c-a00d-c074f6a8bdda tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:42:34.701978 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-c6e0a943-86f9-41f6-bd28-c558d49f9891 req-0dde2041-b4fe-432c-a00d-c074f6a8bdda tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-239387', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for port, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:34.731861 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-2df73c1c-d247-42d9-b20c-a29c61b901d5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1492659'] for network, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:34.764801 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-55b80181-8e60-4e61-ab9c-da578f53923f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:34.793760 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-20656e40-86f4-4c3e-85c5-439b64c63cce admin admin] Notify callbacks [] for port, precommit_update {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:34.817784 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-d9e62ef8-202c-4c2c-8106-4aa04c9760b2 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:34.840843 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0dde2041-b4fe-432c-a00d-c074f6a8bdda tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Pushing event updated for resources: {'Port': ['ID=4698ed19-7e41-4457-a1fd-16d5f606084a,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:34.940099 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-0dde2041-b4fe-432c-a00d-c074f6a8bdda tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.336s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:34.973642 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-20656e40-86f4-4c3e-85c5-439b64c63cce admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:34.996030 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbc4db5a-efa9-474c-a6ce-dc24d7917dcf req-15129a57-1839-4c25-b7e5-f5113a8c8fa3 tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:42:34.997706 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-cbc4db5a-efa9-474c-a6ce-dc24d7917dcf req-15129a57-1839-4c25-b7e5-f5113a8c8fa3 tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] 10.222.0.122 "GET /v2.0/ports?device_id=cab9bd8d-5b7a-4fc2-85cd-9d4f9884b4ee HTTP/1.1" status: 200  len: 932 time: 1.2206910
May 25 17:42:35.004510 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-20656e40-86f4-4c3e-85c5-439b64c63cce admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-549394', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-420925'] for router_interface, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:35.017146 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86f02227-0215-4d31-9c51-66fb9d2303fc req-31169e0a-cbf3-41ba-9639-93b0cd8ad9bc tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:42:35.017888 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-86f02227-0215-4d31-9c51-66fb9d2303fc req-31169e0a-cbf3-41ba-9639-93b0cd8ad9bc tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Synchronizing usage tracker for tenant:5ae575cfd07c4a88aa626c15e6bccfd9 on resource:port {{(pid=99027) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 17:42:35.042469 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-c6e0a943-86f9-41f6-bd28-c558d49f9891 req-0dde2041-b4fe-432c-a00d-c074f6a8bdda tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.125 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 5.8535693
May 25 17:42:35.080628 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.v2.base [req-c6e0a943-86f9-41f6-bd28-c558d49f9891 req-85fd2b34-0182-421e-90a8-ef70bec7b1a7 service neutron] Request body: {'port': {'device_id': '3fb3211e-48f5-46f5-8035-ddbc35109aa8', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78956'}} {{(pid=99027) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:42:35.181770 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-2b87807e-cf35-4a87-ba05-003eda785159 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:35.314164 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device ba3fdf48-5b50-4a04-9bed-01d9f2c8cf44 up at agent ovs-agent-dv-cinder-789564-2-iscsi {{(pid=99028) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 17:42:35.348347 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-86f02227-0215-4d31-9c51-66fb9d2303fc req-31169e0a-cbf3-41ba-9639-93b0cd8ad9bc tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Unset dirty status for tenant:5ae575cfd07c4a88aa626c15e6bccfd9 on resource:port {{(pid=99027) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 17:42:35.349894 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-86f02227-0215-4d31-9c51-66fb9d2303fc req-31169e0a-cbf3-41ba-9639-93b0cd8ad9bc tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/ports?device_id=3fb3211e-48f5-46f5-8035-ddbc35109aa8 HTTP/1.1" status: 200  len: 932 time: 1.0373943
May 25 17:42:35.350993 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-d9e62ef8-202c-4c2c-8106-4aa04c9760b2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:35.374639 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.db.resource_extend [req-c1255886-2c4e-4d60-b056-4e6d8e856d9f req-b611e140-088e-47fd-bbe8-b23e0caa8988 service neutron] It took 0.39 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=99026) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}}
May 25 17:42:35.399016 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:35.432669 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Provisioning complete for port ba3fdf48-5b50-4a04-9bed-01d9f2c8cf44 triggered by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 17:42:35.433050 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:35.440023 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9e62ef8-202c-4c2c-8106-4aa04c9760b2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a9801022-0d86-4bbb-92ba-b3faef5a5f17,revision_number=None']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:35.461003 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-2df73c1c-d247-42d9-b20c-a29c61b901d5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1470792', 'neutron.services.segments.db._delete_segments_for_network-8781841233116'] for network, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:35.461488 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-d9e62ef8-202c-4c2c-8106-4aa04c9760b2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.062s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:35.466243 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-d9e62ef8-202c-4c2c-8106-4aa04c9760b2 admin admin] Notify callbacks [] for security_group, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:35.471001 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-d9e62ef8-202c-4c2c-8106-4aa04c9760b2 admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/a9801022-0d86-4bbb-92ba-b3faef5a5f17 HTTP/1.1" status: 204  len: 168 time: 1.9805601
May 25 17:42:35.478707 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-c6e0a943-86f9-41f6-bd28-c558d49f9891 req-85fd2b34-0182-421e-90a8-ef70bec7b1a7 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:35.503024 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-86f02227-0215-4d31-9c51-66fb9d2303fc req-0bd0b1c6-ff06-4ccf-8be0-9a2c9ca2145a tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Synchronizing usage tracker for tenant:5ae575cfd07c4a88aa626c15e6bccfd9 on resource:security_group {{(pid=99027) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 17:42:35.515888 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-cbc4db5a-efa9-474c-a6ce-dc24d7917dcf req-d4963d99-e28b-4824-97bf-92253c08468c tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] 10.222.0.122 "GET /v2.0/security-groups?id=36f94dea-f495-4a32-ab2e-aef5450d5564&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.4733701
May 25 17:42:35.518525 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-2df73c1c-d247-42d9-b20c-a29c61b901d5 admin admin] Subscribe: <bound method Plugin._prevent_segment_delete_with_subnet_associated of <neutron.services.segments.plugin.Plugin object at 0x7fcae66e1940>> segment before_delete 55550000 {{(pid=99026) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:42:35.518886 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-2df73c1c-d247-42d9-b20c-a29c61b901d5 admin admin] Subscribe: <bound method Plugin._validate_auto_address_subnet_delete of <neutron.services.segments.plugin.Plugin object at 0x7fcae66e1940>> subnet precommit_delete_associations 55550000 {{(pid=99026) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:42:35.519996 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-2df73c1c-d247-42d9-b20c-a29c61b901d5 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_host_addition_to_aggregate of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fcae6a1b2e0>> segment_host_mapping after_create 55550000 {{(pid=99026) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:42:35.519996 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-2df73c1c-d247-42d9-b20c-a29c61b901d5 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_port_created_or_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fcae6a1b2e0>> port after_create 55550000 {{(pid=99026) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:42:35.520300 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-2df73c1c-d247-42d9-b20c-a29c61b901d5 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_port_created_or_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fcae6a1b2e0>> port after_delete 55550000 {{(pid=99026) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:42:35.520646 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-2df73c1c-d247-42d9-b20c-a29c61b901d5 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_port_updated of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fcae6a1b2e0>> port after_update 55550000 {{(pid=99026) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:42:35.520961 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-2df73c1c-d247-42d9-b20c-a29c61b901d5 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_segment_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fcae6a1b2e0>> segment after_delete 55550000 {{(pid=99026) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:42:35.521301 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-2df73c1c-d247-42d9-b20c-a29c61b901d5 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_created of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fcae6a1b2e0>> subnet after_create 55550000 {{(pid=99026) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:42:35.521608 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-2df73c1c-d247-42d9-b20c-a29c61b901d5 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fcae6a1b2e0>> subnet after_delete 55550000 {{(pid=99026) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:42:35.521925 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-2df73c1c-d247-42d9-b20c-a29c61b901d5 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_updated of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fcae6a1b2e0>> subnet after_update 55550000 {{(pid=99026) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:42:35.588326 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-55b80181-8e60-4e61-ab9c-da578f53923f admin admin] Notify callbacks [] for port, precommit_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:35.664452 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-55b80181-8e60-4e61-ab9c-da578f53923f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:35.669004 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-55b80181-8e60-4e61-ab9c-da578f53923f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-549394', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-420925'] for router_interface, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:35.682364 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:35.761322 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-2df73c1c-d247-42d9-b20c-a29c61b901d5 admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_after_create of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7fcae6782970>> subnet after_create 55550000 {{(pid=99026) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:42:35.761932 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-2df73c1c-d247-42d9-b20c-a29c61b901d5 admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_after_delete of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7fcae6782970>> subnet after_delete 55550000 {{(pid=99026) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:42:35.762045 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-2df73c1c-d247-42d9-b20c-a29c61b901d5 admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_before_create of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7fcae6782970>> subnet before_create 55550000 {{(pid=99026) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:42:35.762391 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-2df73c1c-d247-42d9-b20c-a29c61b901d5 admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_before_update of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7fcae6782970>> subnet before_update 55550000 {{(pid=99026) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:42:35.763038 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.services.segments.db [None req-2df73c1c-d247-42d9-b20c-a29c61b901d5 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fcae66e1730>,) {'filters': {'network_id': ['20f9a6bc-29c0-49ed-a2fb-d197360212a9']}} {{(pid=99026) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:42:35.767055 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device 9635c7b0-eb08-41ee-980e-3da56221f88d up at agent ovs-agent-dv-cinder-789564-2-iscsi {{(pid=99028) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 17:42:35.803519 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.notifiers.nova [req-c1255886-2c4e-4d60-b056-4e6d8e856d9f req-b611e140-088e-47fd-bbe8-b23e0caa8988 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 4d583d58-a3d8-4d10-883a-5959fa74e40c {{(pid=99026) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 25 17:42:35.839371 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [req-c1255886-2c4e-4d60-b056-4e6d8e856d9f req-b611e140-088e-47fd-bbe8-b23e0caa8988 service neutron] Notify callbacks [] for port, precommit_update {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:35.851690 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-86f02227-0215-4d31-9c51-66fb9d2303fc req-0bd0b1c6-ff06-4ccf-8be0-9a2c9ca2145a tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Unset dirty status for tenant:5ae575cfd07c4a88aa626c15e6bccfd9 on resource:security_group {{(pid=99027) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 17:42:35.852819 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-86f02227-0215-4d31-9c51-66fb9d2303fc req-0bd0b1c6-ff06-4ccf-8be0-9a2c9ca2145a tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/security-groups?id=dda11ec6-545c-479e-bba9-4390fea678fa&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.4800189
May 25 17:42:35.875108 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.provisioning_blocks [req-c1255886-2c4e-4d60-b056-4e6d8e856d9f req-b611e140-088e-47fd-bbe8-b23e0caa8988 service neutron] Transition to ACTIVE for port object 4d583d58-a3d8-4d10-883a-5959fa74e40c will not be triggered until provisioned by entity L2. {{(pid=99026) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 17:42:35.906261 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.services.segments.db [None req-2df73c1c-d247-42d9-b20c-a29c61b901d5 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fcae66e1730>, '24ef52a3-71f5-4354-8441-5f5dae329da1') {'for_net_delete': True} {{(pid=99026) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:42:35.907199 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.services.segments.db [None req-2df73c1c-d247-42d9-b20c-a29c61b901d5 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fcae66e1730>, '24ef52a3-71f5-4354-8441-5f5dae329da1') {} {{(pid=99026) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:42:35.922826 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-2df73c1c-d247-42d9-b20c-a29c61b901d5 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8781841242525', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-14735041'] for segment, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:35.963152 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20656e40-86f4-4c3e-85c5-439b64c63cce admin admin] Pushing event updated for resources: {'Port': ['ID=f7fc9e77-51db-43c8-9f03-ac0ca1040af2,revision_number=2']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:35.967008 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-20656e40-86f4-4c3e-85c5-439b64c63cce admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.785s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:35.998016 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-2df73c1c-d247-42d9-b20c-a29c61b901d5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1469168'] for segment, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:36.009016 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [req-c1255886-2c4e-4d60-b056-4e6d8e856d9f req-b611e140-088e-47fd-bbe8-b23e0caa8988 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15476529'] for port, after_update {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:36.017022 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-20656e40-86f4-4c3e-85c5-439b64c63cce admin admin] Network 2abe381d-082b-4294-8193-c6556a56adb4 is already hosted by enough agents. {{(pid=99026) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 17:42:36.021050 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-2df73c1c-d247-42d9-b20c-a29c61b901d5 admin admin] Releasing vlan 1337 on physical network physnet1 to pool {{(pid=99026) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 25 17:42:36.021410 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-2df73c1c-d247-42d9-b20c-a29c61b901d5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1469168', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-15476589'] for segment, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:36.038948 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-8a2aea2e-9cd4-4269-b9f7-ae4cfcda55b7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:36.071502 dv-cinder-789564-2-iscsi neutron-server[99026]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead
May 25 17:42:36.071502 dv-cinder-789564-2-iscsi neutron-server[99026]:   from cryptography.utils import int_from_bytes
May 25 17:42:36.071502 dv-cinder-789564-2-iscsi neutron-server[99026]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead
May 25 17:42:36.071502 dv-cinder-789564-2-iscsi neutron-server[99026]:   from cryptography.utils import int_from_bytes
May 25 17:42:36.071502 dv-cinder-789564-2-iscsi neutron-server[99026]: Traceback (most recent call last):
May 25 17:42:36.071502 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 25 17:42:36.071502 dv-cinder-789564-2-iscsi neutron-server[99026]:     timer()
May 25 17:42:36.071502 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 25 17:42:36.071502 dv-cinder-789564-2-iscsi neutron-server[99026]:     cb(*args, **kw)
May 25 17:42:36.071502 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 25 17:42:36.071502 dv-cinder-789564-2-iscsi neutron-server[99026]:     return func(*args, **kwargs)
May 25 17:42:36.071502 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 25 17:42:36.071502 dv-cinder-789564-2-iscsi neutron-server[99026]:     self._notify()
May 25 17:42:36.071502 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 25 17:42:36.071502 dv-cinder-789564-2-iscsi neutron-server[99026]:     self.callback(batched_events)
May 25 17:42:36.071502 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 25 17:42:36.071502 dv-cinder-789564-2-iscsi neutron-server[99026]:     event.method(event)
May 25 17:42:36.071502 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 25 17:42:36.071502 dv-cinder-789564-2-iscsi neutron-server[99026]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 25 17:42:36.071502 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 25 17:42:36.071502 dv-cinder-789564-2-iscsi neutron-server[99026]:     aggregate_uuid = self.p_client.list_aggregates(
May 25 17:42:36.071502 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 25 17:42:36.071502 dv-cinder-789564-2-iscsi neutron-server[99026]:     return f(self, *a, **k)
May 25 17:42:36.071502 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 25 17:42:36.071502 dv-cinder-789564-2-iscsi neutron-server[99026]:     return self._get(url).json()
May 25 17:42:36.071502 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 25 17:42:36.071502 dv-cinder-789564-2-iscsi neutron-server[99026]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 25 17:42:36.071502 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 25 17:42:36.071502 dv-cinder-789564-2-iscsi neutron-server[99026]:     return self.request(url, 'GET', **kwargs)
May 25 17:42:36.071502 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 25 17:42:36.071502 dv-cinder-789564-2-iscsi neutron-server[99026]:     base_url = self.get_endpoint(auth, allow=allow,
May 25 17:42:36.071502 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 25 17:42:36.071502 dv-cinder-789564-2-iscsi neutron-server[99026]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 25 17:42:36.071502 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 25 17:42:36.071502 dv-cinder-789564-2-iscsi neutron-server[99026]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 25 17:42:36.071502 dv-cinder-789564-2-iscsi neutron-server[99026]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 25 17:42:36.073651 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.scheduler.base_scheduler [None req-20656e40-86f4-4c3e-85c5-439b64c63cce admin admin] Resources bound (agent type, host, resource id):  {{(pid=99026) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 17:42:36.097869 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Provisioning for port 9635c7b0-eb08-41ee-980e-3da56221f88d completed by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 17:42:36.103116 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Provisioning complete for port 9635c7b0-eb08-41ee-980e-3da56221f88d triggered by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 17:42:36.103483 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:36.345236 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55b80181-8e60-4e61-ab9c-da578f53923f admin admin] Pushing event updated for resources: {'Port': ['ID=d13f3233-9e09-41c7-8315-4eae735fe605,revision_number=2']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:36.365483 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-55b80181-8e60-4e61-ab9c-da578f53923f admin admin] Network defaef08-c0f9-4608-b66d-b97e06e185bf is already hosted by enough agents. {{(pid=99027) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 17:42:36.384967 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-55b80181-8e60-4e61-ab9c-da578f53923f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.702s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:36.387322 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.base_scheduler [None req-55b80181-8e60-4e61-ab9c-da578f53923f admin admin] Resources bound (agent type, host, resource id):  {{(pid=99027) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 17:42:36.463817 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:36.484252 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b611e140-088e-47fd-bbe8-b23e0caa8988 service neutron] Pushing event updated for resources: {'Port': ['ID=4d583d58-a3d8-4d10-883a-5959fa74e40c,revision_number=2']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:36.497660 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-b611e140-088e-47fd-bbe8-b23e0caa8988 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.458s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:36.522737 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 40378) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:42:36.545771 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] For port 9635c7b0-eb08-41ee-980e-3da56221f88d, host dv-cinder-789564-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=9635c7b0-eb08-41ee-980e-3da56221f88d,segment=NetworkSegment(471771f9-c462-4865-800d-0d5029e9eb3e),segment_id=471771f9-c462-4865-800d-0d5029e9eb3e)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:42:36.690478 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:36.695343 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:36.809598 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-2df73c1c-d247-42d9-b20c-a29c61b901d5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1470785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-459299', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551400', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-419883'] for network, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:36.853454 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:36.973651 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2df73c1c-d247-42d9-b20c-a29c61b901d5 admin admin] Pushing event deleted for resources: {'Network': ['ID=20f9a6bc-29c0-49ed-a2fb-d197360212a9,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:36.974931 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-7312cd9b-e565-412c-88e6-d1075d8cd46a None None] Provisioning complete for port d13f3233-9e09-41c7-8315-4eae735fe605 triggered by entity DHCP. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 17:42:36.975949 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-7312cd9b-e565-412c-88e6-d1075d8cd46a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:36.988829 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-2df73c1c-d247-42d9-b20c-a29c61b901d5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.135s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:36.990584 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-2df73c1c-d247-42d9-b20c-a29c61b901d5 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for network, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:36.997617 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.managers [req-c1255886-2c4e-4d60-b056-4e6d8e856d9f req-b611e140-088e-47fd-bbe8-b23e0caa8988 service neutron] Attempting to bind port 4d583d58-a3d8-4d10-883a-5959fa74e40c on host hv-cinder-78956 for vnic_type normal with profile  {{(pid=99026) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 17:42:36.998093 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.managers [req-c1255886-2c4e-4d60-b056-4e6d8e856d9f req-b611e140-088e-47fd-bbe8-b23e0caa8988 service neutron] Attempting to bind port 4d583d58-a3d8-4d10-883a-5959fa74e40c by drivers openvswitch,hyperv on host hv-cinder-78956 at level 0 using segments [{'id': 'cc9a1d0a-1ce8-490e-886f-4f9fc5e8fc3d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1333, 'network_id': '58926b0f-c6c9-44b1-aa59-d580f9359c87'}] {{(pid=99026) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 17:42:36.998544 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c1255886-2c4e-4d60-b056-4e6d8e856d9f req-b611e140-088e-47fd-bbe8-b23e0caa8988 service neutron] Attempting to bind port 4d583d58-a3d8-4d10-883a-5959fa74e40c on network 58926b0f-c6c9-44b1-aa59-d580f9359c87 {{(pid=99026) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 17:42:37.006834 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-2df73c1c-d247-42d9-b20c-a29c61b901d5 admin admin] 10.222.0.122 "DELETE /v2.0/networks/20f9a6bc-29c0-49ed-a2fb-d197360212a9 HTTP/1.1" status: 204  len: 168 time: 2.8178883
May 25 17:42:37.008905 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c1255886-2c4e-4d60-b056-4e6d8e856d9f req-b611e140-088e-47fd-bbe8-b23e0caa8988 service neutron] Port 4d583d58-a3d8-4d10-883a-5959fa74e40c on network 58926b0f-c6c9-44b1-aa59-d580f9359c87 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78956 {{(pid=99026) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 25 17:42:37.009286 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c1255886-2c4e-4d60-b056-4e6d8e856d9f req-b611e140-088e-47fd-bbe8-b23e0caa8988 service neutron] Attempting to bind port 4d583d58-a3d8-4d10-883a-5959fa74e40c on network 58926b0f-c6c9-44b1-aa59-d580f9359c87 {{(pid=99026) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 17:42:37.013374 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 40400) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:42:37.024276 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-ea6b1ea7-f792-4cbc-91a4-9b35b1e4ca71 admin admin] Notify callbacks [] for security_group, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:37.042138 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.plugin [None req-7312cd9b-e565-412c-88e6-d1075d8cd46a None None] Port d13f3233-9e09-41c7-8315-4eae735fe605 cannot update to ACTIVE because it is not bound. {{(pid=99028) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 25 17:42:37.054518 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Pushing event updated for resources: {'Port': ['ID=9635c7b0-eb08-41ee-980e-3da56221f88d,revision_number=4']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:37.058427 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.db.resource_extend [req-c6e0a943-86f9-41f6-bd28-c558d49f9891 req-85fd2b34-0182-421e-90a8-ef70bec7b1a7 service neutron] It took 0.12 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=99027) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}}
May 25 17:42:37.062008 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.367s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:37.113816 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-ea6b1ea7-f792-4cbc-91a4-9b35b1e4ca71 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:42:37.121120 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.db_base_plugin_v2 [None req-fa0f8d19-7c4d-4e4b-9f51-344e7f99bdcd admin admin] Deleting subnet f99fd53f-fad7-4980-b038-552d0ca98305 {{(pid=99026) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 25 17:42:37.124353 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-fa0f8d19-7c4d-4e4b-9f51-344e7f99bdcd admin admin] Notify callbacks [] for subnet, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:37.164862 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-ea6b1ea7-f792-4cbc-91a4-9b35b1e4ca71 admin admin] Usage tracker for resource:security_group_rule and tenant:ab39c2649fc74fc28cc59776a0a9335d is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:42:37.175386 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-ea6b1ea7-f792-4cbc-91a4-9b35b1e4ca71 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:42:37.183276 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-fa0f8d19-7c4d-4e4b-9f51-344e7f99bdcd admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-14735050'] for subnet, precommit_delete_associations {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:37.205244 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-ea6b1ea7-f792-4cbc-91a4-9b35b1e4ca71 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:42:37.212077 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.notifiers.nova [req-c6e0a943-86f9-41f6-bd28-c558d49f9891 req-85fd2b34-0182-421e-90a8-ef70bec7b1a7 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 4698ed19-7e41-4457-a1fd-16d5f606084a {{(pid=99027) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 25 17:42:37.218653 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-55b80181-8e60-4e61-ab9c-da578f53923f admin admin] Router d71e624d-d858-442b-b878-577be49edd03 has already been hosted by L3 agent eaeb6875-c4ed-43b6-8658-aa4e52324fdf {{(pid=99027) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 25 17:42:37.230955 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-c6e0a943-86f9-41f6-bd28-c558d49f9891 req-85fd2b34-0182-421e-90a8-ef70bec7b1a7 service neutron] Notify callbacks [] for port, precommit_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:37.234384 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c1255886-2c4e-4d60-b056-4e6d8e856d9f req-b611e140-088e-47fd-bbe8-b23e0caa8988 service neutron] Checking agent: {'id': '4d02a528-6a0e-4977-985f-4bcff1ca6cb7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78956', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 17, 40, 41), 'started_at': datetime.datetime(2021, 5, 25, 17, 40, 41), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 17, 42, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=99026) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 17:42:37.234911 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c1255886-2c4e-4d60-b056-4e6d8e856d9f req-b611e140-088e-47fd-bbe8-b23e0caa8988 service neutron] Checking segment: {'id': 'cc9a1d0a-1ce8-490e-886f-4f9fc5e8fc3d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1333, 'network_id': '58926b0f-c6c9-44b1-aa59-d580f9359c87'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=99026) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 17:42:37.235701 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c1255886-2c4e-4d60-b056-4e6d8e856d9f req-b611e140-088e-47fd-bbe8-b23e0caa8988 service neutron] Bound using segment: {'id': 'cc9a1d0a-1ce8-490e-886f-4f9fc5e8fc3d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1333, 'network_id': '58926b0f-c6c9-44b1-aa59-d580f9359c87'} {{(pid=99026) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 17:42:37.236109 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.managers [req-c1255886-2c4e-4d60-b056-4e6d8e856d9f req-b611e140-088e-47fd-bbe8-b23e0caa8988 service neutron] Bound port: 4d583d58-a3d8-4d10-883a-5959fa74e40c, host: hv-cinder-78956, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'cc9a1d0a-1ce8-490e-886f-4f9fc5e8fc3d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1333, 'network_id': '58926b0f-c6c9-44b1-aa59-d580f9359c87'}}] {{(pid=99026) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 17:42:37.236579 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [req-c1255886-2c4e-4d60-b056-4e6d8e856d9f req-b611e140-088e-47fd-bbe8-b23e0caa8988 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:37.268800 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.provisioning_blocks [req-c6e0a943-86f9-41f6-bd28-c558d49f9891 req-85fd2b34-0182-421e-90a8-ef70bec7b1a7 service neutron] Transition to ACTIVE for port object 4698ed19-7e41-4457-a1fd-16d5f606084a will not be triggered until provisioned by entity L2. {{(pid=99027) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 17:42:37.271932 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-20656e40-86f4-4c3e-85c5-439b64c63cce admin admin] Router df4629e6-3b17-47f3-88e4-022b915a6a91 has already been hosted by L3 agent eaeb6875-c4ed-43b6-8658-aa4e52324fdf {{(pid=99026) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 25 17:42:37.282646 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-fa0f8d19-7c4d-4e4b-9f51-344e7f99bdcd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1474503'] for subnet, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:37.447698 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-c6e0a943-86f9-41f6-bd28-c558d49f9891 req-85fd2b34-0182-421e-90a8-ef70bec7b1a7 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:37.495968 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-55b80181-8e60-4e61-ab9c-da578f53923f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:37.556931 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d9bd474-24f5-41fb-80ea-24656867d15b req-4c44df42-a945-4135-9797-23eb90894e23 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:42:37.559682 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-1d9bd474-24f5-41fb-80ea-24656867d15b req-4c44df42-a945-4135-9797-23eb90894e23 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/ports?device_id=3fb3211e-48f5-46f5-8035-ddbc35109aa8 HTTP/1.1" status: 200  len: 932 time: 0.4471080
May 25 17:42:37.589044 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7315542-3345-4d9b-9979-0b69e03e9e71 req-dd98c8aa-4fc4-4fa4-ad19-c605e2abc589 tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:42:37.590911 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-a7315542-3345-4d9b-9979-0b69e03e9e71 req-dd98c8aa-4fc4-4fa4-ad19-c605e2abc589 tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] 10.222.0.122 "GET /v2.0/ports?device_id=cab9bd8d-5b7a-4fc2-85cd-9d4f9884b4ee HTTP/1.1" status: 200  len: 944 time: 0.7149274
May 25 17:42:37.761015 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.agents_db [None req-14fae233-15dc-4576-836b-621c5f95b584 None None] Agent healthcheck: found 6 active agents {{(pid=99029) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 17:42:37.825509 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-55b80181-8e60-4e61-ab9c-da578f53923f admin admin] Notify agent at l3_agent.dv-cinder-789564-2-iscsi the message routers_updated {{(pid=99027) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 25 17:42:37.841132 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6cb11c84-d312-4a7d-9782-3fca436b860d None None] Sync routers for ids ['d71e624d-d858-442b-b878-577be49edd03'] in dv-cinder-789564-2-iscsi {{(pid=99029) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 25 17:42:37.864509 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.db [req-c1255886-2c4e-4d60-b056-4e6d8e856d9f req-b611e140-088e-47fd-bbe8-b23e0caa8988 service neutron] For port 4d583d58-a3d8-4d10-883a-5959fa74e40c, host hv-cinder-78956, cleared binding levels {{(pid=99026) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 17:42:37.870240 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85fd2b34-0182-421e-90a8-ef70bec7b1a7 service neutron] Pushing event updated for resources: {'Port': ['ID=4698ed19-7e41-4457-a1fd-16d5f606084a,revision_number=2']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:37.880003 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6cb11c84-d312-4a7d-9782-3fca436b860d None None] Routers {'d71e624d-d858-442b-b878-577be49edd03'} bound to L3 agent in host dv-cinder-789564-2-iscsi {{(pid=99029) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 17:42:37.880625 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-a7315542-3345-4d9b-9979-0b69e03e9e71 req-9dabb8cb-675f-4de0-9cb4-5c24a35c278d tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] 10.222.0.122 "GET /v2.0/security-groups?id=36f94dea-f495-4a32-ab2e-aef5450d5564&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2571549
May 25 17:42:37.880716 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_hamode_db [None req-6cb11c84-d312-4a7d-9782-3fca436b860d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcae72268e0>, 'dv-cinder-789564-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-25T17:34:21Z,description=<?>,heartbeat_timestamp=2021-05-25T17:42:21Z,host='dv-cinder-789564-2-iscsi',id=eaeb6875-c4ed-43b6-8658-aa4e52324fdf,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T17:34:21Z,topic='l3_agent')) {'router_ids': ['d71e624d-d858-442b-b878-577be49edd03'], 'active': True} {{(pid=99029) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:42:37.886876 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-ea6b1ea7-f792-4cbc-91a4-9b35b1e4ca71 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:37.905691 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.db [req-c1255886-2c4e-4d60-b056-4e6d8e856d9f req-b611e140-088e-47fd-bbe8-b23e0caa8988 service neutron] For port 4d583d58-a3d8-4d10-883a-5959fa74e40c, host hv-cinder-78956, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=4d583d58-a3d8-4d10-883a-5959fa74e40c,segment=NetworkSegment(cc9a1d0a-1ce8-490e-886f-4f9fc5e8fc3d),segment_id=cc9a1d0a-1ce8-490e-886f-4f9fc5e8fc3d)] {{(pid=99026) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 17:42:37.924521 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-20656e40-86f4-4c3e-85c5-439b64c63cce admin admin] Notify agent at l3_agent.dv-cinder-789564-2-iscsi the message routers_updated {{(pid=99026) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 25 17:42:37.931272 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-85fd2b34-0182-421e-90a8-ef70bec7b1a7 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.435s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:37.936538 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b9450522-6e5c-4425-b4ea-6760d1195944 None None] Sync routers for ids ['df4629e6-3b17-47f3-88e4-022b915a6a91'] in dv-cinder-789564-2-iscsi {{(pid=99028) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 25 17:42:37.942243 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-20656e40-86f4-4c3e-85c5-439b64c63cce admin admin] 10.222.0.122 "PUT /v2.0/routers/df4629e6-3b17-47f3-88e4-022b915a6a91/add_router_interface HTTP/1.1" status: 200  len: 503 time: 10.6967721
May 25 17:42:37.981907 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b9450522-6e5c-4425-b4ea-6760d1195944 None None] Routers {'df4629e6-3b17-47f3-88e4-022b915a6a91'} bound to L3 agent in host dv-cinder-789564-2-iscsi {{(pid=99028) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 17:42:37.982775 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-b9450522-6e5c-4425-b4ea-6760d1195944 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcae70acc10>, 'dv-cinder-789564-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-25T17:34:21Z,description=<?>,heartbeat_timestamp=2021-05-25T17:42:21Z,host='dv-cinder-789564-2-iscsi',id=eaeb6875-c4ed-43b6-8658-aa4e52324fdf,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T17:34:21Z,topic='l3_agent')) {'router_ids': ['df4629e6-3b17-47f3-88e4-022b915a6a91'], 'active': True} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:42:37.994170 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-1d9bd474-24f5-41fb-80ea-24656867d15b req-9e7bcbbb-c35c-4797-8d68-51e9ceb476cf tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/security-groups?id=dda11ec6-545c-479e-bba9-4390fea678fa&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.4084561
May 25 17:42:37.997495 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [req-c1255886-2c4e-4d60-b056-4e6d8e856d9f req-b611e140-088e-47fd-bbe8-b23e0caa8988 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15476529'] for port, after_update {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:38.010467 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:38.062590 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-55b80181-8e60-4e61-ab9c-da578f53923f admin admin] 10.222.0.122 "PUT /v2.0/routers/d71e624d-d858-442b-b878-577be49edd03/add_router_interface HTTP/1.1" status: 200  len: 503 time: 10.3311992
May 25 17:42:38.066973 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-ea6b1ea7-f792-4cbc-91a4-9b35b1e4ca71 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:38.104851 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.managers [req-c6e0a943-86f9-41f6-bd28-c558d49f9891 req-85fd2b34-0182-421e-90a8-ef70bec7b1a7 service neutron] Attempting to bind port 4698ed19-7e41-4457-a1fd-16d5f606084a on host hv-cinder-78956 for vnic_type normal with profile  {{(pid=99027) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 17:42:38.114203 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.managers [req-c6e0a943-86f9-41f6-bd28-c558d49f9891 req-85fd2b34-0182-421e-90a8-ef70bec7b1a7 service neutron] Attempting to bind port 4698ed19-7e41-4457-a1fd-16d5f606084a by drivers openvswitch,hyperv on host hv-cinder-78956 at level 0 using segments [{'id': '87df170f-54cc-461b-a7ac-79e125fc526b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1304, 'network_id': '6c7eca3b-72f3-4ba8-9e95-614d64496512'}] {{(pid=99027) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 17:42:38.114666 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c6e0a943-86f9-41f6-bd28-c558d49f9891 req-85fd2b34-0182-421e-90a8-ef70bec7b1a7 service neutron] Attempting to bind port 4698ed19-7e41-4457-a1fd-16d5f606084a on network 6c7eca3b-72f3-4ba8-9e95-614d64496512 {{(pid=99027) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 17:42:38.137352 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.002s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:38.234342 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1255886-2c4e-4d60-b056-4e6d8e856d9f req-b611e140-088e-47fd-bbe8-b23e0caa8988 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:42:38.234967 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [req-c1255886-2c4e-4d60-b056-4e6d8e856d9f req-b611e140-088e-47fd-bbe8-b23e0caa8988 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-239387', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for port, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:38.236508 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-c1255886-2c4e-4d60-b056-4e6d8e856d9f req-b611e140-088e-47fd-bbe8-b23e0caa8988 service neutron] 10.222.0.125 "PUT /v2.0/ports/4d583d58-a3d8-4d10-883a-5959fa74e40c HTTP/1.1" status: 200  len: 1094 time: 6.6868176
May 25 17:42:38.247431 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c6e0a943-86f9-41f6-bd28-c558d49f9891 req-85fd2b34-0182-421e-90a8-ef70bec7b1a7 service neutron] Port 4698ed19-7e41-4457-a1fd-16d5f606084a on network 6c7eca3b-72f3-4ba8-9e95-614d64496512 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78956 {{(pid=99027) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 25 17:42:38.259207 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c6e0a943-86f9-41f6-bd28-c558d49f9891 req-85fd2b34-0182-421e-90a8-ef70bec7b1a7 service neutron] Attempting to bind port 4698ed19-7e41-4457-a1fd-16d5f606084a on network 6c7eca3b-72f3-4ba8-9e95-614d64496512 {{(pid=99027) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 17:42:38.260012 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'cab9bd8d-5b7a-4fc2-85cd-9d4f9884b4ee', 'tag': '4d583d58-a3d8-4d10-883a-5959fa74e40c'}] {{(pid=99026) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 17:42:38.329294 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b611e140-088e-47fd-bbe8-b23e0caa8988 service neutron] Pushing event updated for resources: {'Port': ['ID=4d583d58-a3d8-4d10-883a-5959fa74e40c,revision_number=3']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:38.346013 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-b611e140-088e-47fd-bbe8-b23e0caa8988 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.336s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:38.353222 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-ea6b1ea7-f792-4cbc-91a4-9b35b1e4ca71 admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=ab39c2649fc74fc28cc59776a0a9335d&name=default HTTP/1.1" status: 200  len: 2979 time: 1.8262255
May 25 17:42:38.356756 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 40428) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:42:38.357375 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c6e0a943-86f9-41f6-bd28-c558d49f9891 req-85fd2b34-0182-421e-90a8-ef70bec7b1a7 service neutron] Checking agent: {'id': '4d02a528-6a0e-4977-985f-4bcff1ca6cb7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78956', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 17, 40, 41), 'started_at': datetime.datetime(2021, 5, 25, 17, 40, 41), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 17, 42, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=99027) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 17:42:38.357836 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c6e0a943-86f9-41f6-bd28-c558d49f9891 req-85fd2b34-0182-421e-90a8-ef70bec7b1a7 service neutron] Checking segment: {'id': '87df170f-54cc-461b-a7ac-79e125fc526b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1304, 'network_id': '6c7eca3b-72f3-4ba8-9e95-614d64496512'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=99027) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 17:42:38.362365 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c6e0a943-86f9-41f6-bd28-c558d49f9891 req-85fd2b34-0182-421e-90a8-ef70bec7b1a7 service neutron] Bound using segment: {'id': '87df170f-54cc-461b-a7ac-79e125fc526b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1304, 'network_id': '6c7eca3b-72f3-4ba8-9e95-614d64496512'} {{(pid=99027) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 17:42:38.362874 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.managers [req-c6e0a943-86f9-41f6-bd28-c558d49f9891 req-85fd2b34-0182-421e-90a8-ef70bec7b1a7 service neutron] Bound port: 4698ed19-7e41-4457-a1fd-16d5f606084a, host: hv-cinder-78956, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '87df170f-54cc-461b-a7ac-79e125fc526b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1304, 'network_id': '6c7eca3b-72f3-4ba8-9e95-614d64496512'}}] {{(pid=99027) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 17:42:38.363594 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-c6e0a943-86f9-41f6-bd28-c558d49f9891 req-85fd2b34-0182-421e-90a8-ef70bec7b1a7 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:38.456189 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvr_db [None req-b9450522-6e5c-4425-b4ea-6760d1195944 None None] Set router df4629e6-3b17-47f3-88e4-022b915a6a91 gateway port host: dv-cinder-789564-2-iscsi {{(pid=99028) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 17:42:38.579984 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea6b1ea7-f792-4cbc-91a4-9b35b1e4ca71 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=734ee5b7-dc08-426e-bff4-4c68a07d3457,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:38.586624 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_dvr_db [None req-6cb11c84-d312-4a7d-9782-3fca436b860d None None] Set router d71e624d-d858-442b-b878-577be49edd03 gateway port host: dv-cinder-789564-2-iscsi {{(pid=99029) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 17:42:38.632634 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-fa0f8d19-7c4d-4e4b-9f51-344e7f99bdcd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1473138', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114466', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-15477963', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-14794250'] for subnet, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:38.650666 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-ea6b1ea7-f792-4cbc-91a4-9b35b1e4ca71 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.516s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:38.697307 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-0ce2fcfb-6f6b-4875-97e5-5c30902b5da6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:38.739750 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.db [req-c6e0a943-86f9-41f6-bd28-c558d49f9891 req-85fd2b34-0182-421e-90a8-ef70bec7b1a7 service neutron] For port 4698ed19-7e41-4457-a1fd-16d5f606084a, host hv-cinder-78956, cleared binding levels {{(pid=99027) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 17:42:38.747163 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.db [req-c6e0a943-86f9-41f6-bd28-c558d49f9891 req-85fd2b34-0182-421e-90a8-ef70bec7b1a7 service neutron] For port 4698ed19-7e41-4457-a1fd-16d5f606084a, host hv-cinder-78956, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=4698ed19-7e41-4457-a1fd-16d5f606084a,segment=NetworkSegment(87df170f-54cc-461b-a7ac-79e125fc526b),segment_id=87df170f-54cc-461b-a7ac-79e125fc526b)] {{(pid=99027) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 17:42:38.757786 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa0f8d19-7c4d-4e4b-9f51-344e7f99bdcd admin admin] Pushing event deleted for resources: {'Subnet': ['ID=f99fd53f-fad7-4980-b038-552d0ca98305,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:38.767594 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-fa0f8d19-7c4d-4e4b-9f51-344e7f99bdcd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:38.770244 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-64a436ed-5b64-426e-8449-fdfb20edc6d3 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:38.783755 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-fa0f8d19-7c4d-4e4b-9f51-344e7f99bdcd admin admin] Notify callbacks [] for subnet, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:38.801983 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-c6e0a943-86f9-41f6-bd28-c558d49f9891 req-85fd2b34-0182-421e-90a8-ef70bec7b1a7 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:38.880842 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-55b80181-8e60-4e61-ab9c-da578f53923f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:38.893234 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-fa0f8d19-7c4d-4e4b-9f51-344e7f99bdcd admin admin] 10.222.0.122 "DELETE /v2.0/subnets/f99fd53f-fad7-4980-b038-552d0ca98305 HTTP/1.1" status: 204  len: 168 time: 1.8672180
May 25 17:42:38.914100 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 40444) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:42:38.916230 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-64a436ed-5b64-426e-8449-fdfb20edc6d3 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:39.047288 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6e0a943-86f9-41f6-bd28-c558d49f9891 req-85fd2b34-0182-421e-90a8-ef70bec7b1a7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:42:39.048158 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-c6e0a943-86f9-41f6-bd28-c558d49f9891 req-85fd2b34-0182-421e-90a8-ef70bec7b1a7 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-239387', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for port, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:39.156008 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-c6e0a943-86f9-41f6-bd28-c558d49f9891 req-85fd2b34-0182-421e-90a8-ef70bec7b1a7 service neutron] 10.222.0.125 "PUT /v2.0/ports/4698ed19-7e41-4457-a1fd-16d5f606084a HTTP/1.1" status: 200  len: 1094 time: 3.9791729
May 25 17:42:39.156008 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '3fb3211e-48f5-46f5-8035-ddbc35109aa8', 'tag': '4698ed19-7e41-4457-a1fd-16d5f606084a'}] {{(pid=99027) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 17:42:39.210713 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device 9635c7b0-eb08-41ee-980e-3da56221f88d up at agent ovs-agent-dv-cinder-789564-2-iscsi {{(pid=99028) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 17:42:39.231540 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1255886-2c4e-4d60-b056-4e6d8e856d9f req-3d433e3e-67ae-42ba-ad3a-232600bfc2c5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:42:39.236444 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-c1255886-2c4e-4d60-b056-4e6d8e856d9f req-3d433e3e-67ae-42ba-ad3a-232600bfc2c5 service neutron] 10.222.0.125 "GET /v2.0/ports?tenant_id=fb338a290a2242fea3a4b8ae2bc4a14c&device_id=cab9bd8d-5b7a-4fc2-85cd-9d4f9884b4ee HTTP/1.1" status: 200  len: 1097 time: 0.7610371
May 25 17:42:39.252507 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85fd2b34-0182-421e-90a8-ef70bec7b1a7 service neutron] Pushing event updated for resources: {'Port': ['ID=4698ed19-7e41-4457-a1fd-16d5f606084a,revision_number=3']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:39.262285 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-85fd2b34-0182-421e-90a8-ef70bec7b1a7 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.405s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:39.368422 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-c1255886-2c4e-4d60-b056-4e6d8e856d9f req-5c024376-aa0e-4ce7-9c81-8a16ded20d8f service neutron] 10.222.0.125 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=4d583d58-a3d8-4d10-883a-5959fa74e40c HTTP/1.1" status: 200  len: 217 time: 0.1115680
May 25 17:42:39.399357 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-55488421-bcf8-4368-a8e2-5f63dbd30e21 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1492659'] for network, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:39.495552 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Provisioning complete for port 9635c7b0-eb08-41ee-980e-3da56221f88d triggered by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 17:42:39.495907 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:39.614862 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3623f6a8-95a3-48c6-abc6-fb22d7f662db req-3eeadc3b-9367-4834-9397-a7f154eb28b8 tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:42:39.622324 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-3623f6a8-95a3-48c6-abc6-fb22d7f662db req-3eeadc3b-9367-4834-9397-a7f154eb28b8 tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] 10.222.0.122 "GET /v2.0/ports?device_id=cab9bd8d-5b7a-4fc2-85cd-9d4f9884b4ee HTTP/1.1" status: 200  len: 944 time: 0.2806997
May 25 17:42:39.763794 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_hamode_db [None req-6cb11c84-d312-4a7d-9782-3fca436b860d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcae72268e0>, [{'id': 'd71e624d-d858-442b-b878-577be49edd03', 'name': 'tempest-AttachVolumeTestJSON-1986395052-router', 'tenant_id': 'b4cdc54b260f4e79b87fdf4a43b12e16', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.176'}], 'enable_snat': True}, 'gw_port_id': '9635c7b0-eb08-41ee-980e-3da56221f88d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:42:22Z', 'updated_at': '2021-05-25T17:42:34Z', 'revision_number': 4, 'project_id': 'b4cdc54b260f4e79b87fdf4a43b12e16', 'gw_port': {'id': '9635c7b0-eb08-41ee-980e-3da56221f88d', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:44:59', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd71e624d-d858-442b-b878-577be49edd03', 'device_owner': 'network:router_gateway', 'standard_attr_id': 80, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.176', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:42:23Z', 'updated_at': '2021-05-25T17:42:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi', '_interfaces': [{'id': 'd13f3233-9e09-41c7-8315-4eae735fe605', 'name': '', 'network_id': 'defaef08-c0f9-4608-b66d-b97e06e185bf', 'tenant_id': 'b4cdc54b260f4e79b87fdf4a43b12e16', 'mac_address': 'fa:16:3e:87:b7:74', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd71e624d-d858-442b-b878-577be49edd03', 'device_owner': 'network:router_interface', 'standard_attr_id': 106, 'fixed_ips': [{'subnet_id': '5be08358-9d04-4ee9-91ac-104e66e66e20', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:42:29Z', 'updated_at': '2021-05-25T17:42:35Z', 'revision_number': 2, 'project_id': 'b4cdc54b260f4e79b87fdf4a43b12e16', 'subnets': [{'id': '5be08358-9d04-4ee9-91ac-104e66e66e20', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-789564-2-iscsi', False) {} {{(pid=99029) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:42:39.770877 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1255886-2c4e-4d60-b056-4e6d8e856d9f req-6eb6bb9b-01c9-4ae5-90ae-4b6390a9d9c2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:42:39.771500 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6cb11c84-d312-4a7d-9782-3fca436b860d None None] Checking router: d71e624d-d858-442b-b878-577be49edd03 for host: dv-cinder-789564-2-iscsi {{(pid=99029) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 25 17:42:39.772130 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6cb11c84-d312-4a7d-9782-3fca436b860d None None] Updating router d71e624d-d858-442b-b878-577be49edd03 port d13f3233-9e09-41c7-8315-4eae735fe605 binding host dv-cinder-789564-2-iscsi {{(pid=99029) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 25 17:42:39.773169 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-c1255886-2c4e-4d60-b056-4e6d8e856d9f req-6eb6bb9b-01c9-4ae5-90ae-4b6390a9d9c2 service neutron] 10.222.0.125 "GET /v2.0/subnets?id=d821d422-628c-4d27-a03e-94485f09826d HTTP/1.1" status: 200  len: 852 time: 0.3765359
May 25 17:42:39.778637 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-b9450522-6e5c-4425-b4ea-6760d1195944 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcae70acc10>, [{'id': 'df4629e6-3b17-47f3-88e4-022b915a6a91', 'name': 'tempest-ServerRescueNegativeTestJSON-301463405-router', 'tenant_id': '5b2f6ca8c5b94c2f8894c04f297b5f8b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.206'}], 'enable_snat': True}, 'gw_port_id': 'ba3fdf48-5b50-4a04-9bed-01d9f2c8cf44', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:42:21Z', 'updated_at': '2021-05-25T17:42:31Z', 'revision_number': 4, 'project_id': '5b2f6ca8c5b94c2f8894c04f297b5f8b', 'gw_port': {'id': 'ba3fdf48-5b50-4a04-9bed-01d9f2c8cf44', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:8b:8e:8a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'df4629e6-3b17-47f3-88e4-022b915a6a91', 'device_owner': 'network:router_gateway', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.206', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:42:22Z', 'updated_at': '2021-05-25T17:42:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi', '_interfaces': [{'id': 'f7fc9e77-51db-43c8-9f03-ac0ca1040af2', 'name': '', 'network_id': '2abe381d-082b-4294-8193-c6556a56adb4', 'tenant_id': '5b2f6ca8c5b94c2f8894c04f297b5f8b', 'mac_address': 'fa:16:3e:f6:81:12', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'df4629e6-3b17-47f3-88e4-022b915a6a91', 'device_owner': 'network:router_interface', 'standard_attr_id': 105, 'fixed_ips': [{'subnet_id': 'e7ef8006-ae0e-4a18-b5c7-707d13fb7031', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:42:29Z', 'updated_at': '2021-05-25T17:42:33Z', 'revision_number': 2, 'project_id': '5b2f6ca8c5b94c2f8894c04f297b5f8b', 'subnets': [{'id': 'e7ef8006-ae0e-4a18-b5c7-707d13fb7031', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-789564-2-iscsi', False) {} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:42:39.794105 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b9450522-6e5c-4425-b4ea-6760d1195944 None None] Checking router: df4629e6-3b17-47f3-88e4-022b915a6a91 for host: dv-cinder-789564-2-iscsi {{(pid=99028) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 25 17:42:39.795182 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b9450522-6e5c-4425-b4ea-6760d1195944 None None] Updating router df4629e6-3b17-47f3-88e4-022b915a6a91 port f7fc9e77-51db-43c8-9f03-ac0ca1040af2 binding host dv-cinder-789564-2-iscsi {{(pid=99028) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 25 17:42:39.887820 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-b9450522-6e5c-4425-b4ea-6760d1195944 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:39.916168 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron_lib.callbacks.manager [None req-6cb11c84-d312-4a7d-9782-3fca436b860d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99029) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:39.957257 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-c1255886-2c4e-4d60-b056-4e6d8e856d9f req-a4f169ab-a0c8-4925-b83e-1ad851c2fe17 service neutron] 10.222.0.125 "GET /v2.0/ports?network_id=58926b0f-c6c9-44b1-aa59-d580f9359c87&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.1532326
May 25 17:42:39.961030 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-55488421-bcf8-4368-a8e2-5f63dbd30e21 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1470792', 'neutron.services.segments.db._delete_segments_for_network-8781841233116'] for network, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:40.156140 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 40480) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:42:40.190394 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-3623f6a8-95a3-48c6-abc6-fb22d7f662db req-ed2c09f5-1d9b-46c0-81f4-e1db40ccade3 tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] 10.222.0.122 "GET /v2.0/security-groups?id=36f94dea-f495-4a32-ab2e-aef5450d5564&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.5613971
May 25 17:42:40.197363 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.v2.base [None req-be1ce22a-c346-4dfc-a8f7-5241a76a2eb2 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1086376336', 'description': 'tempest-description--1816896913'}} {{(pid=99027) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:42:40.230127 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-be1ce22a-c346-4dfc-a8f7-5241a76a2eb2 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:42:40.247276 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-be1ce22a-c346-4dfc-a8f7-5241a76a2eb2 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Usage tracker for resource:security_group and tenant:b4cdc54b260f4e79b87fdf4a43b12e16 is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:42:40.247276 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-be1ce22a-c346-4dfc-a8f7-5241a76a2eb2 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:42:40.276960 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-be1ce22a-c346-4dfc-a8f7-5241a76a2eb2 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:42:40.304912 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-c1255886-2c4e-4d60-b056-4e6d8e856d9f req-1a035cc2-af94-4fb8-a061-6b1c3c60d028 service neutron] 10.222.0.125 "GET /v2.0/networks/58926b0f-c6c9-44b1-aa59-d580f9359c87?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3335464
May 25 17:42:40.308554 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-64a436ed-5b64-426e-8449-fdfb20edc6d3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:40.310432 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.services.segments.db [None req-55488421-bcf8-4368-a8e2-5f63dbd30e21 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fcae6f56730>,) {'filters': {'network_id': ['ddc17283-66fe-4b17-b7ec-43aea38f7496']}} {{(pid=99026) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:42:40.349014 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6e0a943-86f9-41f6-bd28-c558d49f9891 req-f16473eb-c1af-4339-af02-316d7722ef50 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:42:40.355744 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-c6e0a943-86f9-41f6-bd28-c558d49f9891 req-f16473eb-c1af-4339-af02-316d7722ef50 service neutron] 10.222.0.125 "GET /v2.0/ports?tenant_id=5ae575cfd07c4a88aa626c15e6bccfd9&device_id=3fb3211e-48f5-46f5-8035-ddbc35109aa8 HTTP/1.1" status: 200  len: 1097 time: 0.6303568
May 25 17:42:40.370838 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-c384d012-fd13-489d-8474-3365467d3cb4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:40.403392 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.services.segments.db [None req-55488421-bcf8-4368-a8e2-5f63dbd30e21 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fcae6f56730>, '486f26bb-e6e6-4d42-9c99-59085f6a249d') {'for_net_delete': True} {{(pid=99026) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:42:40.403392 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.services.segments.db [None req-55488421-bcf8-4368-a8e2-5f63dbd30e21 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fcae6f56730>, '486f26bb-e6e6-4d42-9c99-59085f6a249d') {} {{(pid=99026) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:42:40.428371 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64a436ed-5b64-426e-8449-fdfb20edc6d3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=734ee5b7-dc08-426e-bff4-4c68a07d3457,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:40.440474 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-64a436ed-5b64-426e-8449-fdfb20edc6d3 admin admin] Notify callbacks [] for security_group, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:40.444660 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-64a436ed-5b64-426e-8449-fdfb20edc6d3 admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/734ee5b7-dc08-426e-bff4-4c68a07d3457 HTTP/1.1" status: 204  len: 168 time: 2.0842609
May 25 17:42:40.451911 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-64a436ed-5b64-426e-8449-fdfb20edc6d3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:40.516597 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-c6e0a943-86f9-41f6-bd28-c558d49f9891 req-0781a939-c0a0-4bbc-aeca-55de9e7bed1c service neutron] 10.222.0.125 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=4698ed19-7e41-4457-a1fd-16d5f606084a HTTP/1.1" status: 200  len: 217 time: 0.1517124
May 25 17:42:40.518062 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-be1ce22a-c346-4dfc-a8f7-5241a76a2eb2 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify callbacks [] for security_group, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:40.659193 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-55488421-bcf8-4368-a8e2-5f63dbd30e21 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8781841242525', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-14735041'] for segment, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:40.852640 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-be1ce22a-c346-4dfc-a8f7-5241a76a2eb2 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:42:40.893279 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-be1ce22a-c346-4dfc-a8f7-5241a76a2eb2 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Usage tracker for resource:security_group_rule and tenant:b4cdc54b260f4e79b87fdf4a43b12e16 is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:42:40.908762 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-be1ce22a-c346-4dfc-a8f7-5241a76a2eb2 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:42:40.925008 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-be1ce22a-c346-4dfc-a8f7-5241a76a2eb2 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:42:40.939533 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-55488421-bcf8-4368-a8e2-5f63dbd30e21 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1469168'] for segment, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:40.965057 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6e0a943-86f9-41f6-bd28-c558d49f9891 req-618f6035-1457-4885-b9b3-e96a6d3fd6dc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:42:40.966252 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-c6e0a943-86f9-41f6-bd28-c558d49f9891 req-618f6035-1457-4885-b9b3-e96a6d3fd6dc service neutron] 10.222.0.125 "GET /v2.0/subnets?id=279772c8-d366-4fc6-9c34-e6ddf99b5e08 HTTP/1.1" status: 200  len: 854 time: 0.4377263
May 25 17:42:40.973689 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-55488421-bcf8-4368-a8e2-5f63dbd30e21 admin admin] Releasing vlan 1323 on physical network physnet1 to pool {{(pid=99026) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 25 17:42:40.982016 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-55488421-bcf8-4368-a8e2-5f63dbd30e21 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1469168', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-15476589'] for segment, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:41.059177 dv-cinder-789564-2-iscsi neutron-server[99026]: Traceback (most recent call last):
May 25 17:42:41.059177 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 25 17:42:41.059177 dv-cinder-789564-2-iscsi neutron-server[99026]:     timer()
May 25 17:42:41.059177 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 25 17:42:41.059177 dv-cinder-789564-2-iscsi neutron-server[99026]:     cb(*args, **kw)
May 25 17:42:41.059177 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 25 17:42:41.059177 dv-cinder-789564-2-iscsi neutron-server[99026]:     return func(*args, **kwargs)
May 25 17:42:41.059177 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 25 17:42:41.059177 dv-cinder-789564-2-iscsi neutron-server[99026]:     self._notify()
May 25 17:42:41.059177 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 25 17:42:41.059177 dv-cinder-789564-2-iscsi neutron-server[99026]:     self.callback(batched_events)
May 25 17:42:41.059177 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 25 17:42:41.059177 dv-cinder-789564-2-iscsi neutron-server[99026]:     event.method(event)
May 25 17:42:41.059177 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 25 17:42:41.059177 dv-cinder-789564-2-iscsi neutron-server[99026]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 25 17:42:41.059177 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 25 17:42:41.059177 dv-cinder-789564-2-iscsi neutron-server[99026]:     aggregate_uuid = self.p_client.list_aggregates(
May 25 17:42:41.059177 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 25 17:42:41.059177 dv-cinder-789564-2-iscsi neutron-server[99026]:     return f(self, *a, **k)
May 25 17:42:41.059177 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 25 17:42:41.059177 dv-cinder-789564-2-iscsi neutron-server[99026]:     return self._get(url).json()
May 25 17:42:41.059177 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 25 17:42:41.059177 dv-cinder-789564-2-iscsi neutron-server[99026]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 25 17:42:41.059177 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 25 17:42:41.059177 dv-cinder-789564-2-iscsi neutron-server[99026]:     return self.request(url, 'GET', **kwargs)
May 25 17:42:41.059177 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 25 17:42:41.059177 dv-cinder-789564-2-iscsi neutron-server[99026]:     base_url = self.get_endpoint(auth, allow=allow,
May 25 17:42:41.059177 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 25 17:42:41.059177 dv-cinder-789564-2-iscsi neutron-server[99026]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 25 17:42:41.059177 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 25 17:42:41.059177 dv-cinder-789564-2-iscsi neutron-server[99026]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 25 17:42:41.059177 dv-cinder-789564-2-iscsi neutron-server[99026]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 25 17:42:41.064444 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron_lib.callbacks.manager [None req-6cb11c84-d312-4a7d-9782-3fca436b860d None None] Notify callbacks [] for port, precommit_update {{(pid=99029) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:41.124188 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.provisioning_blocks [None req-6cb11c84-d312-4a7d-9782-3fca436b860d None None] Transition to ACTIVE for port object d13f3233-9e09-41c7-8315-4eae735fe605 will not be triggered until provisioned by entity L2. {{(pid=99029) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 17:42:41.133650 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-c6e0a943-86f9-41f6-bd28-c558d49f9891 req-43f40b78-666b-4214-8ef7-d32c21cc534f service neutron] 10.222.0.125 "GET /v2.0/ports?network_id=6c7eca3b-72f3-4ba8-9e95-614d64496512&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.1283233
May 25 17:42:41.199726 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron_lib.callbacks.manager [None req-6cb11c84-d312-4a7d-9782-3fca436b860d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99029) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:41.203954 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-b9450522-6e5c-4425-b4ea-6760d1195944 None None] Notify callbacks [] for port, precommit_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:41.212258 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG oslo_concurrency.lockutils [None req-009906de-ed50-4a1c-a917-e873b47dabad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:41.230681 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea0c8084-2734-4f8b-9f01-2a2fac77f0db req-b595566f-98f5-43e7-8f64-b07de4ea4d43 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:42:41.239445 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-b9450522-6e5c-4425-b4ea-6760d1195944 None None] Transition to ACTIVE for port object f7fc9e77-51db-43c8-9f03-ac0ca1040af2 will not be triggered until provisioned by entity L2. {{(pid=99028) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 17:42:41.246173 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-ea0c8084-2734-4f8b-9f01-2a2fac77f0db req-b595566f-98f5-43e7-8f64-b07de4ea4d43 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/ports?device_id=3fb3211e-48f5-46f5-8035-ddbc35109aa8 HTTP/1.1" status: 200  len: 944 time: 0.6190307
May 25 17:42:41.321111 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-b9450522-6e5c-4425-b4ea-6760d1195944 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:41.326143 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:41.498349 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e09ea54-7149-4bbc-90c3-6c7bbcce8511 req-656eeed9-300f-4642-a035-c507af957642 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:42:41.504677 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-ea0c8084-2734-4f8b-9f01-2a2fac77f0db req-bd3402dd-cf1a-460a-bbda-e7a14f127388 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/security-groups?id=dda11ec6-545c-479e-bba9-4390fea678fa&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2560265
May 25 17:42:41.505497 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-8e09ea54-7149-4bbc-90c3-6c7bbcce8511 req-656eeed9-300f-4642-a035-c507af957642 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/networks?id=2abe381d-082b-4294-8193-c6556a56adb4 HTTP/1.1" status: 200  len: 818 time: 0.2982507
May 25 17:42:41.553533 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-8e09ea54-7149-4bbc-90c3-6c7bbcce8511 req-15e262e1-a990-4293-a2a9-85e19a3685ac tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/quotas/5b2f6ca8c5b94c2f8894c04f297b5f8b HTTP/1.1" status: 200  len: 375 time: 0.0393109
May 25 17:42:41.565996 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-be1ce22a-c346-4dfc-a8f7-5241a76a2eb2 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify callbacks [] for security_group, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:41.642631 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-c6e0a943-86f9-41f6-bd28-c558d49f9891 req-870fe4c8-e245-4e67-bbfd-f80700c6df14 service neutron] 10.222.0.125 "GET /v2.0/networks/6c7eca3b-72f3-4ba8-9e95-614d64496512?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3568308
May 25 17:42:41.651332 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-be1ce22a-c346-4dfc-a8f7-5241a76a2eb2 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:41.653930 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-144068ab-ac0d-4c3a-a29a-838c35f0f378 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:41.726167 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-c1255886-2c4e-4d60-b056-4e6d8e856d9f req-d50c8e1e-0df1-45f6-8fc9-4ca1ec5228df service neutron] 10.222.0.125 "GET /v2.0/networks/58926b0f-c6c9-44b1-aa59-d580f9359c87?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 1.4049850
May 25 17:42:41.769652 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [req-8e09ea54-7149-4bbc-90c3-6c7bbcce8511 req-508ddcff-b648-49d1-9ec6-f8d935ebf73e tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Synchronizing usage tracker for tenant:5b2f6ca8c5b94c2f8894c04f297b5f8b on resource:port {{(pid=99026) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 17:42:41.832217 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-55488421-bcf8-4368-a8e2-5f63dbd30e21 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1470785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-459299', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551400', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-419883'] for network, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:41.837553 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-e2834cad-64f1-429b-9df7-13c87f2ba45a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:41.872187 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d329346d-8f64-4913-a945-427009f9577d None None] Pushing event updated for resources: {'Port': ['ID=f7fc9e77-51db-43c8-9f03-ac0ca1040af2,revision_number=3']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:41.891235 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:41.897784 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-d329346d-8f64-4913-a945-427009f9577d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.566s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:41.906242 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6f378ce-bf3a-47a0-82f9-664f9dfa448d None None] Pushing event updated for resources: {'Port': ['ID=d13f3233-9e09-41c7-8315-4eae735fe605,revision_number=3']} {{(pid=99029) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:41.909319 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-55488421-bcf8-4368-a8e2-5f63dbd30e21 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for network, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:41.916696 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55488421-bcf8-4368-a8e2-5f63dbd30e21 admin admin] Pushing event deleted for resources: {'Network': ['ID=ddc17283-66fe-4b17-b7ec-43aea38f7496,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:41.918667 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG oslo_concurrency.lockutils [None req-d6f378ce-bf3a-47a0-82f9-664f9dfa448d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.708s {{(pid=99029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:41.925933 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-55488421-bcf8-4368-a8e2-5f63dbd30e21 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:41.941404 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-55488421-bcf8-4368-a8e2-5f63dbd30e21 admin admin] 10.222.0.122 "DELETE /v2.0/networks/ddc17283-66fe-4b17-b7ec-43aea38f7496 HTTP/1.1" status: 204  len: 168 time: 3.0057292
May 25 17:42:41.958318 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.managers [None req-b9450522-6e5c-4425-b4ea-6760d1195944 None None] Attempting to bind port f7fc9e77-51db-43c8-9f03-ac0ca1040af2 on host dv-cinder-789564-2-iscsi for vnic_type normal with profile  {{(pid=99028) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 17:42:41.958701 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.managers [None req-b9450522-6e5c-4425-b4ea-6760d1195944 None None] Attempting to bind port f7fc9e77-51db-43c8-9f03-ac0ca1040af2 by drivers openvswitch,hyperv on host dv-cinder-789564-2-iscsi at level 0 using segments [{'id': 'd619a116-4277-4bad-a1ec-8ca0357dd129', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1329, 'network_id': '2abe381d-082b-4294-8193-c6556a56adb4'}] {{(pid=99028) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 17:42:41.959059 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b9450522-6e5c-4425-b4ea-6760d1195944 None None] Attempting to bind port f7fc9e77-51db-43c8-9f03-ac0ca1040af2 on network 2abe381d-082b-4294-8193-c6556a56adb4 {{(pid=99028) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 17:42:41.960618 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [req-8e09ea54-7149-4bbc-90c3-6c7bbcce8511 req-508ddcff-b648-49d1-9ec6-f8d935ebf73e tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Unset dirty status for tenant:5b2f6ca8c5b94c2f8894c04f297b5f8b on resource:port {{(pid=99026) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 17:42:41.962645 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-8e09ea54-7149-4bbc-90c3-6c7bbcce8511 req-508ddcff-b648-49d1-9ec6-f8d935ebf73e tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?tenant_id=5b2f6ca8c5b94c2f8894c04f297b5f8b&fields=id HTTP/1.1" status: 200  len: 255 time: 0.4159105
May 25 17:42:41.984754 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b9450522-6e5c-4425-b4ea-6760d1195944 None None] Checking agent: {'id': '7bb67520-1e97-4ad9-9b97-101068bbe1a3', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-789564-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 17, 34, 21), 'started_at': datetime.datetime(2021, 5, 25, 17, 34, 51), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 17, 42, 21), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-789564-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=99028) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 17:42:41.985185 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b9450522-6e5c-4425-b4ea-6760d1195944 None None] Checking segment: {'id': 'd619a116-4277-4bad-a1ec-8ca0357dd129', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1329, 'network_id': '2abe381d-082b-4294-8193-c6556a56adb4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=99028) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 17:42:41.985601 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-b9450522-6e5c-4425-b4ea-6760d1195944 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:41.986001 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b9450522-6e5c-4425-b4ea-6760d1195944 None None] Bound using segment: {'id': 'd619a116-4277-4bad-a1ec-8ca0357dd129', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1329, 'network_id': '2abe381d-082b-4294-8193-c6556a56adb4'} {{(pid=99028) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 17:42:41.986509 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.managers [None req-b9450522-6e5c-4425-b4ea-6760d1195944 None None] Bound port: f7fc9e77-51db-43c8-9f03-ac0ca1040af2, host: dv-cinder-789564-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd619a116-4277-4bad-a1ec-8ca0357dd129', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1329, 'network_id': '2abe381d-082b-4294-8193-c6556a56adb4'}}] {{(pid=99028) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 17:42:41.986918 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-b9450522-6e5c-4425-b4ea-6760d1195944 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:42.066936 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be1ce22a-c346-4dfc-a8f7-5241a76a2eb2 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Pushing event updated for resources: {'SecurityGroup': ['ID=82248efd-bb41-43a8-9551-d25c3e3aa06c,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:42.072839 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.plugins.ml2.managers [None req-6cb11c84-d312-4a7d-9782-3fca436b860d None None] Attempting to bind port d13f3233-9e09-41c7-8315-4eae735fe605 on host dv-cinder-789564-2-iscsi for vnic_type normal with profile  {{(pid=99029) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 17:42:42.073408 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-be1ce22a-c346-4dfc-a8f7-5241a76a2eb2 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.419s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:42.073501 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.plugins.ml2.managers [None req-6cb11c84-d312-4a7d-9782-3fca436b860d None None] Attempting to bind port d13f3233-9e09-41c7-8315-4eae735fe605 by drivers openvswitch,hyperv on host dv-cinder-789564-2-iscsi at level 0 using segments [{'id': '9ffd894c-b357-4c03-93af-a222f8984466', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1316, 'network_id': 'defaef08-c0f9-4608-b66d-b97e06e185bf'}] {{(pid=99029) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 17:42:42.075214 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6cb11c84-d312-4a7d-9782-3fca436b860d None None] Attempting to bind port d13f3233-9e09-41c7-8315-4eae735fe605 on network defaef08-c0f9-4608-b66d-b97e06e185bf {{(pid=99029) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 17:42:42.093097 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6cb11c84-d312-4a7d-9782-3fca436b860d None None] Checking agent: {'id': '7bb67520-1e97-4ad9-9b97-101068bbe1a3', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-789564-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 17, 34, 21), 'started_at': datetime.datetime(2021, 5, 25, 17, 34, 51), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 17, 42, 21), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-789564-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=99029) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 17:42:42.093706 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6cb11c84-d312-4a7d-9782-3fca436b860d None None] Checking segment: {'id': '9ffd894c-b357-4c03-93af-a222f8984466', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1316, 'network_id': 'defaef08-c0f9-4608-b66d-b97e06e185bf'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=99029) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 17:42:42.094202 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron_lib.callbacks.manager [None req-6cb11c84-d312-4a7d-9782-3fca436b860d None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=99029) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:42.094677 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6cb11c84-d312-4a7d-9782-3fca436b860d None None] Bound using segment: {'id': '9ffd894c-b357-4c03-93af-a222f8984466', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1316, 'network_id': 'defaef08-c0f9-4608-b66d-b97e06e185bf'} {{(pid=99029) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 17:42:42.095242 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.plugins.ml2.managers [None req-6cb11c84-d312-4a7d-9782-3fca436b860d None None] Bound port: d13f3233-9e09-41c7-8315-4eae735fe605, host: dv-cinder-789564-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9ffd894c-b357-4c03-93af-a222f8984466', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1316, 'network_id': 'defaef08-c0f9-4608-b66d-b97e06e185bf'}}] {{(pid=99029) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 17:42:42.095703 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron_lib.callbacks.manager [None req-6cb11c84-d312-4a7d-9782-3fca436b860d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99029) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:42.160074 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-b9450522-6e5c-4425-b4ea-6760d1195944 None None] For port f7fc9e77-51db-43c8-9f03-ac0ca1040af2, host dv-cinder-789564-2-iscsi, cleared binding levels {{(pid=99028) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 17:42:42.171054 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-b9450522-6e5c-4425-b4ea-6760d1195944 None None] For port f7fc9e77-51db-43c8-9f03-ac0ca1040af2, host dv-cinder-789564-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=f7fc9e77-51db-43c8-9f03-ac0ca1040af2,segment=NetworkSegment(d619a116-4277-4bad-a1ec-8ca0357dd129),segment_id=d619a116-4277-4bad-a1ec-8ca0357dd129)] {{(pid=99028) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 17:42:42.177482 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-be1ce22a-c346-4dfc-a8f7-5241a76a2eb2 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify callbacks [] for security_group, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:42.187016 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-be1ce22a-c346-4dfc-a8f7-5241a76a2eb2 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] 10.222.0.122 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1780 time: 2.0172024
May 25 17:42:42.188146 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-c6e0a943-86f9-41f6-bd28-c558d49f9891 req-086d5449-fd5d-48c7-8e58-ac7bab48fa6f service neutron] 10.222.0.125 "GET /v2.0/networks/6c7eca3b-72f3-4ba8-9e95-614d64496512?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.5353019
May 25 17:42:42.189543 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 40532) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:42:42.200460 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.v2.base [None req-70e711d7-5e4a-4e3d-b90a-9a765026fc1e tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Request body: {'security_group_rule': {'security_group_id': '82248efd-bb41-43a8-9551-d25c3e3aa06c', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=99027) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:42:42.219955 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-70e711d7-5e4a-4e3d-b90a-9a765026fc1e tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:42:42.227491 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-70e711d7-5e4a-4e3d-b90a-9a765026fc1e tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Usage tracker for resource:security_group_rule and tenant:b4cdc54b260f4e79b87fdf4a43b12e16 is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:42:42.228582 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.plugins.ml2.db [None req-6cb11c84-d312-4a7d-9782-3fca436b860d None None] For port d13f3233-9e09-41c7-8315-4eae735fe605, host dv-cinder-789564-2-iscsi, cleared binding levels {{(pid=99029) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 17:42:42.234359 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.plugins.ml2.db [None req-6cb11c84-d312-4a7d-9782-3fca436b860d None None] For port d13f3233-9e09-41c7-8315-4eae735fe605, host dv-cinder-789564-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=d13f3233-9e09-41c7-8315-4eae735fe605,segment=NetworkSegment(9ffd894c-b357-4c03-93af-a222f8984466),segment_id=9ffd894c-b357-4c03-93af-a222f8984466)] {{(pid=99029) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 17:42:42.245306 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-70e711d7-5e4a-4e3d-b90a-9a765026fc1e tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:42:42.252400 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-70e711d7-5e4a-4e3d-b90a-9a765026fc1e tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:42:42.276495 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 40536) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:42:42.332462 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-b9450522-6e5c-4425-b4ea-6760d1195944 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:42.336250 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-8e09ea54-7149-4bbc-90c3-6c7bbcce8511 req-9197e854-0087-48bc-90c0-89a569f7da39 service neutron] 10.222.0.122 "GET /v2.0/networks/2abe381d-082b-4294-8193-c6556a56adb4?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3469510
May 25 17:42:42.341930 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:42.371525 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron_lib.callbacks.manager [None req-6cb11c84-d312-4a7d-9782-3fca436b860d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99029) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:42.378785 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'cab9bd8d-5b7a-4fc2-85cd-9d4f9884b4ee', 'tag': '4d583d58-a3d8-4d10-883a-5959fa74e40c', 'status': 'completed', 'code': 200}
May 25 17:42:42.383029 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG oslo_concurrency.lockutils [None req-009906de-ed50-4a1c-a917-e873b47dabad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:42.385866 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-70e711d7-5e4a-4e3d-b90a-9a765026fc1e tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify callbacks [] for security_group_rule, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:42.429741 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b9450522-6e5c-4425-b4ea-6760d1195944 None None] Routers {'df4629e6-3b17-47f3-88e4-022b915a6a91'} bound to L3 agent in host dv-cinder-789564-2-iscsi {{(pid=99028) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 17:42:42.430530 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-b9450522-6e5c-4425-b4ea-6760d1195944 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcae70acc10>, 'dv-cinder-789564-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-25T17:34:21Z,description=<?>,heartbeat_timestamp=2021-05-25T17:42:21Z,host='dv-cinder-789564-2-iscsi',id=eaeb6875-c4ed-43b6-8658-aa4e52324fdf,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T17:34:21Z,topic='l3_agent')) {'router_ids': ['df4629e6-3b17-47f3-88e4-022b915a6a91'], 'active': True} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:42:42.533369 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d329346d-8f64-4913-a945-427009f9577d None None] Pushing event updated for resources: {'Port': ['ID=f7fc9e77-51db-43c8-9f03-ac0ca1040af2,revision_number=4']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:42.540339 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6f378ce-bf3a-47a0-82f9-664f9dfa448d None None] Pushing event updated for resources: {'Port': ['ID=d13f3233-9e09-41c7-8315-4eae735fe605,revision_number=4']} {{(pid=99029) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:42.543519 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG oslo_concurrency.lockutils [None req-d6f378ce-bf3a-47a0-82f9-664f9dfa448d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.161s {{(pid=99029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:42.546250 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-d329346d-8f64-4913-a945-427009f9577d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.207s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:42.566452 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6cb11c84-d312-4a7d-9782-3fca436b860d None None] Routers {'d71e624d-d858-442b-b878-577be49edd03'} bound to L3 agent in host dv-cinder-789564-2-iscsi {{(pid=99029) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 17:42:42.581461 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_hamode_db [None req-6cb11c84-d312-4a7d-9782-3fca436b860d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcae72268e0>, 'dv-cinder-789564-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-25T17:34:21Z,description=<?>,heartbeat_timestamp=2021-05-25T17:42:21Z,host='dv-cinder-789564-2-iscsi',id=eaeb6875-c4ed-43b6-8658-aa4e52324fdf,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T17:34:21Z,topic='l3_agent')) {'router_ids': ['d71e624d-d858-442b-b878-577be49edd03'], 'active': True} {{(pid=99029) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:42:42.643912 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 40548) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:42:42.688595 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-8e09ea54-7149-4bbc-90c3-6c7bbcce8511 req-a5f798df-4de5-4c1b-8795-efc6026d1bc6 service neutron] 10.222.0.122 "GET /v2.0/networks/2abe381d-082b-4294-8193-c6556a56adb4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3500664
May 25 17:42:42.776168 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvr_db [None req-b9450522-6e5c-4425-b4ea-6760d1195944 None None] Set router df4629e6-3b17-47f3-88e4-022b915a6a91 gateway port host: dv-cinder-789564-2-iscsi {{(pid=99028) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 17:42:42.783912 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-b69984ae-83f0-4cc6-937e-92a681c39e86 admin admin] Notify callbacks [] for security_group, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:42.830165 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-b69984ae-83f0-4cc6-937e-92a681c39e86 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:42:42.834767 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-b69984ae-83f0-4cc6-937e-92a681c39e86 admin admin] Usage tracker for resource:security_group_rule and tenant:95bba96fac784b628847b9b53b8fe9ce is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:42:42.838845 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-b69984ae-83f0-4cc6-937e-92a681c39e86 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:42:42.845962 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-b69984ae-83f0-4cc6-937e-92a681c39e86 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:42:42.855051 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 40552) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:42:43.060589 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-b5665a8c-b67c-4c46-a988-da72f8b35f77 admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=834c78f6fe1e4da3bcaa284865200eb2&name=default HTTP/1.1" status: 200  len: 2975 time: 0.2040603
May 25 17:42:43.062302 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 40560) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:42:43.111449 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_dvr_db [None req-6cb11c84-d312-4a7d-9782-3fca436b860d None None] Set router d71e624d-d858-442b-b878-577be49edd03 gateway port host: dv-cinder-789564-2-iscsi {{(pid=99029) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 17:42:43.188965 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-b69984ae-83f0-4cc6-937e-92a681c39e86 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:43.247963 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-dfbe0f60-56d0-46a7-8e0d-4d61940b91a2 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:43.305298 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-98d4b6d9-4eae-484e-b05e-107b61dc8853 admin admin] Notify callbacks [] for security_group, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:43.342167 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-98d4b6d9-4eae-484e-b05e-107b61dc8853 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:42:43.347766 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-98d4b6d9-4eae-484e-b05e-107b61dc8853 admin admin] Usage tracker for resource:security_group_rule and tenant:fdf5bad451cc41b7ab36274ee82ee987 is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:42:43.352546 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-98d4b6d9-4eae-484e-b05e-107b61dc8853 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:42:43.359258 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-b69984ae-83f0-4cc6-937e-92a681c39e86 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:43.366517 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-98d4b6d9-4eae-484e-b05e-107b61dc8853 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:42:43.417455 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:43.432767 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-dfbe0f60-56d0-46a7-8e0d-4d61940b91a2 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:43.455107 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-b69984ae-83f0-4cc6-937e-92a681c39e86 admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=95bba96fac784b628847b9b53b8fe9ce&name=default HTTP/1.1" status: 200  len: 2979 time: 0.8006897
May 25 17:42:43.458557 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-70e711d7-5e4a-4e3d-b90a-9a765026fc1e tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:43.463498 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 40568) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:42:43.463929 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b69984ae-83f0-4cc6-937e-92a681c39e86 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a1f4fd75-698a-441a-9058-cf59786d7d43,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:43.493158 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-b69984ae-83f0-4cc6-937e-92a681c39e86 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:43.497074 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f91d711-39c8-4333-b2de-3e9eb5db4d23 req-76185a68-1d07-41ee-9ea8-0a8130e212c3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:42:43.508024 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-7f91d711-39c8-4333-b2de-3e9eb5db4d23 req-76185a68-1d07-41ee-9ea8-0a8130e212c3 service neutron] 10.222.0.125 "GET /v2.0/ports?tenant_id=fb338a290a2242fea3a4b8ae2bc4a14c&device_id=cab9bd8d-5b7a-4fc2-85cd-9d4f9884b4ee HTTP/1.1" status: 200  len: 1097 time: 1.0853245
May 25 17:42:43.687693 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8ccd413-697e-4fd8-92fc-0b4b4ce218fd req-a213aabd-f09b-4f45-babb-be65681d7493 tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:42:43.700312 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-f8ccd413-697e-4fd8-92fc-0b4b4ce218fd req-a213aabd-f09b-4f45-babb-be65681d7493 tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] 10.222.0.122 "GET /v2.0/ports?device_id=cab9bd8d-5b7a-4fc2-85cd-9d4f9884b4ee HTTP/1.1" status: 200  len: 944 time: 0.4192891
May 25 17:42:43.807676 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_hamode_db [None req-6cb11c84-d312-4a7d-9782-3fca436b860d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcae72268e0>, [{'id': 'd71e624d-d858-442b-b878-577be49edd03', 'name': 'tempest-AttachVolumeTestJSON-1986395052-router', 'tenant_id': 'b4cdc54b260f4e79b87fdf4a43b12e16', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.176'}], 'enable_snat': True}, 'gw_port_id': '9635c7b0-eb08-41ee-980e-3da56221f88d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:42:22Z', 'updated_at': '2021-05-25T17:42:34Z', 'revision_number': 4, 'project_id': 'b4cdc54b260f4e79b87fdf4a43b12e16', 'gw_port': {'id': '9635c7b0-eb08-41ee-980e-3da56221f88d', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:44:59', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd71e624d-d858-442b-b878-577be49edd03', 'device_owner': 'network:router_gateway', 'standard_attr_id': 80, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.176', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:42:23Z', 'updated_at': '2021-05-25T17:42:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi', '_interfaces': [{'id': 'd13f3233-9e09-41c7-8315-4eae735fe605', 'name': '', 'network_id': 'defaef08-c0f9-4608-b66d-b97e06e185bf', 'tenant_id': 'b4cdc54b260f4e79b87fdf4a43b12e16', 'mac_address': 'fa:16:3e:87:b7:74', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd71e624d-d858-442b-b878-577be49edd03', 'device_owner': 'network:router_interface', 'standard_attr_id': 106, 'fixed_ips': [{'subnet_id': '5be08358-9d04-4ee9-91ac-104e66e66e20', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:42:29Z', 'updated_at': '2021-05-25T17:42:42Z', 'revision_number': 4, 'project_id': 'b4cdc54b260f4e79b87fdf4a43b12e16', 'subnets': [{'id': '5be08358-9d04-4ee9-91ac-104e66e66e20', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-789564-2-iscsi', False) {} {{(pid=99029) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:42:43.827050 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6cb11c84-d312-4a7d-9782-3fca436b860d None None] The sync data for ids ['d71e624d-d858-442b-b878-577be49edd03'] in dv-cinder-789564-2-iscsi is: [{'id': 'd71e624d-d858-442b-b878-577be49edd03', 'name': 'tempest-AttachVolumeTestJSON-1986395052-router', 'tenant_id': 'b4cdc54b260f4e79b87fdf4a43b12e16', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.176'}], 'enable_snat': True}, 'gw_port_id': '9635c7b0-eb08-41ee-980e-3da56221f88d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:42:22Z', 'updated_at': '2021-05-25T17:42:34Z', 'revision_number': 4, 'project_id': 'b4cdc54b260f4e79b87fdf4a43b12e16', 'gw_port': {'id': '9635c7b0-eb08-41ee-980e-3da56221f88d', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:44:59', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd71e624d-d858-442b-b878-577be49edd03', 'device_owner': 'network:router_gateway', 'standard_attr_id': 80, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.176', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:42:23Z', 'updated_at': '2021-05-25T17:42:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi', '_interfaces': [{'id': 'd13f3233-9e09-41c7-8315-4eae735fe605', 'name': '', 'network_id': 'defaef08-c0f9-4608-b66d-b97e06e185bf', 'tenant_id': 'b4cdc54b260f4e79b87fdf4a43b12e16', 'mac_address': 'fa:16:3e:87:b7:74', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd71e624d-d858-442b-b878-577be49edd03', 'device_owner': 'network:router_interface', 'standard_attr_id': 106, 'fixed_ips': [{'subnet_id': '5be08358-9d04-4ee9-91ac-104e66e66e20', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:42:29Z', 'updated_at': '2021-05-25T17:42:42Z', 'revision_number': 4, 'project_id': 'b4cdc54b260f4e79b87fdf4a43b12e16', 'subnets': [{'id': '5be08358-9d04-4ee9-91ac-104e66e66e20', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=99029) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 25 17:42:43.874486 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 40574) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:42:43.888868 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-d6761d2d-e0c5-437e-9370-cbd5c1ece0c9 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:43.888868 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-dfbe0f60-56d0-46a7-8e0d-4d61940b91a2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:43.924834 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f91d711-39c8-4333-b2de-3e9eb5db4d23 req-afb184e8-6f45-4083-af15-ea01e034cbe9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:42:43.926560 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-7f91d711-39c8-4333-b2de-3e9eb5db4d23 req-afb184e8-6f45-4083-af15-ea01e034cbe9 service neutron] 10.222.0.125 "GET /v2.0/networks?id=58926b0f-c6c9-44b1-aa59-d580f9359c87 HTTP/1.1" status: 200  len: 914 time: 0.4123645
May 25 17:42:43.933212 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '3fb3211e-48f5-46f5-8035-ddbc35109aa8', 'tag': '4698ed19-7e41-4457-a1fd-16d5f606084a', 'status': 'completed', 'code': 200}
May 25 17:42:43.937446 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-b9450522-6e5c-4425-b4ea-6760d1195944 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcae70acc10>, [{'id': 'df4629e6-3b17-47f3-88e4-022b915a6a91', 'name': 'tempest-ServerRescueNegativeTestJSON-301463405-router', 'tenant_id': '5b2f6ca8c5b94c2f8894c04f297b5f8b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.206'}], 'enable_snat': True}, 'gw_port_id': 'ba3fdf48-5b50-4a04-9bed-01d9f2c8cf44', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:42:21Z', 'updated_at': '2021-05-25T17:42:31Z', 'revision_number': 4, 'project_id': '5b2f6ca8c5b94c2f8894c04f297b5f8b', 'gw_port': {'id': 'ba3fdf48-5b50-4a04-9bed-01d9f2c8cf44', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:8b:8e:8a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'df4629e6-3b17-47f3-88e4-022b915a6a91', 'device_owner': 'network:router_gateway', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.206', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:42:22Z', 'updated_at': '2021-05-25T17:42:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi', '_interfaces': [{'id': 'f7fc9e77-51db-43c8-9f03-ac0ca1040af2', 'name': '', 'network_id': '2abe381d-082b-4294-8193-c6556a56adb4', 'tenant_id': '5b2f6ca8c5b94c2f8894c04f297b5f8b', 'mac_address': 'fa:16:3e:f6:81:12', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'df4629e6-3b17-47f3-88e4-022b915a6a91', 'device_owner': 'network:router_interface', 'standard_attr_id': 105, 'fixed_ips': [{'subnet_id': 'e7ef8006-ae0e-4a18-b5c7-707d13fb7031', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:42:29Z', 'updated_at': '2021-05-25T17:42:42Z', 'revision_number': 4, 'project_id': '5b2f6ca8c5b94c2f8894c04f297b5f8b', 'subnets': [{'id': 'e7ef8006-ae0e-4a18-b5c7-707d13fb7031', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-789564-2-iscsi', False) {} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:42:43.964976 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b9450522-6e5c-4425-b4ea-6760d1195944 None None] The sync data for ids ['df4629e6-3b17-47f3-88e4-022b915a6a91'] in dv-cinder-789564-2-iscsi is: [{'id': 'df4629e6-3b17-47f3-88e4-022b915a6a91', 'name': 'tempest-ServerRescueNegativeTestJSON-301463405-router', 'tenant_id': '5b2f6ca8c5b94c2f8894c04f297b5f8b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.206'}], 'enable_snat': True}, 'gw_port_id': 'ba3fdf48-5b50-4a04-9bed-01d9f2c8cf44', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:42:21Z', 'updated_at': '2021-05-25T17:42:31Z', 'revision_number': 4, 'project_id': '5b2f6ca8c5b94c2f8894c04f297b5f8b', 'gw_port': {'id': 'ba3fdf48-5b50-4a04-9bed-01d9f2c8cf44', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:8b:8e:8a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'df4629e6-3b17-47f3-88e4-022b915a6a91', 'device_owner': 'network:router_gateway', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.206', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:42:22Z', 'updated_at': '2021-05-25T17:42:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi', '_interfaces': [{'id': 'f7fc9e77-51db-43c8-9f03-ac0ca1040af2', 'name': '', 'network_id': '2abe381d-082b-4294-8193-c6556a56adb4', 'tenant_id': '5b2f6ca8c5b94c2f8894c04f297b5f8b', 'mac_address': 'fa:16:3e:f6:81:12', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'df4629e6-3b17-47f3-88e4-022b915a6a91', 'device_owner': 'network:router_interface', 'standard_attr_id': 105, 'fixed_ips': [{'subnet_id': 'e7ef8006-ae0e-4a18-b5c7-707d13fb7031', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:42:29Z', 'updated_at': '2021-05-25T17:42:42Z', 'revision_number': 4, 'project_id': '5b2f6ca8c5b94c2f8894c04f297b5f8b', 'subnets': [{'id': 'e7ef8006-ae0e-4a18-b5c7-707d13fb7031', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=99028) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 25 17:42:43.984392 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:44.010299 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-70e711d7-5e4a-4e3d-b90a-9a765026fc1e tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459369'] for security_group_rule, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:44.123917 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-7f91d711-39c8-4333-b2de-3e9eb5db4d23 req-d8fc8d61-6439-446e-a0d8-f73c28fc3651 service neutron] 10.222.0.125 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=4d583d58-a3d8-4d10-883a-5959fa74e40c HTTP/1.1" status: 200  len: 217 time: 0.1049945
May 25 17:42:44.128589 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:44.148301 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70e711d7-5e4a-4e3d-b90a-9a765026fc1e tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e11a9cf1-b381-4c6d-abc4-42d7565b25d8,revision_number=0']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:44.152103 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-70e711d7-5e4a-4e3d-b90a-9a765026fc1e tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:44.161638 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-d6761d2d-e0c5-437e-9370-cbd5c1ece0c9 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:44.314650 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3787b114-abfb-4f28-aa58-ee6809b9d1d8 req-a3f28e2b-3e15-480f-9557-5e9dced536db tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:42:44.323718 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-3787b114-abfb-4f28-aa58-ee6809b9d1d8 req-a3f28e2b-3e15-480f-9557-5e9dced536db tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/ports?device_id=3fb3211e-48f5-46f5-8035-ddbc35109aa8 HTTP/1.1" status: 200  len: 944 time: 0.3893664
May 25 17:42:44.331379 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dfbe0f60-56d0-46a7-8e0d-4d61940b91a2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6726d4e1-f2e8-454c-8eb5-fe9d63052d6d,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:44.341191 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-dfbe0f60-56d0-46a7-8e0d-4d61940b91a2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.360s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:44.354956 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-f8ccd413-697e-4fd8-92fc-0b4b4ce218fd req-9defc532-bf76-4b84-905a-fed3f16a66de tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] 10.222.0.122 "GET /v2.0/security-groups?id=36f94dea-f495-4a32-ab2e-aef5450d5564&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.6534936
May 25 17:42:44.402771 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-dfbe0f60-56d0-46a7-8e0d-4d61940b91a2 admin admin] Notify callbacks [] for security_group, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:44.406348 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-dfbe0f60-56d0-46a7-8e0d-4d61940b91a2 admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/6726d4e1-f2e8-454c-8eb5-fe9d63052d6d HTTP/1.1" status: 204  len: 168 time: 1.3401096
May 25 17:42:44.424570 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-d6761d2d-e0c5-437e-9370-cbd5c1ece0c9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:44.436234 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f91d711-39c8-4333-b2de-3e9eb5db4d23 req-d2fd2771-f70b-412a-8be4-d83fdeba401c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:42:44.441467 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-7f91d711-39c8-4333-b2de-3e9eb5db4d23 req-d2fd2771-f70b-412a-8be4-d83fdeba401c service neutron] 10.222.0.125 "GET /v2.0/subnets?id=d821d422-628c-4d27-a03e-94485f09826d HTTP/1.1" status: 200  len: 852 time: 0.2753925
May 25 17:42:44.443314 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-a0e97967-1c8c-4a7b-b4e5-8e3874549a2c admin admin] Notify callbacks [] for security_group, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:44.456944 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-70e711d7-5e4a-4e3d-b90a-9a765026fc1e tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify callbacks [] for security_group_rule, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:44.461778 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-70e711d7-5e4a-4e3d-b90a-9a765026fc1e tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] 10.222.0.122 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 2.2675977
May 25 17:42:44.473698 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-3787b114-abfb-4f28-aa58-ee6809b9d1d8 req-fd2471df-ba7c-4ea8-8a3b-6e9a4cf8d37f tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/security-groups?id=dda11ec6-545c-479e-bba9-4390fea678fa&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1466837
May 25 17:42:44.493317 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 40584) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:42:44.498887 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-6905bc89-ce83-4675-b350-0c8385a730af admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:44.574332 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-7f91d711-39c8-4333-b2de-3e9eb5db4d23 req-2417e65a-0f78-42da-8e72-4895a872f45b service neutron] 10.222.0.125 "GET /v2.0/ports?network_id=58926b0f-c6c9-44b1-aa59-d580f9359c87&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.1125085
May 25 17:42:44.601113 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.v2.base [None req-4e3b8941-aa53-4df2-b5cb-663c9ef9d34d tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Request body: {'security_group_rule': {'security_group_id': '82248efd-bb41-43a8-9551-d25c3e3aa06c', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=99026) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:42:44.615091 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-a0e97967-1c8c-4a7b-b4e5-8e3874549a2c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:42:44.628010 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6761d2d-e0c5-437e-9370-cbd5c1ece0c9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a1f4fd75-698a-441a-9058-cf59786d7d43,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:44.630528 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-d6761d2d-e0c5-437e-9370-cbd5c1ece0c9 admin admin] Notify callbacks [] for security_group, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:44.640148 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-d6761d2d-e0c5-437e-9370-cbd5c1ece0c9 admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/a1f4fd75-698a-441a-9058-cf59786d7d43 HTTP/1.1" status: 204  len: 168 time: 1.1692824
May 25 17:42:44.665773 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-98d4b6d9-4eae-484e-b05e-107b61dc8853 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:44.703622 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-d6761d2d-e0c5-437e-9370-cbd5c1ece0c9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.202s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:44.715066 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-4e3b8941-aa53-4df2-b5cb-663c9ef9d34d tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:42:44.745326 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-4e3b8941-aa53-4df2-b5cb-663c9ef9d34d tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Usage tracker for resource:security_group_rule and tenant:b4cdc54b260f4e79b87fdf4a43b12e16 is out of sync, need to count used quota {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:42:44.759429 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-4e3b8941-aa53-4df2-b5cb-663c9ef9d34d tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:42:44.775534 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-4e3b8941-aa53-4df2-b5cb-663c9ef9d34d tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:42:44.793582 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-ab12c56f-5ab8-492c-a9f0-c733d203492c req-cd39dcfa-0592-4dc3-9d66-f63656ed55b0 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=432d7a94-0218-4907-bc7c-650f24a5b1e1 HTTP/1.1" status: 200  len: 210 time: 0.2956893
May 25 17:42:44.815491 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-a0e97967-1c8c-4a7b-b4e5-8e3874549a2c admin admin] Usage tracker for resource:security_group_rule and tenant:7db46e32dded47f0aca259d541ded76d is out of sync, need to count used quota {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:42:44.836477 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-a0e97967-1c8c-4a7b-b4e5-8e3874549a2c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:42:44.859775 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-a0e97967-1c8c-4a7b-b4e5-8e3874549a2c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:42:44.872653 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-98d4b6d9-4eae-484e-b05e-107b61dc8853 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:44.872887 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8dedff9f-4b94-438b-992d-64a73733bc20 req-01f124ce-0734-431c-a504-113ee0963a66 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:42:44.872887 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-8dedff9f-4b94-438b-992d-64a73733bc20 req-01f124ce-0734-431c-a504-113ee0963a66 service neutron] 10.222.0.125 "GET /v2.0/ports?tenant_id=5ae575cfd07c4a88aa626c15e6bccfd9&device_id=3fb3211e-48f5-46f5-8035-ddbc35109aa8 HTTP/1.1" status: 200  len: 1097 time: 1.2276266
May 25 17:42:44.913108 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-dfbad891-e0b2-41f0-964b-21548010ee3f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:44.986611 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-98d4b6d9-4eae-484e-b05e-107b61dc8853 admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=fdf5bad451cc41b7ab36274ee82ee987&name=default HTTP/1.1" status: 200  len: 2979 time: 2.7088783
May 25 17:42:44.993364 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 40596) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:42:45.262574 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98d4b6d9-4eae-484e-b05e-107b61dc8853 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=59bb74bc-2925-4fe4-887e-3b8b92501978,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:45.262574 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-98d4b6d9-4eae-484e-b05e-107b61dc8853 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.350s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:45.321703 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-7f91d711-39c8-4333-b2de-3e9eb5db4d23 req-66bff314-1704-4bf5-81d7-1010c2ab5915 service neutron] 10.222.0.125 "GET /v2.0/networks/58926b0f-c6c9-44b1-aa59-d580f9359c87?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.7100239
May 25 17:42:45.324987 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-4e3b8941-aa53-4df2-b5cb-663c9ef9d34d tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify callbacks [] for security_group_rule, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:45.396611 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device d13f3233-9e09-41c7-8315-4eae735fe605 up at agent ovs-agent-dv-cinder-789564-2-iscsi {{(pid=99028) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 17:42:45.609908 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-a0e97967-1c8c-4a7b-b4e5-8e3874549a2c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:45.697175 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-7f91d711-39c8-4333-b2de-3e9eb5db4d23 req-d2a108c9-6175-4785-8e5b-a84fcb40133b service neutron] 10.222.0.125 "GET /v2.0/networks/58926b0f-c6c9-44b1-aa59-d580f9359c87?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3611352
May 25 17:42:45.753938 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Provisioning for port d13f3233-9e09-41c7-8315-4eae735fe605 completed by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 17:42:45.767890 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Provisioning complete for port d13f3233-9e09-41c7-8315-4eae735fe605 triggered by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 17:42:45.768527 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:45.777130 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-d8ee53c9-73f0-468f-af02-1274c1673fbc admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:45.781651 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 40618) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:42:45.802730 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-4e3b8941-aa53-4df2-b5cb-663c9ef9d34d tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:45.812016 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-a0e97967-1c8c-4a7b-b4e5-8e3874549a2c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:45.845371 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-d8ee53c9-73f0-468f-af02-1274c1673fbc admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:45.933027 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-d6761d2d-e0c5-437e-9370-cbd5c1ece0c9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:45.962108 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-a0e97967-1c8c-4a7b-b4e5-8e3874549a2c admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=7db46e32dded47f0aca259d541ded76d&name=default HTTP/1.1" status: 200  len: 2979 time: 2.0778928
May 25 17:42:45.963093 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-4e3b8941-aa53-4df2-b5cb-663c9ef9d34d tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459369'] for security_group_rule, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:46.017732 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 40622) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:42:46.026014 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8dedff9f-4b94-438b-992d-64a73733bc20 req-96a72239-ff7c-473c-b087-5b3bb5d91b4b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:42:46.028057 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-8dedff9f-4b94-438b-992d-64a73733bc20 req-96a72239-ff7c-473c-b087-5b3bb5d91b4b service neutron] 10.222.0.125 "GET /v2.0/networks?id=6c7eca3b-72f3-4ba8-9e95-614d64496512 HTTP/1.1" status: 200  len: 916 time: 1.1420548
May 25 17:42:46.102606 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:46.167531 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] For port d13f3233-9e09-41c7-8315-4eae735fe605, host dv-cinder-789564-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=d13f3233-9e09-41c7-8315-4eae735fe605,segment=NetworkSegment(9ffd894c-b357-4c03-93af-a222f8984466),segment_id=9ffd894c-b357-4c03-93af-a222f8984466)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:42:46.197465 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a2e1e70-d9ef-4b13-a5b2-ad5b52b74848 req-686b79a5-ee0f-4464-9c55-a68275f92c09 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:42:46.198319 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-5a2e1e70-d9ef-4b13-a5b2-ad5b52b74848 req-686b79a5-ee0f-4464-9c55-a68275f92c09 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Synchronizing usage tracker for tenant:5b2f6ca8c5b94c2f8894c04f297b5f8b on resource:network {{(pid=99027) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 17:42:46.285911 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:46.295610 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device f7fc9e77-51db-43c8-9f03-ac0ca1040af2 up at agent ovs-agent-dv-cinder-789564-2-iscsi {{(pid=99028) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 17:42:46.324433 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-2f51fe2b-b9ae-49f6-9a08-7db018f3258b None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:46.344954 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-8dedff9f-4b94-438b-992d-64a73733bc20 req-0a85eca4-34e9-45e8-a48d-4f3820597772 service neutron] 10.222.0.125 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=4698ed19-7e41-4457-a1fd-16d5f606084a HTTP/1.1" status: 200  len: 217 time: 0.2883017
May 25 17:42:46.349626 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-78b72e1e-6317-4b36-8ff5-e254a51ce7f0 admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=fa5904b6048d43e9b34c88cb53735be3&name=default HTTP/1.1" status: 200  len: 2975 time: 0.5420597
May 25 17:42:46.349770 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-5a2e1e70-d9ef-4b13-a5b2-ad5b52b74848 req-686b79a5-ee0f-4464-9c55-a68275f92c09 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Unset dirty status for tenant:5b2f6ca8c5b94c2f8894c04f297b5f8b on resource:network {{(pid=99027) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 17:42:46.351243 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-5a2e1e70-d9ef-4b13-a5b2-ad5b52b74848 req-686b79a5-ee0f-4464-9c55-a68275f92c09 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/networks?id=2abe381d-082b-4294-8193-c6556a56adb4 HTTP/1.1" status: 200  len: 818 time: 0.6510668
May 25 17:42:46.352045 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 40634) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:42:46.354837 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-d8ee53c9-73f0-468f-af02-1274c1673fbc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:46.370506 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0e97967-1c8c-4a7b-b4e5-8e3874549a2c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=17d78ec1-fd20-45af-8f1c-46eedbe12d79,revision_number=1']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:46.374919 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-a0e97967-1c8c-4a7b-b4e5-8e3874549a2c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.442s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:46.379025 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.330s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:46.425891 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04d7d08f-68d8-47c3-a85b-462fe58c6871 req-95022177-b629-4051-b75d-de2ca3c7e3be tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:42:46.429460 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-04d7d08f-68d8-47c3-a85b-462fe58c6871 req-95022177-b629-4051-b75d-de2ca3c7e3be tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] 10.222.0.122 "GET /v2.0/ports?device_id=cab9bd8d-5b7a-4fc2-85cd-9d4f9884b4ee HTTP/1.1" status: 200  len: 944 time: 0.7556467
May 25 17:42:46.430353 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e3b8941-aa53-4df2-b5cb-663c9ef9d34d tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=2b593339-f1f9-4f6c-80e4-db2fde25f820,revision_number=0']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:46.434127 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-339aa27b-e142-4172-a51b-4bab30e479c6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:46.435593 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-4e3b8941-aa53-4df2-b5cb-663c9ef9d34d tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.056s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:46.452388 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-5a2e1e70-d9ef-4b13-a5b2-ad5b52b74848 req-5cd91cd6-48ee-4ff8-9122-d92ab2a6f671 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/quotas/5b2f6ca8c5b94c2f8894c04f297b5f8b HTTP/1.1" status: 200  len: 375 time: 0.0711806
May 25 17:42:46.455772 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Pushing event updated for resources: {'Port': ['ID=d13f3233-9e09-41c7-8315-4eae735fe605,revision_number=5']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:46.456956 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-d8ee53c9-73f0-468f-af02-1274c1673fbc admin admin] Notify callbacks [] for security_group, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:46.458334 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-d8ee53c9-73f0-468f-af02-1274c1673fbc admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/59bb74bc-2925-4fe4-887e-3b8b92501978 HTTP/1.1" status: 204  len: 168 time: 1.4553840
May 25 17:42:46.469394 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.145s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:46.474049 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8ee53c9-73f0-468f-af02-1274c1673fbc admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=59bb74bc-2925-4fe4-887e-3b8b92501978,revision_number=None']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:46.532229 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-d8ee53c9-73f0-468f-af02-1274c1673fbc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.098s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:46.570313 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-4e3b8941-aa53-4df2-b5cb-663c9ef9d34d tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify callbacks [] for security_group_rule, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:46.571681 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-4e3b8941-aa53-4df2-b5cb-663c9ef9d34d tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] 10.222.0.122 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 2.0449226
May 25 17:42:46.585754 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 40642) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:42:46.588745 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Provisioning for port f7fc9e77-51db-43c8-9f03-ac0ca1040af2 completed by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 17:42:46.594261 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Provisioning complete for port f7fc9e77-51db-43c8-9f03-ac0ca1040af2 triggered by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 17:42:46.594635 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:46.660777 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.v2.base [None req-ec4cb654-3324-499e-a891-ca5dad42f693 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Request body: {'floatingip': {'floating_network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb'}} {{(pid=99027) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:42:46.667575 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-ec4cb654-3324-499e-a891-ca5dad42f693 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:42:46.671455 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-ec4cb654-3324-499e-a891-ca5dad42f693 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Usage tracker for resource:floatingip and tenant:b4cdc54b260f4e79b87fdf4a43b12e16 is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:42:46.674700 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-ec4cb654-3324-499e-a891-ca5dad42f693 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:42:46.681820 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-ec4cb654-3324-499e-a891-ca5dad42f693 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:42:46.704966 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-04d7d08f-68d8-47c3-a85b-462fe58c6871 req-14a40860-dd9f-4f4c-98b9-2565d58c6a44 tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] 10.222.0.122 "GET /v2.0/security-groups?id=36f94dea-f495-4a32-ab2e-aef5450d5564&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2630355
May 25 17:42:46.705774 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-dffe99da-4bc8-4410-a840-c8c275c4854d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:46.709709 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-7d6bf8a8-cb6e-4d0f-b5f0-cc1d09407f52 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:46.715167 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8dedff9f-4b94-438b-992d-64a73733bc20 req-a1e892f9-c6f8-416f-b3f5-16b6fde95941 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:42:46.716626 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-8dedff9f-4b94-438b-992d-64a73733bc20 req-a1e892f9-c6f8-416f-b3f5-16b6fde95941 service neutron] 10.222.0.125 "GET /v2.0/subnets?id=279772c8-d366-4fc6-9c34-e6ddf99b5e08 HTTP/1.1" status: 200  len: 854 time: 0.2734926
May 25 17:42:46.763372 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-dffe99da-4bc8-4410-a840-c8c275c4854d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:46.806500 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-ec4cb654-3324-499e-a891-ca5dad42f693 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify callbacks [] for floatingip, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:46.859494 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-8dedff9f-4b94-438b-992d-64a73733bc20 req-0a96979e-41df-444a-aded-4293e7570cf1 service neutron] 10.222.0.125 "GET /v2.0/ports?network_id=6c7eca3b-72f3-4ba8-9e95-614d64496512&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.1069179
May 25 17:42:46.866720 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:46.917444 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e09ea54-7149-4bbc-90c3-6c7bbcce8511 req-2acc7d1a-eacf-46a1-8b1a-bf87089634b1 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:42:46.919230 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-8e09ea54-7149-4bbc-90c3-6c7bbcce8511 req-2acc7d1a-eacf-46a1-8b1a-bf87089634b1 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.125 "GET /v2.0/networks?id=2abe381d-082b-4294-8193-c6556a56adb4 HTTP/1.1" status: 200  len: 818 time: 0.3791864
May 25 17:42:46.921065 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] For port f7fc9e77-51db-43c8-9f03-ac0ca1040af2, host dv-cinder-789564-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=f7fc9e77-51db-43c8-9f03-ac0ca1040af2,segment=NetworkSegment(d619a116-4277-4bad-a1ec-8ca0357dd129),segment_id=d619a116-4277-4bad-a1ec-8ca0357dd129)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:42:46.929261 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-7d6bf8a8-cb6e-4d0f-b5f0-cc1d09407f52 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:46.940116 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-5a2e1e70-d9ef-4b13-a5b2-ad5b52b74848 req-02aa71b6-c698-440c-af12-8370ad7dc72b tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?tenant_id=5b2f6ca8c5b94c2f8894c04f297b5f8b&fields=id HTTP/1.1" status: 200  len: 255 time: 0.4674504
May 25 17:42:46.946916 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.v2.base [req-8e09ea54-7149-4bbc-90c3-6c7bbcce8511 req-105c47ad-9000-4e81-81c0-d80bc66b3e94 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Request body: {'port': {'device_id': '432d7a94-0218-4907-bc7c-650f24a5b1e1', 'network_id': '2abe381d-082b-4294-8193-c6556a56adb4', 'admin_state_up': True, 'tenant_id': '5b2f6ca8c5b94c2f8894c04f297b5f8b'}} {{(pid=99027) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:42:47.012230 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:47.016235 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-d0032186-1802-49e4-b250-bca64ed38313 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:47.154707 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Pushing event updated for resources: {'Port': ['ID=f7fc9e77-51db-43c8-9f03-ac0ca1040af2,revision_number=5']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:47.165992 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.150s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:47.186307 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device d13f3233-9e09-41c7-8315-4eae735fe605 up at agent ovs-agent-dv-cinder-789564-2-iscsi {{(pid=99028) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 17:42:47.390177 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-8dedff9f-4b94-438b-992d-64a73733bc20 req-7c3461e8-579f-4dde-adf7-d2ad93641666 service neutron] 10.222.0.125 "GET /v2.0/networks/6c7eca3b-72f3-4ba8-9e95-614d64496512?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.4516754
May 25 17:42:47.390177 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9cb8b4f6-f479-4019-b505-04e2997b4078 req-11c2ef9c-e326-4f87-b2a2-6be026857f68 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:42:47.390177 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-9cb8b4f6-f479-4019-b505-04e2997b4078 req-11c2ef9c-e326-4f87-b2a2-6be026857f68 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/ports?device_id=3fb3211e-48f5-46f5-8035-ddbc35109aa8 HTTP/1.1" status: 200  len: 944 time: 0.4206417
May 25 17:42:47.390610 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [req-8e09ea54-7149-4bbc-90c3-6c7bbcce8511 req-105c47ad-9000-4e81-81c0-d80bc66b3e94 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:42:47.391065 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Provisioning complete for port d13f3233-9e09-41c7-8315-4eae735fe605 triggered by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 17:42:47.391065 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:47.392178 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [req-8e09ea54-7149-4bbc-90c3-6c7bbcce8511 req-105c47ad-9000-4e81-81c0-d80bc66b3e94 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:42:47.402361 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-5a2e1e70-d9ef-4b13-a5b2-ad5b52b74848 req-ea8ae0fe-caf4-4e44-a1ff-2d93bc93deeb service neutron] 10.222.0.122 "GET /v2.0/networks/2abe381d-082b-4294-8193-c6556a56adb4?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.4321392
May 25 17:42:47.438417 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-dffe99da-4bc8-4410-a840-c8c275c4854d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:47.445566 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-7d6bf8a8-cb6e-4d0f-b5f0-cc1d09407f52 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:47.520843 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-dfbe0f60-56d0-46a7-8e0d-4d61940b91a2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:47.521635 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-98d4b6d9-4eae-484e-b05e-107b61dc8853 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:47.536060 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-8e09ea54-7149-4bbc-90c3-6c7bbcce8511 req-105c47ad-9000-4e81-81c0-d80bc66b3e94 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Made reservation on behalf of 5b2f6ca8c5b94c2f8894c04f297b5f8b for: {'port': 1} {{(pid=99027) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 17:42:47.539694 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-8e09ea54-7149-4bbc-90c3-6c7bbcce8511 req-105c47ad-9000-4e81-81c0-d80bc66b3e94 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:47.559888 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-9cb8b4f6-f479-4019-b505-04e2997b4078 req-f2142e92-448c-416a-9a6e-1c63877bb127 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/security-groups?id=dda11ec6-545c-479e-bba9-4390fea678fa&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1929927
May 25 17:42:47.565923 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-ec4cb654-3324-499e-a891-ca5dad42f693 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:47.569785 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d6bf8a8-cb6e-4d0f-b5f0-cc1d09407f52 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=17d78ec1-fd20-45af-8f1c-46eedbe12d79,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:47.578356 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-7d6bf8a8-cb6e-4d0f-b5f0-cc1d09407f52 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.058s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:47.584049 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dffe99da-4bc8-4410-a840-c8c275c4854d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=57ae5d73-571c-4ded-af34-7b55bc6b5e18,revision_number=None']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:47.606021 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-7d6bf8a8-cb6e-4d0f-b5f0-cc1d09407f52 admin admin] Notify callbacks [] for security_group, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:47.610081 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-7d6bf8a8-cb6e-4d0f-b5f0-cc1d09407f52 admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/17d78ec1-fd20-45af-8f1c-46eedbe12d79 HTTP/1.1" status: 204  len: 168 time: 1.5775244
May 25 17:42:47.627457 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-dffe99da-4bc8-4410-a840-c8c275c4854d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.106s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:47.629349 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-dffe99da-4bc8-4410-a840-c8c275c4854d admin admin] Notify callbacks [] for security_group, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:47.637971 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-dffe99da-4bc8-4410-a840-c8c275c4854d admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/57ae5d73-571c-4ded-af34-7b55bc6b5e18 HTTP/1.1" status: 204  len: 168 time: 1.2745025
May 25 17:42:47.673245 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 40666) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:42:47.708308 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-8dedff9f-4b94-438b-992d-64a73733bc20 req-481684dd-55b7-4e93-a1ca-0be3be2c2295 service neutron] 10.222.0.125 "GET /v2.0/networks/6c7eca3b-72f3-4ba8-9e95-614d64496512?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3641407
May 25 17:42:47.711114 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-83a37876-79b7-40b2-ba20-be06671f5508 admin admin] Notify callbacks [] for security_group, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:47.752150 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-83a37876-79b7-40b2-ba20-be06671f5508 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:42:47.758494 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-83a37876-79b7-40b2-ba20-be06671f5508 admin admin] Usage tracker for resource:security_group_rule and tenant:6fabf03e7def41ac83b8ccc220372e0a is out of sync, need to count used quota {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:42:47.761971 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-83a37876-79b7-40b2-ba20-be06671f5508 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:42:47.768968 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-83a37876-79b7-40b2-ba20-be06671f5508 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:42:47.778374 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-5a2e1e70-d9ef-4b13-a5b2-ad5b52b74848 req-feddb527-e117-44fe-9a05-75625c7ecad7 service neutron] 10.222.0.122 "GET /v2.0/networks/2abe381d-082b-4294-8193-c6556a56adb4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3680296
May 25 17:42:47.893040 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-83a37876-79b7-40b2-ba20-be06671f5508 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:47.984683 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-83a37876-79b7-40b2-ba20-be06671f5508 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:47.997416 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-a0e97967-1c8c-4a7b-b4e5-8e3874549a2c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:47.999211 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.db_base_plugin_common [None req-ec4cb654-3324-499e-a891-ca5dad42f693 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Allocated IP 172.27.3.117 (eb7ec72b-a691-481b-8d7e-42c05e13a8cb/d6898f5f-da0b-4428-97b4-4cbe3e83caaa/2a26b78b-8465-42a9-8373-8418f6764e8d) {{(pid=99027) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 17:42:48.001639 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.db_base_plugin_common [req-8e09ea54-7149-4bbc-90c3-6c7bbcce8511 req-105c47ad-9000-4e81-81c0-d80bc66b3e94 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Allocated IP 172.20.0.7 (2abe381d-082b-4294-8193-c6556a56adb4/e7ef8006-ae0e-4a18-b5c7-707d13fb7031/ca8c744f-fdc1-456d-ad85-74dff5ed46eb) {{(pid=99027) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 17:42:48.045856 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83a37876-79b7-40b2-ba20-be06671f5508 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=134ea57a-f774-42b8-ba4a-f48329822266,revision_number=1']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:48.062904 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-83a37876-79b7-40b2-ba20-be06671f5508 admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=6fabf03e7def41ac83b8ccc220372e0a&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3870413
May 25 17:42:48.065616 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-83a37876-79b7-40b2-ba20-be06671f5508 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.068s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:48.066139 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 40674) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:42:48.107793 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38ed2a58-c7ba-4274-886e-b2ac445d393a req-f945509a-0f18-4bd0-b53d-9755f721beae tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:42:48.108903 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-38ed2a58-c7ba-4274-886e-b2ac445d393a req-f945509a-0f18-4bd0-b53d-9755f721beae tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] 10.222.0.122 "GET /v2.0/ports?device_id=cab9bd8d-5b7a-4fc2-85cd-9d4f9884b4ee HTTP/1.1" status: 200  len: 944 time: 0.1914220
May 25 17:42:48.172003 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-3d5ba3f8-a5d7-405e-a859-fd152e9cd352 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:48.192709 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-38ed2a58-c7ba-4274-886e-b2ac445d393a req-31b9ea03-f3d4-492a-8e7a-0cc29fc580ab tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] 10.222.0.122 "GET /v2.0/security-groups?id=36f94dea-f495-4a32-ab2e-aef5450d5564&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0733106
May 25 17:42:48.219073 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-021c9664-62e2-4832-a420-b592596b0d85 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:48.263018 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-021c9664-62e2-4832-a420-b592596b0d85 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:48.300619 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-781f9e1b-983a-4c68-adaf-41c593ed5a66 req-2c8ff040-9563-4d32-a946-90ac49547efd tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=78a85fac-d281-494d-90da-a47ddc8255e5 HTTP/1.1" status: 200  len: 210 time: 0.0672657
May 25 17:42:48.347312 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-ec4cb654-3324-499e-a891-ca5dad42f693 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify callbacks [] for port, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:48.424250 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-021c9664-62e2-4832-a420-b592596b0d85 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:48.425946 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-8e09ea54-7149-4bbc-90c3-6c7bbcce8511 req-105c47ad-9000-4e81-81c0-d80bc66b3e94 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Notify callbacks [] for port, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:48.433554 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:48.448046 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-021c9664-62e2-4832-a420-b592596b0d85 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=134ea57a-f774-42b8-ba4a-f48329822266,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:48.450645 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-021c9664-62e2-4832-a420-b592596b0d85 admin admin] Notify callbacks [] for security_group, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:48.454335 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-021c9664-62e2-4832-a420-b592596b0d85 admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/134ea57a-f774-42b8-ba4a-f48329822266 HTTP/1.1" status: 204  len: 168 time: 0.3821552
May 25 17:42:48.455066 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-021c9664-62e2-4832-a420-b592596b0d85 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:48.511931 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-ec4cb654-3324-499e-a891-ca5dad42f693 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781840788179'] for port, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:48.517032 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:48.567848 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-8e09ea54-7149-4bbc-90c3-6c7bbcce8511 req-105c47ad-9000-4e81-81c0-d80bc66b3e94 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781840788179'] for port, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:48.592700 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ec4cb654-3324-499e-a891-ca5dad42f693 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Network eb7ec72b-a691-481b-8d7e-42c05e13a8cb is already hosted by enough agents. {{(pid=99027) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 17:42:48.597516 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.base_scheduler [None req-ec4cb654-3324-499e-a891-ca5dad42f693 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Resources bound (agent type, host, resource id):  {{(pid=99027) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 17:42:48.604064 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ec4cb654-3324-499e-a891-ca5dad42f693 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Received port after_create {{(pid=99027) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 17:42:48.612889 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec4cb654-3324-499e-a891-ca5dad42f693 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Pushing event updated for resources: {'Port': ['ID=2a26b78b-8465-42a9-8373-8418f6764e8d,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:48.619291 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-ec4cb654-3324-499e-a891-ca5dad42f693 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.102s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:48.621095 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-8e09ea54-7149-4bbc-90c3-6c7bbcce8511 req-105c47ad-9000-4e81-81c0-d80bc66b3e94 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Network 2abe381d-082b-4294-8193-c6556a56adb4 is already hosted by enough agents. {{(pid=99027) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 17:42:48.621779 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-0dde2041-b4fe-432c-a00d-c074f6a8bdda tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.033s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:48.677752 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.base_scheduler [req-8e09ea54-7149-4bbc-90c3-6c7bbcce8511 req-105c47ad-9000-4e81-81c0-d80bc66b3e94 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Resources bound (agent type, host, resource id):  {{(pid=99027) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 17:42:48.739868 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.l3_dvrscheduler_db [req-8e09ea54-7149-4bbc-90c3-6c7bbcce8511 req-105c47ad-9000-4e81-81c0-d80bc66b3e94 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Received port after_create {{(pid=99027) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 17:42:48.745865 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e09ea54-7149-4bbc-90c3-6c7bbcce8511 req-105c47ad-9000-4e81-81c0-d80bc66b3e94 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:42:48.748770 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-8e09ea54-7149-4bbc-90c3-6c7bbcce8511 req-105c47ad-9000-4e81-81c0-d80bc66b3e94 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-239387', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for port, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:48.801240 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-105c47ad-9000-4e81-81c0-d80bc66b3e94 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Pushing event updated for resources: {'Port': ['ID=ca8c744f-fdc1-456d-ad85-74dff5ed46eb,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:48.807395 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3e928ce-ff2e-4a43-9e00-7fc85b04ed45 req-d7f67eb9-ffb9-4a6b-ba3b-4337bcfea1ac tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:42:48.809737 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-f3e928ce-ff2e-4a43-9e00-7fc85b04ed45 req-d7f67eb9-ffb9-4a6b-ba3b-4337bcfea1ac tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/ports?device_id=3fb3211e-48f5-46f5-8035-ddbc35109aa8 HTTP/1.1" status: 200  len: 944 time: 0.0897563
May 25 17:42:48.815120 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-105c47ad-9000-4e81-81c0-d80bc66b3e94 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.193s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:48.816765 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-ec4cb654-3324-499e-a891-ca5dad42f693 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify callbacks [] for floatingip, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:48.836466 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 40702) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:42:48.859116 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-2154e082-d3d3-4d05-a833-3f0c9da9bf8e admin admin] Notify callbacks [] for security_group, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:48.890392 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-f3e928ce-ff2e-4a43-9e00-7fc85b04ed45 req-adfe642a-79a0-488d-89c2-250f4e845307 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/security-groups?id=dda11ec6-545c-479e-bba9-4390fea678fa&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0698791
May 25 17:42:48.891318 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-2154e082-d3d3-4d05-a833-3f0c9da9bf8e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:42:48.895170 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-2154e082-d3d3-4d05-a833-3f0c9da9bf8e admin admin] Usage tracker for resource:security_group_rule and tenant:001015a367b94f7d936bc791297d1978 is out of sync, need to count used quota {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:42:48.898336 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-2154e082-d3d3-4d05-a833-3f0c9da9bf8e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:42:48.904113 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-2154e082-d3d3-4d05-a833-3f0c9da9bf8e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:42:48.942981 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-8e09ea54-7149-4bbc-90c3-6c7bbcce8511 req-105c47ad-9000-4e81-81c0-d80bc66b3e94 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.125 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 2.0084028
May 25 17:42:48.982167 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.v2.base [req-8e09ea54-7149-4bbc-90c3-6c7bbcce8511 req-0f91ea39-ed43-4abc-be70-c85f8ec77b7c service neutron] Request body: {'port': {'device_id': '432d7a94-0218-4907-bc7c-650f24a5b1e1', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78956'}} {{(pid=99027) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:42:49.058470 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-2154e082-d3d3-4d05-a833-3f0c9da9bf8e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:49.074228 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-ec4cb654-3324-499e-a891-ca5dad42f693 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:49.117653 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device f7fc9e77-51db-43c8-9f03-ac0ca1040af2 up at agent ovs-agent-dv-cinder-789564-2-iscsi {{(pid=99028) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 17:42:49.125784 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-2154e082-d3d3-4d05-a833-3f0c9da9bf8e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:49.140344 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-83a37876-79b7-40b2-ba20-be06671f5508 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:49.249391 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-2154e082-d3d3-4d05-a833-3f0c9da9bf8e admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=001015a367b94f7d936bc791297d1978&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4118474
May 25 17:42:49.251033 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2154e082-d3d3-4d05-a833-3f0c9da9bf8e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e74a73f4-b615-4764-811b-16ef04760980,revision_number=1']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:49.255648 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 40716) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:42:49.304104 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-2154e082-d3d3-4d05-a833-3f0c9da9bf8e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.166s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:49.354232 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Provisioning complete for port f7fc9e77-51db-43c8-9f03-ac0ca1040af2 triggered by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 17:42:49.360764 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:49.439924 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-0600cc52-96bd-4f44-86e3-62a1d0d92f1d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:49.507295 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-0600cc52-96bd-4f44-86e3-62a1d0d92f1d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:49.562641 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-8e09ea54-7149-4bbc-90c3-6c7bbcce8511 req-0f91ea39-ed43-4abc-be70-c85f8ec77b7c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:49.637745 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-dd732638-3e15-4eff-91a1-20748a316bfa req-3f4a9278-fd72-4891-a90c-8638791f273b tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=78a85fac-d281-494d-90da-a47ddc8255e5 HTTP/1.1" status: 200  len: 210 time: 0.0808935
May 25 17:42:49.778210 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-0600cc52-96bd-4f44-86e3-62a1d0d92f1d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:49.783650 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:49.805194 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0600cc52-96bd-4f44-86e3-62a1d0d92f1d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e74a73f4-b615-4764-811b-16ef04760980,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:49.807819 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-0600cc52-96bd-4f44-86e3-62a1d0d92f1d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:49.820050 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-0600cc52-96bd-4f44-86e3-62a1d0d92f1d admin admin] Notify callbacks [] for security_group, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:49.824898 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0265860-26ce-43d1-b193-8b6c8fdac6e4 req-11ed1929-1b97-48d8-bdfe-31974bf8340c tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:42:49.825306 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-d0265860-26ce-43d1-b193-8b6c8fdac6e4 req-11ed1929-1b97-48d8-bdfe-31974bf8340c tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] 10.222.0.122 "GET /v2.0/ports?device_id=cab9bd8d-5b7a-4fc2-85cd-9d4f9884b4ee HTTP/1.1" status: 200  len: 944 time: 0.3420968
May 25 17:42:49.836066 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-0600cc52-96bd-4f44-86e3-62a1d0d92f1d admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/e74a73f4-b615-4764-811b-16ef04760980 HTTP/1.1" status: 204  len: 168 time: 0.5648174
May 25 17:42:49.902872 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Device 4d583d58-a3d8-4d10-883a-5959fa74e40c details requested by agent hyperv_hv-cinder-78956 with host hv-cinder-78956 {{(pid=99028) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 25 17:42:49.940612 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-ec4cb654-3324-499e-a891-ca5dad42f693 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify callbacks [] for port, precommit_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:49.997628 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-d0265860-26ce-43d1-b193-8b6c8fdac6e4 req-c65cffe0-ef96-41af-abde-70f794f5e638 tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] 10.222.0.122 "GET /v2.0/security-groups?id=36f94dea-f495-4a32-ab2e-aef5450d5564&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1566529
May 25 17:42:50.020825 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-ec4cb654-3324-499e-a891-ca5dad42f693 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:50.046274 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:50.203487 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9ed2268-5bcf-4137-8183-ea2453840b7c req-88e35e5a-0eb4-4d69-ae1a-ad4008934f7c tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:42:50.207952 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-ec4cb654-3324-499e-a891-ca5dad42f693 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-419865'] for floatingip, after_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:50.208119 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] For port 4d583d58-a3d8-4d10-883a-5959fa74e40c, host hv-cinder-78956, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=4d583d58-a3d8-4d10-883a-5959fa74e40c,segment=NetworkSegment(cc9a1d0a-1ce8-490e-886f-4f9fc5e8fc3d),segment_id=cc9a1d0a-1ce8-490e-886f-4f9fc5e8fc3d)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:42:50.213130 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-f9ed2268-5bcf-4137-8183-ea2453840b7c req-88e35e5a-0eb4-4d69-ae1a-ad4008934f7c tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/ports?device_id=3fb3211e-48f5-46f5-8035-ddbc35109aa8 HTTP/1.1" status: 200  len: 944 time: 0.1065943
May 25 17:42:50.265064 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec4cb654-3324-499e-a891-ca5dad42f693 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Pushing event updated for resources: {'Port': ['ID=2a26b78b-8465-42a9-8373-8418f6764e8d,revision_number=2']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:50.271308 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-f9ed2268-5bcf-4137-8183-ea2453840b7c req-99fe4a21-53a9-4f6c-8fc8-ec5c8318ea04 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/security-groups?id=dda11ec6-545c-479e-bba9-4390fea678fa&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0570743
May 25 17:42:50.271525 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Returning: {'device': '4d583d58-a3d8-4d10-883a-5959fa74e40c', 'network_id': '58926b0f-c6c9-44b1-aa59-d580f9359c87', 'port_id': '4d583d58-a3d8-4d10-883a-5959fa74e40c', 'mac_address': 'fa:16:3e:98:73:8b', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1333, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'd821d422-628c-4d27-a03e-94485f09826d', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=99028) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 25 17:42:50.276955 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-ec4cb654-3324-499e-a891-ca5dad42f693 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.231s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:50.355325 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.notifiers.nova [req-8e09ea54-7149-4bbc-90c3-6c7bbcce8511 req-0f91ea39-ed43-4abc-be70-c85f8ec77b7c service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id ca8c744f-fdc1-456d-ad85-74dff5ed46eb {{(pid=99027) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 25 17:42:50.362889 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:50.370063 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-8e09ea54-7149-4bbc-90c3-6c7bbcce8511 req-0f91ea39-ed43-4abc-be70-c85f8ec77b7c service neutron] Notify callbacks [] for port, precommit_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:50.375314 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-ec4cb654-3324-499e-a891-ca5dad42f693 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-239387'] for floatingip, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:50.375314 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-ec4cb654-3324-499e-a891-ca5dad42f693 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] 10.222.0.122 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 693 time: 3.7819166
May 25 17:42:50.398326 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.provisioning_blocks [req-8e09ea54-7149-4bbc-90c3-6c7bbcce8511 req-0f91ea39-ed43-4abc-be70-c85f8ec77b7c service neutron] Transition to ACTIVE for port object ca8c744f-fdc1-456d-ad85-74dff5ed46eb will not be triggered until provisioned by entity L2. {{(pid=99027) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 17:42:50.413820 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.notifiers.nova [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 4d583d58-a3d8-4d10-883a-5959fa74e40c {{(pid=99028) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 25 17:42:50.443586 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] For port 4d583d58-a3d8-4d10-883a-5959fa74e40c, host hv-cinder-78956, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=4d583d58-a3d8-4d10-883a-5959fa74e40c,segment=NetworkSegment(cc9a1d0a-1ce8-490e-886f-4f9fc5e8fc3d),segment_id=cc9a1d0a-1ce8-490e-886f-4f9fc5e8fc3d)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:42:50.468318 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-8e09ea54-7149-4bbc-90c3-6c7bbcce8511 req-0f91ea39-ed43-4abc-be70-c85f8ec77b7c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:50.473954 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-ec4cb654-3324-499e-a891-ca5dad42f693 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:50.583318 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:50.585971 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Device 4698ed19-7e41-4457-a1fd-16d5f606084a details requested by agent hyperv_hv-cinder-78956 with host hv-cinder-78956 {{(pid=99028) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 25 17:42:50.665329 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f91ea39-ed43-4abc-be70-c85f8ec77b7c service neutron] Pushing event updated for resources: {'Port': ['ID=ca8c744f-fdc1-456d-ad85-74dff5ed46eb,revision_number=2']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:50.670783 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-0f91ea39-ed43-4abc-be70-c85f8ec77b7c service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.197s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:50.676867 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.managers [req-8e09ea54-7149-4bbc-90c3-6c7bbcce8511 req-0f91ea39-ed43-4abc-be70-c85f8ec77b7c service neutron] Attempting to bind port ca8c744f-fdc1-456d-ad85-74dff5ed46eb on host hv-cinder-78956 for vnic_type normal with profile  {{(pid=99027) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 17:42:50.690271 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.managers [req-8e09ea54-7149-4bbc-90c3-6c7bbcce8511 req-0f91ea39-ed43-4abc-be70-c85f8ec77b7c service neutron] Attempting to bind port ca8c744f-fdc1-456d-ad85-74dff5ed46eb by drivers openvswitch,hyperv on host hv-cinder-78956 at level 0 using segments [{'id': 'd619a116-4277-4bad-a1ec-8ca0357dd129', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1329, 'network_id': '2abe381d-082b-4294-8193-c6556a56adb4'}] {{(pid=99027) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 17:42:50.695106 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8e09ea54-7149-4bbc-90c3-6c7bbcce8511 req-0f91ea39-ed43-4abc-be70-c85f8ec77b7c service neutron] Attempting to bind port ca8c744f-fdc1-456d-ad85-74dff5ed46eb on network 2abe381d-082b-4294-8193-c6556a56adb4 {{(pid=99027) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 17:42:50.698745 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8e09ea54-7149-4bbc-90c3-6c7bbcce8511 req-0f91ea39-ed43-4abc-be70-c85f8ec77b7c service neutron] Port ca8c744f-fdc1-456d-ad85-74dff5ed46eb on network 2abe381d-082b-4294-8193-c6556a56adb4 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78956 {{(pid=99027) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 25 17:42:50.699271 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8e09ea54-7149-4bbc-90c3-6c7bbcce8511 req-0f91ea39-ed43-4abc-be70-c85f8ec77b7c service neutron] Attempting to bind port ca8c744f-fdc1-456d-ad85-74dff5ed46eb on network 2abe381d-082b-4294-8193-c6556a56adb4 {{(pid=99027) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 17:42:50.707226 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8e09ea54-7149-4bbc-90c3-6c7bbcce8511 req-0f91ea39-ed43-4abc-be70-c85f8ec77b7c service neutron] Checking agent: {'id': '4d02a528-6a0e-4977-985f-4bcff1ca6cb7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78956', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 17, 40, 41), 'started_at': datetime.datetime(2021, 5, 25, 17, 40, 41), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 17, 42, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=99027) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 17:42:50.707761 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8e09ea54-7149-4bbc-90c3-6c7bbcce8511 req-0f91ea39-ed43-4abc-be70-c85f8ec77b7c service neutron] Checking segment: {'id': 'd619a116-4277-4bad-a1ec-8ca0357dd129', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1329, 'network_id': '2abe381d-082b-4294-8193-c6556a56adb4'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=99027) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 17:42:50.708356 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8e09ea54-7149-4bbc-90c3-6c7bbcce8511 req-0f91ea39-ed43-4abc-be70-c85f8ec77b7c service neutron] Bound using segment: {'id': 'd619a116-4277-4bad-a1ec-8ca0357dd129', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1329, 'network_id': '2abe381d-082b-4294-8193-c6556a56adb4'} {{(pid=99027) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 17:42:50.709006 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.managers [req-8e09ea54-7149-4bbc-90c3-6c7bbcce8511 req-0f91ea39-ed43-4abc-be70-c85f8ec77b7c service neutron] Bound port: ca8c744f-fdc1-456d-ad85-74dff5ed46eb, host: hv-cinder-78956, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd619a116-4277-4bad-a1ec-8ca0357dd129', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1329, 'network_id': '2abe381d-082b-4294-8193-c6556a56adb4'}}] {{(pid=99027) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 17:42:50.710098 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-8e09ea54-7149-4bbc-90c3-6c7bbcce8511 req-0f91ea39-ed43-4abc-be70-c85f8ec77b7c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:50.880195 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.db [req-8e09ea54-7149-4bbc-90c3-6c7bbcce8511 req-0f91ea39-ed43-4abc-be70-c85f8ec77b7c service neutron] For port ca8c744f-fdc1-456d-ad85-74dff5ed46eb, host hv-cinder-78956, cleared binding levels {{(pid=99027) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 17:42:50.888597 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.db [req-8e09ea54-7149-4bbc-90c3-6c7bbcce8511 req-0f91ea39-ed43-4abc-be70-c85f8ec77b7c service neutron] For port ca8c744f-fdc1-456d-ad85-74dff5ed46eb, host hv-cinder-78956, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=ca8c744f-fdc1-456d-ad85-74dff5ed46eb,segment=NetworkSegment(d619a116-4277-4bad-a1ec-8ca0357dd129),segment_id=d619a116-4277-4bad-a1ec-8ca0357dd129)] {{(pid=99027) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 17:42:50.916814 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] For port 4698ed19-7e41-4457-a1fd-16d5f606084a, host hv-cinder-78956, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=4698ed19-7e41-4457-a1fd-16d5f606084a,segment=NetworkSegment(87df170f-54cc-461b-a7ac-79e125fc526b),segment_id=87df170f-54cc-461b-a7ac-79e125fc526b)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:42:50.933447 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:50.970726 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-8e09ea54-7149-4bbc-90c3-6c7bbcce8511 req-0f91ea39-ed43-4abc-be70-c85f8ec77b7c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:51.001938 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-21ad0f2a-1f4e-478d-b487-7fdb2776601d req-b44c0f52-9db9-44bf-8385-1c4211563c0f tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=78a85fac-d281-494d-90da-a47ddc8255e5 HTTP/1.1" status: 200  len: 210 time: 0.1330342
May 25 17:42:51.012779 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:51.051511 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Returning: {'device': '4698ed19-7e41-4457-a1fd-16d5f606084a', 'network_id': '6c7eca3b-72f3-4ba8-9e95-614d64496512', 'port_id': '4698ed19-7e41-4457-a1fd-16d5f606084a', 'mac_address': 'fa:16:3e:3c:14:a0', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1304, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '279772c8-d366-4fc6-9c34-e6ddf99b5e08', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=99028) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 25 17:42:51.081587 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Pushing event updated for resources: {'Port': ['ID=4d583d58-a3d8-4d10-883a-5959fa74e40c,revision_number=4']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:51.099163 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-10e8ee48-d180-4f0f-aee5-65b868f172e8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:51.103887 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.170s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:51.192361 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f91ea39-ed43-4abc-be70-c85f8ec77b7c service neutron] Pushing event updated for resources: {'Port': ['ID=ca8c744f-fdc1-456d-ad85-74dff5ed46eb,revision_number=3']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:51.200086 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-5818dd78-01b4-4a12-b804-96d9d1a34047 req-827b4525-383d-426a-ba6c-722fa30dee25 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Synchronizing usage tracker for tenant:b4cdc54b260f4e79b87fdf4a43b12e16 on resource:security_group {{(pid=99027) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 17:42:51.204060 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-0f91ea39-ed43-4abc-be70-c85f8ec77b7c service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.199s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:51.211099 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:51.211656 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e09ea54-7149-4bbc-90c3-6c7bbcce8511 req-0f91ea39-ed43-4abc-be70-c85f8ec77b7c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:42:51.212242 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-8e09ea54-7149-4bbc-90c3-6c7bbcce8511 req-0f91ea39-ed43-4abc-be70-c85f8ec77b7c service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-239387', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for port, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:51.213717 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-8e09ea54-7149-4bbc-90c3-6c7bbcce8511 req-0f91ea39-ed43-4abc-be70-c85f8ec77b7c service neutron] 10.222.0.125 "PUT /v2.0/ports/ca8c744f-fdc1-456d-ad85-74dff5ed46eb HTTP/1.1" status: 200  len: 1093 time: 2.2360449
May 25 17:42:51.214182 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '432d7a94-0218-4907-bc7c-650f24a5b1e1', 'tag': 'ca8c744f-fdc1-456d-ad85-74dff5ed46eb'}] {{(pid=99027) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 17:42:51.227889 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:51.239541 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.notifiers.nova [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 4698ed19-7e41-4457-a1fd-16d5f606084a {{(pid=99028) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 25 17:42:51.261293 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] For port 4698ed19-7e41-4457-a1fd-16d5f606084a, host hv-cinder-78956, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=4698ed19-7e41-4457-a1fd-16d5f606084a,segment=NetworkSegment(87df170f-54cc-461b-a7ac-79e125fc526b),segment_id=87df170f-54cc-461b-a7ac-79e125fc526b)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:42:51.312796 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-5818dd78-01b4-4a12-b804-96d9d1a34047 req-827b4525-383d-426a-ba6c-722fa30dee25 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Unset dirty status for tenant:b4cdc54b260f4e79b87fdf4a43b12e16 on resource:security_group {{(pid=99027) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 17:42:51.325376 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-5818dd78-01b4-4a12-b804-96d9d1a34047 req-827b4525-383d-426a-ba6c-722fa30dee25 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] 10.222.0.122 "GET /v2.0/security-groups?name=tempest-securitygroup--1086376336&fields=id&tenant_id=b4cdc54b260f4e79b87fdf4a43b12e16 HTTP/1.1" status: 200  len: 267 time: 0.4316192
May 25 17:42:51.344555 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:51.351433 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:51.402932 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a2e1e70-d9ef-4b13-a5b2-ad5b52b74848 req-81627dee-d22d-4a94-9e91-a160bce99540 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:42:51.402932 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-5a2e1e70-d9ef-4b13-a5b2-ad5b52b74848 req-81627dee-d22d-4a94-9e91-a160bce99540 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.125 "GET /v2.0/networks?id=2abe381d-082b-4294-8193-c6556a56adb4 HTTP/1.1" status: 200  len: 818 time: 0.4555871
May 25 17:42:51.422646 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.v2.base [req-5a2e1e70-d9ef-4b13-a5b2-ad5b52b74848 req-618f3614-e19a-4cf0-9fe6-ee789335b2b0 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Request body: {'port': {'device_id': '78a85fac-d281-494d-90da-a47ddc8255e5', 'network_id': '2abe381d-082b-4294-8193-c6556a56adb4', 'admin_state_up': True, 'tenant_id': '5b2f6ca8c5b94c2f8894c04f297b5f8b'}} {{(pid=99026) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:42:51.522876 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Pushing event updated for resources: {'Port': ['ID=4698ed19-7e41-4457-a1fd-16d5f606084a,revision_number=4']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:51.530089 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.180s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:51.658091 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5818dd78-01b4-4a12-b804-96d9d1a34047 req-c07d5871-ad46-435a-a432-9fe1ce1e4d4b tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:42:51.660767 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-5818dd78-01b4-4a12-b804-96d9d1a34047 req-c07d5871-ad46-435a-a432-9fe1ce1e4d4b tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Synchronizing usage tracker for tenant:b4cdc54b260f4e79b87fdf4a43b12e16 on resource:network {{(pid=99027) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 17:42:51.664387 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e09ea54-7149-4bbc-90c3-6c7bbcce8511 req-0c6cf476-0cd2-4f90-91a7-4d3aff6501ee service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:42:51.665743 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-8e09ea54-7149-4bbc-90c3-6c7bbcce8511 req-0c6cf476-0cd2-4f90-91a7-4d3aff6501ee service neutron] 10.222.0.125 "GET /v2.0/ports?tenant_id=5b2f6ca8c5b94c2f8894c04f297b5f8b&device_id=432d7a94-0218-4907-bc7c-650f24a5b1e1 HTTP/1.1" status: 200  len: 1096 time: 0.2693269
May 25 17:42:51.671903 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] get_ports_and_sgs() called for port_ids ['4698ed19-7e41-4457-a1fd-16d5f606084a'] {{(pid=99028) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 25 17:42:51.708271 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] get_ports_and_sgs() called for port_ids ['4d583d58-a3d8-4d10-883a-5959fa74e40c'] {{(pid=99028) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 25 17:42:51.761228 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-8e09ea54-7149-4bbc-90c3-6c7bbcce8511 req-fd5b84c4-a3eb-4bbb-b500-7fee614e541e service neutron] 10.222.0.125 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=ca8c744f-fdc1-456d-ad85-74dff5ed46eb HTTP/1.1" status: 200  len: 217 time: 0.0882080
May 25 17:42:51.791182 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-7e261f94-b84f-443e-be49-3bc1ac903b55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:51.815789 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7347800-9ee2-4b88-9b08-b9f5d16fc8fa req-aeb300f4-5dc5-450b-b5e0-81aef2605f46 tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:42:51.833055 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-5818dd78-01b4-4a12-b804-96d9d1a34047 req-c07d5871-ad46-435a-a432-9fe1ce1e4d4b tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Unset dirty status for tenant:b4cdc54b260f4e79b87fdf4a43b12e16 on resource:network {{(pid=99027) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 17:42:51.834508 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-5818dd78-01b4-4a12-b804-96d9d1a34047 req-c07d5871-ad46-435a-a432-9fe1ce1e4d4b tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] 10.222.0.122 "GET /v2.0/networks?id=defaef08-c0f9-4608-b66d-b97e06e185bf HTTP/1.1" status: 200  len: 811 time: 0.5056264
May 25 17:42:51.841745 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-f7347800-9ee2-4b88-9b08-b9f5d16fc8fa req-aeb300f4-5dc5-450b-b5e0-81aef2605f46 tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] 10.222.0.122 "GET /v2.0/ports?device_id=cab9bd8d-5b7a-4fc2-85cd-9d4f9884b4ee HTTP/1.1" status: 200  len: 945 time: 0.5371912
May 25 17:42:51.862262 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-5818dd78-01b4-4a12-b804-96d9d1a34047 req-204a5509-1798-4f7a-a009-4d77c5ce8fc0 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] 10.222.0.122 "GET /v2.0/quotas/b4cdc54b260f4e79b87fdf4a43b12e16 HTTP/1.1" status: 200  len: 375 time: 0.0150673
May 25 17:42:51.867238 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e09ea54-7149-4bbc-90c3-6c7bbcce8511 req-f264158e-f706-4ed7-b664-6383b8b760c1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:42:51.868820 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-8e09ea54-7149-4bbc-90c3-6c7bbcce8511 req-f264158e-f706-4ed7-b664-6383b8b760c1 service neutron] 10.222.0.125 "GET /v2.0/subnets?id=e7ef8006-ae0e-4a18-b5c7-707d13fb7031 HTTP/1.1" status: 200  len: 858 time: 0.0990105
May 25 17:42:51.974485 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-8e09ea54-7149-4bbc-90c3-6c7bbcce8511 req-b3ee8a09-ff4c-48f2-9ae8-e06470afded1 service neutron] 10.222.0.125 "GET /v2.0/ports?network_id=2abe381d-082b-4294-8193-c6556a56adb4&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0619745
May 25 17:42:52.001320 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [req-5a2e1e70-d9ef-4b13-a5b2-ad5b52b74848 req-618f3614-e19a-4cf0-9fe6-ee789335b2b0 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:42:52.018134 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-f7347800-9ee2-4b88-9b08-b9f5d16fc8fa req-4a42ee59-f78e-4329-aadb-0609fafdd32f tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] 10.222.0.122 "GET /v2.0/security-groups?id=36f94dea-f495-4a32-ab2e-aef5450d5564&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1731153
May 25 17:42:52.025279 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [req-5a2e1e70-d9ef-4b13-a5b2-ad5b52b74848 req-618f3614-e19a-4cf0-9fe6-ee789335b2b0 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Usage tracker for resource:port and tenant:5b2f6ca8c5b94c2f8894c04f297b5f8b is out of sync, need to count used quota {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:42:52.033586 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [req-5a2e1e70-d9ef-4b13-a5b2-ad5b52b74848 req-618f3614-e19a-4cf0-9fe6-ee789335b2b0 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Quota usage for port was recalculated. Used quota:2. {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:42:52.059806 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [req-5a2e1e70-d9ef-4b13-a5b2-ad5b52b74848 req-618f3614-e19a-4cf0-9fe6-ee789335b2b0 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:42:52.151158 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-5818dd78-01b4-4a12-b804-96d9d1a34047 req-6354af04-cb10-4891-b706-6ce682a533e4 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Synchronizing usage tracker for tenant:b4cdc54b260f4e79b87fdf4a43b12e16 on resource:port {{(pid=99027) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 17:42:52.166407 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-5a2e1e70-d9ef-4b13-a5b2-ad5b52b74848 req-618f3614-e19a-4cf0-9fe6-ee789335b2b0 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Made reservation on behalf of 5b2f6ca8c5b94c2f8894c04f297b5f8b for: {'port': 1} {{(pid=99026) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 17:42:52.172196 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [req-5a2e1e70-d9ef-4b13-a5b2-ad5b52b74848 req-618f3614-e19a-4cf0-9fe6-ee789335b2b0 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:52.181913 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '432d7a94-0218-4907-bc7c-650f24a5b1e1', 'tag': 'ca8c744f-fdc1-456d-ad85-74dff5ed46eb', 'status': 'completed', 'code': 200}
May 25 17:42:52.295610 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-8e09ea54-7149-4bbc-90c3-6c7bbcce8511 req-de32c430-5c7a-46dd-a1ff-ad1134724186 service neutron] 10.222.0.125 "GET /v2.0/networks/2abe381d-082b-4294-8193-c6556a56adb4?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3079886
May 25 17:42:52.297323 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-5818dd78-01b4-4a12-b804-96d9d1a34047 req-6354af04-cb10-4891-b706-6ce682a533e4 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Unset dirty status for tenant:b4cdc54b260f4e79b87fdf4a43b12e16 on resource:port {{(pid=99027) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 17:42:52.298688 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-5818dd78-01b4-4a12-b804-96d9d1a34047 req-6354af04-cb10-4891-b706-6ce682a533e4 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] 10.222.0.122 "GET /v2.0/ports?tenant_id=b4cdc54b260f4e79b87fdf4a43b12e16&fields=id HTTP/1.1" status: 200  len: 348 time: 0.4258986
May 25 17:42:52.406306 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8aceeff-5e28-4b36-b1a3-72d0acd6997d req-567fcbc1-a035-4f60-8ab6-8d570687bd73 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:42:52.407820 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-c8aceeff-5e28-4b36-b1a3-72d0acd6997d req-567fcbc1-a035-4f60-8ab6-8d570687bd73 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/ports?device_id=3fb3211e-48f5-46f5-8035-ddbc35109aa8 HTTP/1.1" status: 200  len: 945 time: 0.1518598
May 25 17:42:52.524431 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-c8aceeff-5e28-4b36-b1a3-72d0acd6997d req-6ed5da45-c59a-46c9-9c96-d6f754a57dfa tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/security-groups?id=dda11ec6-545c-479e-bba9-4390fea678fa&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1086969
May 25 17:42:52.532224 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.db_base_plugin_common [req-5a2e1e70-d9ef-4b13-a5b2-ad5b52b74848 req-618f3614-e19a-4cf0-9fe6-ee789335b2b0 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Allocated IP 172.20.0.9 (2abe381d-082b-4294-8193-c6556a56adb4/e7ef8006-ae0e-4a18-b5c7-707d13fb7031/8a9ac879-c35f-482a-b8f0-6355fbb9a900) {{(pid=99026) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 17:42:52.724020 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-8e09ea54-7149-4bbc-90c3-6c7bbcce8511 req-9ac3e433-b95d-43a8-bf6b-ba25f598d3a9 service neutron] 10.222.0.125 "GET /v2.0/networks/2abe381d-082b-4294-8193-c6556a56adb4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.4197900
May 25 17:42:52.745129 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-5818dd78-01b4-4a12-b804-96d9d1a34047 req-4e1aca2b-bd92-47bc-8a64-37ac7bb9bb2e service neutron] 10.222.0.122 "GET /v2.0/networks/defaef08-c0f9-4608-b66d-b97e06e185bf?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3980639
May 25 17:42:52.813987 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-27b6de3e-a027-4028-b8a5-3165dd8c2e1d req-9ed35c26-c2f2-4fa9-8630-517c7072bd4c tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=78a85fac-d281-494d-90da-a47ddc8255e5 HTTP/1.1" status: 200  len: 210 time: 0.1213741
May 25 17:42:52.934609 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [req-5a2e1e70-d9ef-4b13-a5b2-ad5b52b74848 req-618f3614-e19a-4cf0-9fe6-ee789335b2b0 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Notify callbacks [] for port, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:53.030567 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-5818dd78-01b4-4a12-b804-96d9d1a34047 req-beb6169c-dcb0-4972-ae35-4121f54b3881 service neutron] 10.222.0.122 "GET /v2.0/networks/defaef08-c0f9-4608-b66d-b97e06e185bf?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2788928
May 25 17:42:53.073767 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0fa03a4-619f-4a06-9c41-f2683b264785 req-1da7f0b6-528c-4a74-8019-c8f945036783 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:42:53.088313 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [req-5a2e1e70-d9ef-4b13-a5b2-ad5b52b74848 req-618f3614-e19a-4cf0-9fe6-ee789335b2b0 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781840788179', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15476536'] for port, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:53.096437 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-4aba278a-ace1-4979-959f-0579123e3658 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:53.100854 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-e0fa03a4-619f-4a06-9c41-f2683b264785 req-1da7f0b6-528c-4a74-8019-c8f945036783 service neutron] 10.222.0.125 "GET /v2.0/ports?tenant_id=5b2f6ca8c5b94c2f8894c04f297b5f8b&device_id=432d7a94-0218-4907-bc7c-650f24a5b1e1 HTTP/1.1" status: 200  len: 1096 time: 0.2042508
May 25 17:42:53.199520 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-5a2e1e70-d9ef-4b13-a5b2-ad5b52b74848 req-618f3614-e19a-4cf0-9fe6-ee789335b2b0 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Network 2abe381d-082b-4294-8193-c6556a56adb4 is already hosted by enough agents. {{(pid=99026) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 17:42:53.203010 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.scheduler.base_scheduler [req-5a2e1e70-d9ef-4b13-a5b2-ad5b52b74848 req-618f3614-e19a-4cf0-9fe6-ee789335b2b0 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Resources bound (agent type, host, resource id):  {{(pid=99026) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 17:42:53.224349 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.l3_dvrscheduler_db [req-5a2e1e70-d9ef-4b13-a5b2-ad5b52b74848 req-618f3614-e19a-4cf0-9fe6-ee789335b2b0 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Received port after_create {{(pid=99026) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 17:42:53.278049 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-618f3614-e19a-4cf0-9fe6-ee789335b2b0 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Pushing event updated for resources: {'Port': ['ID=8a9ac879-c35f-482a-b8f0-6355fbb9a900,revision_number=1']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:53.305710 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-6df2b2a7-a54e-4d57-9be3-033078b9d5b3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:53.319678 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0fa03a4-619f-4a06-9c41-f2683b264785 req-35a907ea-b822-4c90-bece-6201295a8de1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:42:53.321305 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-e0fa03a4-619f-4a06-9c41-f2683b264785 req-35a907ea-b822-4c90-bece-6201295a8de1 service neutron] 10.222.0.125 "GET /v2.0/networks?id=2abe381d-082b-4294-8193-c6556a56adb4 HTTP/1.1" status: 200  len: 920 time: 0.2184579
May 25 17:42:53.328850 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-618f3614-e19a-4cf0-9fe6-ee789335b2b0 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.233s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:53.379774 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a2e1e70-d9ef-4b13-a5b2-ad5b52b74848 req-618f3614-e19a-4cf0-9fe6-ee789335b2b0 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:42:53.380407 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [req-5a2e1e70-d9ef-4b13-a5b2-ad5b52b74848 req-618f3614-e19a-4cf0-9fe6-ee789335b2b0 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-239387', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for port, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:53.435877 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26fc9bbb-f045-4b07-a2d0-162389beba22 req-d8c6f86c-86e7-45c3-8e98-36b1f50ea924 tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:42:53.445208 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-26fc9bbb-f045-4b07-a2d0-162389beba22 req-d8c6f86c-86e7-45c3-8e98-36b1f50ea924 tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] 10.222.0.122 "GET /v2.0/ports?device_id=cab9bd8d-5b7a-4fc2-85cd-9d4f9884b4ee HTTP/1.1" status: 200  len: 945 time: 0.1778238
May 25 17:42:53.476655 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-5a2e1e70-d9ef-4b13-a5b2-ad5b52b74848 req-618f3614-e19a-4cf0-9fe6-ee789335b2b0 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.125 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 2.0586669
May 25 17:42:53.483231 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-e0fa03a4-619f-4a06-9c41-f2683b264785 req-eaf87885-9cbf-4bba-a9ce-05e34f1f4ebc service neutron] 10.222.0.125 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=ca8c744f-fdc1-456d-ad85-74dff5ed46eb HTTP/1.1" status: 200  len: 217 time: 0.1529701
May 25 17:42:53.498674 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.v2.base [req-5a2e1e70-d9ef-4b13-a5b2-ad5b52b74848 req-e74312b5-520e-41a6-a834-099c9fe636b6 service neutron] Request body: {'port': {'device_id': '78a85fac-d281-494d-90da-a47ddc8255e5', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78956'}} {{(pid=99026) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:42:53.551186 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-26fc9bbb-f045-4b07-a2d0-162389beba22 req-f30b882c-8b46-41a1-bec7-5011a38095b6 tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] 10.222.0.122 "GET /v2.0/security-groups?id=36f94dea-f495-4a32-ab2e-aef5450d5564&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1050529
May 25 17:42:53.569536 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-a5912a99-c103-4e1d-911b-b1372497f52b req-b6be94ed-629a-4df9-a147-b54bf0c9f0c0 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] 10.222.0.122 "GET /v2.0/ports?device_id=446d90e5-0bef-47f6-852a-61b638d2a161 HTTP/1.1" status: 200  len: 210 time: 0.0848992
May 25 17:42:53.653951 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [req-5a2e1e70-d9ef-4b13-a5b2-ad5b52b74848 req-e74312b5-520e-41a6-a834-099c9fe636b6 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:53.673734 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0fa03a4-619f-4a06-9c41-f2683b264785 req-df7cedea-83d4-4ac4-b4d4-bd10e479dc27 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:42:53.675057 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-e0fa03a4-619f-4a06-9c41-f2683b264785 req-df7cedea-83d4-4ac4-b4d4-bd10e479dc27 service neutron] 10.222.0.125 "GET /v2.0/subnets?id=e7ef8006-ae0e-4a18-b5c7-707d13fb7031 HTTP/1.1" status: 200  len: 858 time: 0.1010640
May 25 17:42:53.739263 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-e0fa03a4-619f-4a06-9c41-f2683b264785 req-3429b239-666f-4045-97a2-336ae4090f11 service neutron] 10.222.0.125 "GET /v2.0/ports?network_id=2abe381d-082b-4294-8193-c6556a56adb4&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0567884
May 25 17:42:53.876884 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Device 4d583d58-a3d8-4d10-883a-5959fa74e40c up at agent hyperv_hv-cinder-78956 {{(pid=99028) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 17:42:53.941727 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b63c6b63-2494-453a-8be1-5a880fb1b22c req-89ede153-1f7d-447e-95a9-324f24ca76f9 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:42:53.949716 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-b63c6b63-2494-453a-8be1-5a880fb1b22c req-89ede153-1f7d-447e-95a9-324f24ca76f9 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/ports?device_id=3fb3211e-48f5-46f5-8035-ddbc35109aa8 HTTP/1.1" status: 200  len: 945 time: 0.2187309
May 25 17:42:53.978440 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-e0fa03a4-619f-4a06-9c41-f2683b264785 req-8cee8666-8a70-483d-9e92-c67c7a056617 service neutron] 10.222.0.125 "GET /v2.0/networks/2abe381d-082b-4294-8193-c6556a56adb4?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1963601
May 25 17:42:54.132250 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Provisioning for port 4d583d58-a3d8-4d10-883a-5959fa74e40c completed by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 17:42:54.139537 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Provisioning complete for port 4d583d58-a3d8-4d10-883a-5959fa74e40c triggered by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 17:42:54.146424 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:54.185894 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-b63c6b63-2494-453a-8be1-5a880fb1b22c req-f34be1d2-9379-4b77-aac6-74e2cdb4e090 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/security-groups?id=dda11ec6-545c-479e-bba9-4390fea678fa&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2331283
May 25 17:42:54.282050 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 40898) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:42:54.316915 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a86af872-7016-4f61-9a1b-22367f2ed6f0 req-aa52ad6e-c7ed-41bd-b678-6ce7cc72d1f0 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:42:54.318012 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [req-a86af872-7016-4f61-9a1b-22367f2ed6f0 req-aa52ad6e-c7ed-41bd-b678-6ce7cc72d1f0 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Synchronizing usage tracker for tenant:5b2f6ca8c5b94c2f8894c04f297b5f8b on resource:port {{(pid=99026) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 17:42:54.330697 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-e0fa03a4-619f-4a06-9c41-f2683b264785 req-c3ac8827-19e6-481e-9917-5e89c60b28f3 service neutron] 10.222.0.125 "GET /v2.0/networks/2abe381d-082b-4294-8193-c6556a56adb4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3434420
May 25 17:42:54.355590 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.notifiers.nova [req-5a2e1e70-d9ef-4b13-a5b2-ad5b52b74848 req-e74312b5-520e-41a6-a834-099c9fe636b6 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 8a9ac879-c35f-482a-b8f0-6355fbb9a900 {{(pid=99026) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 25 17:42:54.364483 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [req-5a2e1e70-d9ef-4b13-a5b2-ad5b52b74848 req-e74312b5-520e-41a6-a834-099c9fe636b6 service neutron] Notify callbacks [] for port, precommit_update {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:54.385388 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.provisioning_blocks [req-5a2e1e70-d9ef-4b13-a5b2-ad5b52b74848 req-e74312b5-520e-41a6-a834-099c9fe636b6 service neutron] Transition to ACTIVE for port object 8a9ac879-c35f-482a-b8f0-6355fbb9a900 will not be triggered until provisioned by entity L2. {{(pid=99026) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 17:42:54.389552 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:54.428678 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] For port 4d583d58-a3d8-4d10-883a-5959fa74e40c, host hv-cinder-78956, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=4d583d58-a3d8-4d10-883a-5959fa74e40c,segment=NetworkSegment(cc9a1d0a-1ce8-490e-886f-4f9fc5e8fc3d),segment_id=cc9a1d0a-1ce8-490e-886f-4f9fc5e8fc3d)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:42:54.429732 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'cab9bd8d-5b7a-4fc2-85cd-9d4f9884b4ee', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4d583d58-a3d8-4d10-883a-5959fa74e40c'}] {{(pid=99028) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 17:42:54.467681 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [req-a86af872-7016-4f61-9a1b-22367f2ed6f0 req-aa52ad6e-c7ed-41bd-b678-6ce7cc72d1f0 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Unset dirty status for tenant:5b2f6ca8c5b94c2f8894c04f297b5f8b on resource:port {{(pid=99026) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 17:42:54.469681 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-a86af872-7016-4f61-9a1b-22367f2ed6f0 req-aa52ad6e-c7ed-41bd-b678-6ce7cc72d1f0 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=78a85fac-d281-494d-90da-a47ddc8255e5 HTTP/1.1" status: 200  len: 931 time: 0.4434938
May 25 17:42:54.543254 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:54.544127 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Device 4698ed19-7e41-4457-a1fd-16d5f606084a up at agent hyperv_hv-cinder-78956 {{(pid=99028) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 17:42:54.546589 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [req-5a2e1e70-d9ef-4b13-a5b2-ad5b52b74848 req-e74312b5-520e-41a6-a834-099c9fe636b6 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15476529'] for port, after_update {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:54.556018 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:54.604222 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:54.677443 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-a86af872-7016-4f61-9a1b-22367f2ed6f0 req-b35f8019-0e9a-40a4-804f-5d3fb167df41 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2012832
May 25 17:42:54.742907 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-65d70856-37c4-4b05-8c5c-da5ce4464bfb admin admin] Notify callbacks [] for security_group, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:54.805115 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Pushing event updated for resources: {'Port': ['ID=4d583d58-a3d8-4d10-883a-5959fa74e40c,revision_number=5']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:54.813267 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.208s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:54.831256 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-65d70856-37c4-4b05-8c5c-da5ce4464bfb admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:42:54.837432 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-65d70856-37c4-4b05-8c5c-da5ce4464bfb admin admin] Usage tracker for resource:security_group_rule and tenant:306e9644fc4746ef8fa4cfff7c7e4d5f is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:42:54.841824 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-65d70856-37c4-4b05-8c5c-da5ce4464bfb admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:42:54.851466 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-65d70856-37c4-4b05-8c5c-da5ce4464bfb admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:42:54.910292 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e74312b5-520e-41a6-a834-099c9fe636b6 service neutron] Pushing event updated for resources: {'Port': ['ID=8a9ac879-c35f-482a-b8f0-6355fbb9a900,revision_number=2']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:54.926073 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28c88ec6-6f53-4d98-b3a2-341d3792f34a req-236fad82-9256-420c-a145-36cdb5254f3c tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:42:54.936857 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-28c88ec6-6f53-4d98-b3a2-341d3792f34a req-236fad82-9256-420c-a145-36cdb5254f3c tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] 10.222.0.122 "GET /v2.0/ports?device_id=cab9bd8d-5b7a-4fc2-85cd-9d4f9884b4ee HTTP/1.1" status: 200  len: 946 time: 0.1746383
May 25 17:42:54.962105 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-e74312b5-520e-41a6-a834-099c9fe636b6 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.406s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:54.991695 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Provisioning for port 4698ed19-7e41-4457-a1fd-16d5f606084a completed by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 17:42:55.001070 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Provisioning complete for port 4698ed19-7e41-4457-a1fd-16d5f606084a triggered by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 17:42:55.001585 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:55.012003 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-28c88ec6-6f53-4d98-b3a2-341d3792f34a req-2b577084-7598-4c2d-aa20-d76e6d3d9fb4 tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] 10.222.0.122 "GET /v2.0/security-groups?id=36f94dea-f495-4a32-ab2e-aef5450d5564&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0738041
May 25 17:42:55.099108 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-65d70856-37c4-4b05-8c5c-da5ce4464bfb admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:55.127798 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-202b3a0c-5534-4f4c-b41a-907b6f5c867f req-7ec201de-9ec9-409c-a43e-7184a61ec276 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] 10.222.0.122 "GET /v2.0/ports?device_id=446d90e5-0bef-47f6-852a-61b638d2a161 HTTP/1.1" status: 200  len: 210 time: 0.2533820
May 25 17:42:55.157304 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:55.173907 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.managers [req-5a2e1e70-d9ef-4b13-a5b2-ad5b52b74848 req-e74312b5-520e-41a6-a834-099c9fe636b6 service neutron] Attempting to bind port 8a9ac879-c35f-482a-b8f0-6355fbb9a900 on host hv-cinder-78956 for vnic_type normal with profile  {{(pid=99026) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 17:42:55.173907 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.managers [req-5a2e1e70-d9ef-4b13-a5b2-ad5b52b74848 req-e74312b5-520e-41a6-a834-099c9fe636b6 service neutron] Attempting to bind port 8a9ac879-c35f-482a-b8f0-6355fbb9a900 by drivers openvswitch,hyperv on host hv-cinder-78956 at level 0 using segments [{'id': 'd619a116-4277-4bad-a1ec-8ca0357dd129', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1329, 'network_id': '2abe381d-082b-4294-8193-c6556a56adb4'}] {{(pid=99026) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 17:42:55.174196 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5a2e1e70-d9ef-4b13-a5b2-ad5b52b74848 req-e74312b5-520e-41a6-a834-099c9fe636b6 service neutron] Attempting to bind port 8a9ac879-c35f-482a-b8f0-6355fbb9a900 on network 2abe381d-082b-4294-8193-c6556a56adb4 {{(pid=99026) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 17:42:55.179516 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5a2e1e70-d9ef-4b13-a5b2-ad5b52b74848 req-e74312b5-520e-41a6-a834-099c9fe636b6 service neutron] Port 8a9ac879-c35f-482a-b8f0-6355fbb9a900 on network 2abe381d-082b-4294-8193-c6556a56adb4 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78956 {{(pid=99026) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 25 17:42:55.180064 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5a2e1e70-d9ef-4b13-a5b2-ad5b52b74848 req-e74312b5-520e-41a6-a834-099c9fe636b6 service neutron] Attempting to bind port 8a9ac879-c35f-482a-b8f0-6355fbb9a900 on network 2abe381d-082b-4294-8193-c6556a56adb4 {{(pid=99026) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 17:42:55.186280 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5a2e1e70-d9ef-4b13-a5b2-ad5b52b74848 req-e74312b5-520e-41a6-a834-099c9fe636b6 service neutron] Checking agent: {'id': '4d02a528-6a0e-4977-985f-4bcff1ca6cb7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78956', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 17, 40, 41), 'started_at': datetime.datetime(2021, 5, 25, 17, 40, 41), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 17, 42, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=99026) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 17:42:55.186892 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5a2e1e70-d9ef-4b13-a5b2-ad5b52b74848 req-e74312b5-520e-41a6-a834-099c9fe636b6 service neutron] Checking segment: {'id': 'd619a116-4277-4bad-a1ec-8ca0357dd129', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1329, 'network_id': '2abe381d-082b-4294-8193-c6556a56adb4'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=99026) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 17:42:55.187275 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5a2e1e70-d9ef-4b13-a5b2-ad5b52b74848 req-e74312b5-520e-41a6-a834-099c9fe636b6 service neutron] Bound using segment: {'id': 'd619a116-4277-4bad-a1ec-8ca0357dd129', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1329, 'network_id': '2abe381d-082b-4294-8193-c6556a56adb4'} {{(pid=99026) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 17:42:55.187713 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.managers [req-5a2e1e70-d9ef-4b13-a5b2-ad5b52b74848 req-e74312b5-520e-41a6-a834-099c9fe636b6 service neutron] Bound port: 8a9ac879-c35f-482a-b8f0-6355fbb9a900, host: hv-cinder-78956, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd619a116-4277-4bad-a1ec-8ca0357dd129', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1329, 'network_id': '2abe381d-082b-4294-8193-c6556a56adb4'}}] {{(pid=99026) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 17:42:55.188058 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [req-5a2e1e70-d9ef-4b13-a5b2-ad5b52b74848 req-e74312b5-520e-41a6-a834-099c9fe636b6 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:55.199145 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] For port 4698ed19-7e41-4457-a1fd-16d5f606084a, host hv-cinder-78956, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=4698ed19-7e41-4457-a1fd-16d5f606084a,segment=NetworkSegment(87df170f-54cc-461b-a7ac-79e125fc526b),segment_id=87df170f-54cc-461b-a7ac-79e125fc526b)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:42:55.201955 dv-cinder-789564-2-iscsi neutron-server[99028]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'cab9bd8d-5b7a-4fc2-85cd-9d4f9884b4ee', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4d583d58-a3d8-4d10-883a-5959fa74e40c', 'code': 200}
May 25 17:42:55.217980 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-65d70856-37c4-4b05-8c5c-da5ce4464bfb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:55.273128 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-ea6b1ea7-f792-4cbc-91a4-9b35b1e4ca71 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:55.286988 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-65d70856-37c4-4b05-8c5c-da5ce4464bfb admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=306e9644fc4746ef8fa4cfff7c7e4d5f&name=default HTTP/1.1" status: 200  len: 2979 time: 1.0037527
May 25 17:42:55.290159 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 40936) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:42:55.326051 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:55.327946 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:55.336258 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65d70856-37c4-4b05-8c5c-da5ce4464bfb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ac121b85-9f23-4567-bf62-2dcfa6146c33,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:55.341942 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-65d70856-37c4-4b05-8c5c-da5ce4464bfb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.069s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:55.404859 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-428802d2-72a1-4b92-b5e5-2eaa7e691e7a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:55.413490 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.db [req-5a2e1e70-d9ef-4b13-a5b2-ad5b52b74848 req-e74312b5-520e-41a6-a834-099c9fe636b6 service neutron] For port 8a9ac879-c35f-482a-b8f0-6355fbb9a900, host hv-cinder-78956, cleared binding levels {{(pid=99026) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 17:42:55.425982 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Pushing event updated for resources: {'Port': ['ID=4698ed19-7e41-4457-a1fd-16d5f606084a,revision_number=5']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:55.435252 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.107s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:55.439869 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.db [req-5a2e1e70-d9ef-4b13-a5b2-ad5b52b74848 req-e74312b5-520e-41a6-a834-099c9fe636b6 service neutron] For port 8a9ac879-c35f-482a-b8f0-6355fbb9a900, host hv-cinder-78956, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=8a9ac879-c35f-482a-b8f0-6355fbb9a900,segment=NetworkSegment(d619a116-4277-4bad-a1ec-8ca0357dd129),segment_id=d619a116-4277-4bad-a1ec-8ca0357dd129)] {{(pid=99026) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 17:42:55.458964 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-428802d2-72a1-4b92-b5e5-2eaa7e691e7a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:55.484777 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-583d90e7-6113-4792-8f31-3cb97bf14c9d req-ae057b3b-8fe2-4fcd-9b4d-83d7645eb8eb tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:42:55.488695 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-583d90e7-6113-4792-8f31-3cb97bf14c9d req-ae057b3b-8fe2-4fcd-9b4d-83d7645eb8eb tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/ports?device_id=3fb3211e-48f5-46f5-8035-ddbc35109aa8 HTTP/1.1" status: 200  len: 946 time: 0.1747410
May 25 17:42:55.539510 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [req-5a2e1e70-d9ef-4b13-a5b2-ad5b52b74848 req-e74312b5-520e-41a6-a834-099c9fe636b6 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15476529'] for port, after_update {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:55.548728 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:55.624695 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a2e1e70-d9ef-4b13-a5b2-ad5b52b74848 req-e74312b5-520e-41a6-a834-099c9fe636b6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:42:55.628438 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [req-5a2e1e70-d9ef-4b13-a5b2-ad5b52b74848 req-e74312b5-520e-41a6-a834-099c9fe636b6 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-239387', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for port, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:55.628438 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-5a2e1e70-d9ef-4b13-a5b2-ad5b52b74848 req-e74312b5-520e-41a6-a834-099c9fe636b6 service neutron] 10.222.0.125 "PUT /v2.0/ports/8a9ac879-c35f-482a-b8f0-6355fbb9a900 HTTP/1.1" status: 200  len: 1093 time: 2.1324632
May 25 17:42:55.632601 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '78a85fac-d281-494d-90da-a47ddc8255e5', 'tag': '8a9ac879-c35f-482a-b8f0-6355fbb9a900'}] {{(pid=99026) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 17:42:55.641951 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-583d90e7-6113-4792-8f31-3cb97bf14c9d req-6b4ed6bc-57c6-47f2-ba2a-ed2c88521d9c tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/security-groups?id=dda11ec6-545c-479e-bba9-4390fea678fa&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1426668
May 25 17:42:55.659319 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e74312b5-520e-41a6-a834-099c9fe636b6 service neutron] Pushing event updated for resources: {'Port': ['ID=8a9ac879-c35f-482a-b8f0-6355fbb9a900,revision_number=3']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:55.662970 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-e74312b5-520e-41a6-a834-099c9fe636b6 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.114s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:55.711267 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-428802d2-72a1-4b92-b5e5-2eaa7e691e7a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:55.720763 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '78a85fac-d281-494d-90da-a47ddc8255e5', 'tag': '8a9ac879-c35f-482a-b8f0-6355fbb9a900', 'status': 'completed', 'code': 200}
May 25 17:42:55.722314 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-f4403198-4bc3-42de-9547-6cb2ce5ac477 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:55.759402 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-428802d2-72a1-4b92-b5e5-2eaa7e691e7a admin admin] Notify callbacks [] for security_group, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:55.760520 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-428802d2-72a1-4b92-b5e5-2eaa7e691e7a admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/ac121b85-9f23-4567-bf62-2dcfa6146c33 HTTP/1.1" status: 204  len: 168 time: 0.4692562
May 25 17:42:55.762762 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-428802d2-72a1-4b92-b5e5-2eaa7e691e7a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ac121b85-9f23-4567-bf62-2dcfa6146c33,revision_number=None']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:55.772632 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-428802d2-72a1-4b92-b5e5-2eaa7e691e7a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:55.785531 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3eebbff3-1cab-433e-8a76-73f42902a0c2 req-73622fe5-1b3e-4fec-8cd3-3deedf0e7859 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:42:55.787914 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-3eebbff3-1cab-433e-8a76-73f42902a0c2 req-73622fe5-1b3e-4fec-8cd3-3deedf0e7859 service neutron] 10.222.0.125 "GET /v2.0/ports?device_id=cab9bd8d-5b7a-4fc2-85cd-9d4f9884b4ee HTTP/1.1" status: 200  len: 1099 time: 0.1661792
May 25 17:42:55.867881 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-3eebbff3-1cab-433e-8a76-73f42902a0c2 req-4da68357-fd06-4152-a376-e14c7139ddb3 service neutron] Notify callbacks [] for security_group, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:55.874842 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-529b1ea1-d971-4256-aa27-1afaa6cbae5d req-057843eb-8cf2-4925-8985-e42851eb3f5f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:42:55.880347 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-529b1ea1-d971-4256-aa27-1afaa6cbae5d req-057843eb-8cf2-4925-8985-e42851eb3f5f service neutron] 10.222.0.125 "GET /v2.0/ports?tenant_id=5b2f6ca8c5b94c2f8894c04f297b5f8b&device_id=78a85fac-d281-494d-90da-a47ddc8255e5 HTTP/1.1" status: 200  len: 1096 time: 0.1235754
May 25 17:42:55.894392 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Device ca8c744f-fdc1-456d-ad85-74dff5ed46eb details requested by agent hyperv_hv-cinder-78956 with host hv-cinder-78956 {{(pid=99028) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 25 17:42:55.904155 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [req-3eebbff3-1cab-433e-8a76-73f42902a0c2 req-4da68357-fd06-4152-a376-e14c7139ddb3 service neutron] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:42:55.918036 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-3eebbff3-1cab-433e-8a76-73f42902a0c2 req-4da68357-fd06-4152-a376-e14c7139ddb3 service neutron] Usage tracker for resource:security_group_rule and tenant:cc52a0c8843849469724bf3edc7e3986 is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:42:55.932188 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-3eebbff3-1cab-433e-8a76-73f42902a0c2 req-4da68357-fd06-4152-a376-e14c7139ddb3 service neutron] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:42:55.945261 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [req-3eebbff3-1cab-433e-8a76-73f42902a0c2 req-4da68357-fd06-4152-a376-e14c7139ddb3 service neutron] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:42:56.087440 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-529b1ea1-d971-4256-aa27-1afaa6cbae5d req-ded2b8c0-6c9d-4b17-9e8f-811ad2bd4afa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:42:56.088896 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-529b1ea1-d971-4256-aa27-1afaa6cbae5d req-ded2b8c0-6c9d-4b17-9e8f-811ad2bd4afa service neutron] 10.222.0.125 "GET /v2.0/networks?tenant_id=5b2f6ca8c5b94c2f8894c04f297b5f8b&shared=False HTTP/1.1" status: 200  len: 920 time: 0.1699119
May 25 17:42:56.097849 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5225caf-fea6-4626-8a39-28dcd6b41665 req-de506cdb-8167-4353-b55e-4c5a7759bb4f tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:42:56.105833 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-d5225caf-fea6-4626-8a39-28dcd6b41665 req-de506cdb-8167-4353-b55e-4c5a7759bb4f tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=78a85fac-d281-494d-90da-a47ddc8255e5 HTTP/1.1" status: 200  len: 943 time: 0.2246253
May 25 17:42:56.142025 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-3eebbff3-1cab-433e-8a76-73f42902a0c2 req-4da68357-fd06-4152-a376-e14c7139ddb3 service neutron] Notify callbacks [] for security_group, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:56.191955 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] For port ca8c744f-fdc1-456d-ad85-74dff5ed46eb, host hv-cinder-78956, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=ca8c744f-fdc1-456d-ad85-74dff5ed46eb,segment=NetworkSegment(d619a116-4277-4bad-a1ec-8ca0357dd129),segment_id=d619a116-4277-4bad-a1ec-8ca0357dd129)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:42:56.220068 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Returning: {'device': 'ca8c744f-fdc1-456d-ad85-74dff5ed46eb', 'network_id': '2abe381d-082b-4294-8193-c6556a56adb4', 'port_id': 'ca8c744f-fdc1-456d-ad85-74dff5ed46eb', 'mac_address': 'fa:16:3e:db:77:6d', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1329, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'e7ef8006-ae0e-4a18-b5c7-707d13fb7031', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=99028) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 25 17:42:56.234737 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-3eebbff3-1cab-433e-8a76-73f42902a0c2 req-4da68357-fd06-4152-a376-e14c7139ddb3 service neutron] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:56.255005 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:56.270792 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-d5225caf-fea6-4626-8a39-28dcd6b41665 req-4e8f648f-5fd8-4a6c-8b97-636331a510da tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1639273
May 25 17:42:56.324083 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:56.356154 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-529b1ea1-d971-4256-aa27-1afaa6cbae5d req-bcc0cba6-d5a0-452e-a8b1-53161b2fb719 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:42:56.357885 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-529b1ea1-d971-4256-aa27-1afaa6cbae5d req-bcc0cba6-d5a0-452e-a8b1-53161b2fb719 service neutron] 10.222.0.125 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 871 time: 0.2496264
May 25 17:42:56.379554 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.notifiers.nova [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id ca8c744f-fdc1-456d-ad85-74dff5ed46eb {{(pid=99028) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 25 17:42:56.410233 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] For port ca8c744f-fdc1-456d-ad85-74dff5ed46eb, host hv-cinder-78956, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=ca8c744f-fdc1-456d-ad85-74dff5ed46eb,segment=NetworkSegment(d619a116-4277-4bad-a1ec-8ca0357dd129),segment_id=d619a116-4277-4bad-a1ec-8ca0357dd129)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:42:56.464797 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-3eebbff3-1cab-433e-8a76-73f42902a0c2 req-4da68357-fd06-4152-a376-e14c7139ddb3 service neutron] 10.222.0.125 "GET /v2.0/security-groups?id=36f94dea-f495-4a32-ab2e-aef5450d5564&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.6708329
May 25 17:42:56.489047 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4da68357-fd06-4152-a376-e14c7139ddb3 service neutron] Pushing event updated for resources: {'SecurityGroup': ['ID=82b92360-171a-4bb5-a9c7-2d6d14fc4246,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:56.494333 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-4da68357-fd06-4152-a376-e14c7139ddb3 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.239s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:56.509479 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:56.513407 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:56.515847 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-3b185cb2-b2f7-4566-870d-a663e59732cf req-d739f941-eb4b-48bf-be53-57615d21bc4a tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] 10.222.0.122 "GET /v2.0/ports?device_id=446d90e5-0bef-47f6-852a-61b638d2a161 HTTP/1.1" status: 200  len: 210 time: 0.0640767
May 25 17:42:56.542828 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f27372a1-b0ff-447f-86df-c265a250f4bc req-23853fc7-392f-4f02-a9cf-cac798e1a724 tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:42:56.550076 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-f27372a1-b0ff-447f-86df-c265a250f4bc req-23853fc7-392f-4f02-a9cf-cac798e1a724 tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] 10.222.0.122 "GET /v2.0/ports?device_id=cab9bd8d-5b7a-4fc2-85cd-9d4f9884b4ee HTTP/1.1" status: 200  len: 946 time: 0.1502390
May 25 17:42:56.556544 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a2e1e70-d9ef-4b13-a5b2-ad5b52b74848 req-47ca2a02-3654-49a0-ade6-d91e7901d20b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:42:56.558140 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-5a2e1e70-d9ef-4b13-a5b2-ad5b52b74848 req-47ca2a02-3654-49a0-ade6-d91e7901d20b service neutron] 10.222.0.125 "GET /v2.0/ports?tenant_id=5b2f6ca8c5b94c2f8894c04f297b5f8b&device_id=78a85fac-d281-494d-90da-a47ddc8255e5 HTTP/1.1" status: 200  len: 1096 time: 0.1427710
May 25 17:42:56.600677 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-f27372a1-b0ff-447f-86df-c265a250f4bc req-51fc2210-8ff2-4c24-aff8-95b1a6f32fad tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] 10.222.0.122 "GET /v2.0/security-groups?id=36f94dea-f495-4a32-ab2e-aef5450d5564&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0462022
May 25 17:42:56.620860 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Pushing event updated for resources: {'Port': ['ID=ca8c744f-fdc1-456d-ad85-74dff5ed46eb,revision_number=4']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:56.638922 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.125s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:56.654691 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-5a2e1e70-d9ef-4b13-a5b2-ad5b52b74848 req-07e4d816-918f-48ad-a322-0cc2209c9123 service neutron] 10.222.0.125 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=8a9ac879-c35f-482a-b8f0-6355fbb9a900 HTTP/1.1" status: 200  len: 217 time: 0.0875461
May 25 17:42:56.717696 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 40976) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:42:56.733787 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] get_ports_and_sgs() called for port_ids ['ca8c744f-fdc1-456d-ad85-74dff5ed46eb'] {{(pid=99028) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 25 17:42:56.760009 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a2e1e70-d9ef-4b13-a5b2-ad5b52b74848 req-a1c5dae7-edca-47c4-840e-88ed031bac42 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:42:56.761529 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-5a2e1e70-d9ef-4b13-a5b2-ad5b52b74848 req-a1c5dae7-edca-47c4-840e-88ed031bac42 service neutron] 10.222.0.125 "GET /v2.0/subnets?id=e7ef8006-ae0e-4a18-b5c7-707d13fb7031 HTTP/1.1" status: 200  len: 858 time: 0.1019239
May 25 17:42:56.828747 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-5a2e1e70-d9ef-4b13-a5b2-ad5b52b74848 req-e2facac2-ea2d-4bdd-9faa-789cdcbce9ee service neutron] 10.222.0.125 "GET /v2.0/ports?network_id=2abe381d-082b-4294-8193-c6556a56adb4&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0568254
May 25 17:42:57.024755 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 40988) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:42:57.080577 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25373e02-7a8e-4f26-87d0-8497f759f450 req-8119ad42-9e16-4a81-a587-65581e4d6241 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:42:57.087592 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-25373e02-7a8e-4f26-87d0-8497f759f450 req-8119ad42-9e16-4a81-a587-65581e4d6241 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/ports?device_id=3fb3211e-48f5-46f5-8035-ddbc35109aa8 HTTP/1.1" status: 200  len: 946 time: 0.2581801
May 25 17:42:57.089688 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-bdaae2bd-1498-4ca4-86ee-13793633d012 admin admin] Notify callbacks [] for security_group, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:57.165702 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-25373e02-7a8e-4f26-87d0-8497f759f450 req-5c221afc-0cf8-489e-99ef-2aa601f41f6e tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/security-groups?id=dda11ec6-545c-479e-bba9-4390fea678fa&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0769894
May 25 17:42:57.197441 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-bdaae2bd-1498-4ca4-86ee-13793633d012 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:42:57.202906 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3fb3211e-48f5-46f5-8035-ddbc35109aa8', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4698ed19-7e41-4457-a1fd-16d5f606084a'}] {{(pid=99028) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 17:42:57.204891 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-bdaae2bd-1498-4ca4-86ee-13793633d012 admin admin] Usage tracker for resource:security_group_rule and tenant:e21a4c4ad648407aaef7e71e6beb2103 is out of sync, need to count used quota {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:42:57.224937 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-5a2e1e70-d9ef-4b13-a5b2-ad5b52b74848 req-4ea8fef6-d578-4da6-9fd0-21034cd62371 service neutron] 10.222.0.125 "GET /v2.0/networks/2abe381d-082b-4294-8193-c6556a56adb4?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3311589
May 25 17:42:57.225975 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-bdaae2bd-1498-4ca4-86ee-13793633d012 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:42:57.236706 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5818dd78-01b4-4a12-b804-96d9d1a34047 req-22bf28d1-f5e1-4c67-a060-e4ae4c201f19 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:42:57.238225 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-bdaae2bd-1498-4ca4-86ee-13793633d012 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:42:57.238739 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-5818dd78-01b4-4a12-b804-96d9d1a34047 req-22bf28d1-f5e1-4c67-a060-e4ae4c201f19 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] 10.222.0.125 "GET /v2.0/networks?id=defaef08-c0f9-4608-b66d-b97e06e185bf HTTP/1.1" status: 200  len: 811 time: 0.2347007
May 25 17:42:57.269981 dv-cinder-789564-2-iscsi neutron-server[99028]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3fb3211e-48f5-46f5-8035-ddbc35109aa8', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4698ed19-7e41-4457-a1fd-16d5f606084a', 'code': 200}
May 25 17:42:57.294064 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-cafb6a1b-2218-4ef1-8268-3a5bf574b2d5 admin admin] Notify callbacks [] for security_group, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:57.350320 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-cafb6a1b-2218-4ef1-8268-3a5bf574b2d5 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:42:57.359825 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-cafb6a1b-2218-4ef1-8268-3a5bf574b2d5 admin admin] Usage tracker for resource:security_group_rule and tenant:302cdb4e25a149b3abf5b961d971c77c is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:42:57.370025 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-cafb6a1b-2218-4ef1-8268-3a5bf574b2d5 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:42:57.381666 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-cafb6a1b-2218-4ef1-8268-3a5bf574b2d5 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:42:57.474543 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-5818dd78-01b4-4a12-b804-96d9d1a34047 req-f8a3365d-c5c5-4229-9f82-bdbd61fb9ffd tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] 10.222.0.125 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=b4cdc54b260f4e79b87fdf4a43b12e16 HTTP/1.1" status: 200  len: 380 time: 0.2197473
May 25 17:42:57.485342 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.v2.base [req-5818dd78-01b4-4a12-b804-96d9d1a34047 req-84305375-ff97-42ab-a947-ebb5cf02e461 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Request body: {'port': {'device_id': '446d90e5-0bef-47f6-852a-61b638d2a161', 'network_id': 'defaef08-c0f9-4608-b66d-b97e06e185bf', 'admin_state_up': True, 'tenant_id': 'b4cdc54b260f4e79b87fdf4a43b12e16', 'security_groups': ['82248efd-bb41-43a8-9551-d25c3e3aa06c']}} {{(pid=99027) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:42:57.727333 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-bdaae2bd-1498-4ca4-86ee-13793633d012 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:57.729814 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-5a2e1e70-d9ef-4b13-a5b2-ad5b52b74848 req-ea11bc08-093a-42d2-9ad0-cb9daa437756 service neutron] 10.222.0.125 "GET /v2.0/networks/2abe381d-082b-4294-8193-c6556a56adb4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.4787209
May 25 17:42:57.746031 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.125', 55512) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:42:57.780576 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-2acbc072-dbd3-439f-8c97-c8da2df05eb5 req-cebd2adf-c610-49c5-bdc7-c7f08440a968 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] 10.222.0.122 "GET /v2.0/ports?device_id=446d90e5-0bef-47f6-852a-61b638d2a161 HTTP/1.1" status: 200  len: 210 time: 0.1094816
May 25 17:42:57.843271 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f77ee4db-6738-48fe-903d-bd79e44659a2 req-e2f61e7d-ea7f-4c61-8121-a344f4da2c52 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:42:57.843479 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-f77ee4db-6738-48fe-903d-bd79e44659a2 req-e2f61e7d-ea7f-4c61-8121-a344f4da2c52 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=78a85fac-d281-494d-90da-a47ddc8255e5 HTTP/1.1" status: 200  len: 943 time: 0.3294065
May 25 17:42:57.854103 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-cafb6a1b-2218-4ef1-8268-3a5bf574b2d5 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:57.873544 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-bdaae2bd-1498-4ca4-86ee-13793633d012 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:57.894430 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:57.898271 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Device ca8c744f-fdc1-456d-ad85-74dff5ed46eb up at agent hyperv_hv-cinder-78956 {{(pid=99028) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 17:42:57.932083 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-f77ee4db-6738-48fe-903d-bd79e44659a2 req-6b5b2120-2b8d-48bc-bd44-5a85ad6e5aad tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0877740
May 25 17:42:57.947187 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [req-5818dd78-01b4-4a12-b804-96d9d1a34047 req-84305375-ff97-42ab-a947-ebb5cf02e461 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:42:57.973841 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bdaae2bd-1498-4ca4-86ee-13793633d012 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=38cd7505-49f1-4cdc-967e-16dd120e934a,revision_number=1']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:57.993710 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-bdaae2bd-1498-4ca4-86ee-13793633d012 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.099s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:57.999823 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-bdaae2bd-1498-4ca4-86ee-13793633d012 admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=e21a4c4ad648407aaef7e71e6beb2103&name=default HTTP/1.1" status: 200  len: 2979 time: 0.9680867
May 25 17:42:58.002389 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f94647fc-5906-4b56-a498-ca86efde110d req-d4fa951c-f137-4b4d-a9b5-c4957938cc86 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:42:58.004138 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-f94647fc-5906-4b56-a498-ca86efde110d req-d4fa951c-f137-4b4d-a9b5-c4957938cc86 service neutron] 10.222.0.125 "GET /v2.0/ports?device_id=3fb3211e-48f5-46f5-8035-ddbc35109aa8 HTTP/1.1" status: 200  len: 1099 time: 0.2528009
May 25 17:42:58.004808 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 41018) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:42:58.050541 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [req-5818dd78-01b4-4a12-b804-96d9d1a34047 req-84305375-ff97-42ab-a947-ebb5cf02e461 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:42:58.056878 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-cafb6a1b-2218-4ef1-8268-3a5bf574b2d5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:58.070787 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:58.082434 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-f94647fc-5906-4b56-a498-ca86efde110d req-259d91b9-7d2f-48d4-a38f-58484beb0dcb service neutron] 10.222.0.125 "GET /v2.0/security-groups?id=dda11ec6-545c-479e-bba9-4390fea678fa&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0629864
May 25 17:42:58.106026 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-9bd132d6-0e31-454e-9804-7c6210741f70 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:58.125418 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-cafb6a1b-2218-4ef1-8268-3a5bf574b2d5 admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=302cdb4e25a149b3abf5b961d971c77c&name=default HTTP/1.1" status: 200  len: 2979 time: 1.4059503
May 25 17:42:58.128338 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 41024) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:42:58.133576 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cafb6a1b-2218-4ef1-8268-3a5bf574b2d5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=99c9b8cd-1a61-4365-b5e0-8bce18947ece,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:58.136968 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-cafb6a1b-2218-4ef1-8268-3a5bf574b2d5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.066s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:58.142129 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Provisioning for port ca8c744f-fdc1-456d-ad85-74dff5ed46eb completed by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 17:42:58.152152 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Provisioning complete for port ca8c744f-fdc1-456d-ad85-74dff5ed46eb triggered by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 17:42:58.152770 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:58.156561 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-9bd132d6-0e31-454e-9804-7c6210741f70 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:58.160343 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f071f72f-53e9-46d5-be3e-8b0ee24dcf3b req-372caed1-6668-4b24-91b1-0ba7004995dd tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:42:58.169062 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-f071f72f-53e9-46d5-be3e-8b0ee24dcf3b req-372caed1-6668-4b24-91b1-0ba7004995dd tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] 10.222.0.122 "GET /v2.0/ports?device_id=cab9bd8d-5b7a-4fc2-85cd-9d4f9884b4ee HTTP/1.1" status: 200  len: 946 time: 0.2134373
May 25 17:42:58.187207 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-5818dd78-01b4-4a12-b804-96d9d1a34047 req-84305375-ff97-42ab-a947-ebb5cf02e461 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Made reservation on behalf of b4cdc54b260f4e79b87fdf4a43b12e16 for: {'port': 1} {{(pid=99027) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 17:42:58.191119 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-5818dd78-01b4-4a12-b804-96d9d1a34047 req-84305375-ff97-42ab-a947-ebb5cf02e461 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:58.292496 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-f071f72f-53e9-46d5-be3e-8b0ee24dcf3b req-72af0276-d08a-4375-b65f-72f73130260e tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] 10.222.0.122 "GET /v2.0/security-groups?id=36f94dea-f495-4a32-ab2e-aef5450d5564&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1224215
May 25 17:42:58.295356 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-08dd849f-bb17-41e7-9980-c87287e34154 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:58.326511 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-08dd849f-bb17-41e7-9980-c87287e34154 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:58.368920 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:58.410017 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] For port ca8c744f-fdc1-456d-ad85-74dff5ed46eb, host hv-cinder-78956, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=ca8c744f-fdc1-456d-ad85-74dff5ed46eb,segment=NetworkSegment(d619a116-4277-4bad-a1ec-8ca0357dd129),segment_id=d619a116-4277-4bad-a1ec-8ca0357dd129)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:42:58.423270 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-9bd132d6-0e31-454e-9804-7c6210741f70 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:58.432936 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:58.446963 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9bd132d6-0e31-454e-9804-7c6210741f70 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=38cd7505-49f1-4cdc-967e-16dd120e934a,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:58.452644 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-9bd132d6-0e31-454e-9804-7c6210741f70 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:58.461743 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-9bd132d6-0e31-454e-9804-7c6210741f70 admin admin] Notify callbacks [] for security_group, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:58.465550 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-9bd132d6-0e31-454e-9804-7c6210741f70 admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/38cd7505-49f1-4cdc-967e-16dd120e934a HTTP/1.1" status: 204  len: 168 time: 0.4567916
May 25 17:42:58.473574 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.db_base_plugin_common [req-5818dd78-01b4-4a12-b804-96d9d1a34047 req-84305375-ff97-42ab-a947-ebb5cf02e461 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Allocated IP 172.20.0.11 (defaef08-c0f9-4608-b66d-b97e06e185bf/5be08358-9d04-4ee9-91ac-104e66e66e20/841b2456-1a8a-47bd-a481-929b9038fe0d) {{(pid=99027) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 17:42:58.498343 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-800676d5-8090-43fa-830b-a8ea76d1d1dc req-c76af47f-91ee-47cf-85b1-d59128d13e4e tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:42:58.514639 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-800676d5-8090-43fa-830b-a8ea76d1d1dc req-c76af47f-91ee-47cf-85b1-d59128d13e4e tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/ports?device_id=3fb3211e-48f5-46f5-8035-ddbc35109aa8 HTTP/1.1" status: 200  len: 946 time: 0.1639462
May 25 17:42:58.514937 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:58.517598 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:58.577153 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-08dd849f-bb17-41e7-9980-c87287e34154 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:58.594376 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-bdaae2bd-1498-4ca4-86ee-13793633d012 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:58.614142 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-08dd849f-bb17-41e7-9980-c87287e34154 admin admin] Notify callbacks [] for security_group, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:58.616149 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-08dd849f-bb17-41e7-9980-c87287e34154 admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/99c9b8cd-1a61-4365-b5e0-8bce18947ece HTTP/1.1" status: 204  len: 168 time: 0.4858201
May 25 17:42:58.631221 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-800676d5-8090-43fa-830b-a8ea76d1d1dc req-36f73ae8-5db1-49de-a8e1-78e2d00b6b54 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/security-groups?id=dda11ec6-545c-479e-bba9-4390fea678fa&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1159408
May 25 17:42:58.633729 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08dd849f-bb17-41e7-9980-c87287e34154 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=99c9b8cd-1a61-4365-b5e0-8bce18947ece,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:58.636965 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-08dd849f-bb17-41e7-9980-c87287e34154 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:58.715458 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Pushing event updated for resources: {'Port': ['ID=ca8c744f-fdc1-456d-ad85-74dff5ed46eb,revision_number=5']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:58.721866 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.203s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:58.834631 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-5818dd78-01b4-4a12-b804-96d9d1a34047 req-84305375-ff97-42ab-a947-ebb5cf02e461 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify callbacks [] for port, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:58.858065 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.provisioning_blocks [req-5818dd78-01b4-4a12-b804-96d9d1a34047 req-84305375-ff97-42ab-a947-ebb5cf02e461 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Transition to ACTIVE for port object 841b2456-1a8a-47bd-a481-929b9038fe0d will not be triggered until provisioned by entity DHCP. {{(pid=99027) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 17:42:58.947397 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-95327cb1-0601-4e9a-b108-cb4d4f644bdc req-2e3e2984-edb4-4dfa-b459-64fcedc0fd07 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] 10.222.0.122 "GET /v2.0/ports?device_id=446d90e5-0bef-47f6-852a-61b638d2a161 HTTP/1.1" status: 200  len: 210 time: 0.0472701
May 25 17:42:58.995256 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-5818dd78-01b4-4a12-b804-96d9d1a34047 req-84305375-ff97-42ab-a947-ebb5cf02e461 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781840788179'] for port, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:59.004081 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-0f91ea39-ed43-4abc-be70-c85f8ec77b7c service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:42:59.083167 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-5818dd78-01b4-4a12-b804-96d9d1a34047 req-84305375-ff97-42ab-a947-ebb5cf02e461 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Network defaef08-c0f9-4608-b66d-b97e06e185bf is already hosted by enough agents. {{(pid=99027) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 17:42:59.087092 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.base_scheduler [req-5818dd78-01b4-4a12-b804-96d9d1a34047 req-84305375-ff97-42ab-a947-ebb5cf02e461 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Resources bound (agent type, host, resource id):  {{(pid=99027) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 17:42:59.091198 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.l3_dvrscheduler_db [req-5818dd78-01b4-4a12-b804-96d9d1a34047 req-84305375-ff97-42ab-a947-ebb5cf02e461 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Received port after_create {{(pid=99027) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 17:42:59.096671 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5818dd78-01b4-4a12-b804-96d9d1a34047 req-84305375-ff97-42ab-a947-ebb5cf02e461 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:42:59.097316 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-5818dd78-01b4-4a12-b804-96d9d1a34047 req-84305375-ff97-42ab-a947-ebb5cf02e461 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-239387', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for port, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:59.176881 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84305375-ff97-42ab-a947-ebb5cf02e461 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Pushing event updated for resources: {'Port': ['ID=841b2456-1a8a-47bd-a481-929b9038fe0d,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:42:59.176881 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-84305375-ff97-42ab-a947-ebb5cf02e461 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.158s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:42:59.199702 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42e72bb7-91f6-4ace-b2f7-ff29209660bd req-35ac8bf2-85a2-45b4-b5d9-5b5c43cee31f tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:42:59.208716 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-42e72bb7-91f6-4ace-b2f7-ff29209660bd req-35ac8bf2-85a2-45b4-b5d9-5b5c43cee31f tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=78a85fac-d281-494d-90da-a47ddc8255e5 HTTP/1.1" status: 200  len: 943 time: 0.1610847
May 25 17:42:59.270464 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '432d7a94-0218-4907-bc7c-650f24a5b1e1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ca8c744f-fdc1-456d-ad85-74dff5ed46eb'}] {{(pid=99028) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 17:42:59.292136 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-5818dd78-01b4-4a12-b804-96d9d1a34047 req-84305375-ff97-42ab-a947-ebb5cf02e461 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] 10.222.0.125 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 1.8117685
May 25 17:42:59.306881 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.v2.base [req-5818dd78-01b4-4a12-b804-96d9d1a34047 req-9f9d9046-5585-4035-a15a-4f713f977a4c service neutron] Request body: {'port': {'device_id': '446d90e5-0bef-47f6-852a-61b638d2a161', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78956'}} {{(pid=99027) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:42:59.312088 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-42e72bb7-91f6-4ace-b2f7-ff29209660bd req-56c7dcdb-81fc-4414-b7af-a9d7959378d9 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1018233
May 25 17:42:59.374891 dv-cinder-789564-2-iscsi neutron-server[99028]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '432d7a94-0218-4907-bc7c-650f24a5b1e1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ca8c744f-fdc1-456d-ad85-74dff5ed46eb', 'code': 200}
May 25 17:42:59.521710 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-5818dd78-01b4-4a12-b804-96d9d1a34047 req-9f9d9046-5585-4035-a15a-4f713f977a4c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:59.611965 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-d77c981e-7206-4605-a60f-ec1f340e0592 None None] Provisioning for port 841b2456-1a8a-47bd-a481-929b9038fe0d completed by entity DHCP. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 17:42:59.618037 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-d77c981e-7206-4605-a60f-ec1f340e0592 None None] Provisioning complete for port 841b2456-1a8a-47bd-a481-929b9038fe0d triggered by entity DHCP. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 17:42:59.618434 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-d77c981e-7206-4605-a60f-ec1f340e0592 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:59.676294 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.plugin [None req-d77c981e-7206-4605-a60f-ec1f340e0592 None None] Port 841b2456-1a8a-47bd-a481-929b9038fe0d cannot update to ACTIVE because it is not bound. {{(pid=99028) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 25 17:42:59.828580 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-710259db-c57b-4e32-a584-0f0e7fabdcf6 req-0c653e95-c4b0-4236-a448-f62b8d3db7ea tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:42:59.830342 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-710259db-c57b-4e32-a584-0f0e7fabdcf6 req-0c653e95-c4b0-4236-a448-f62b8d3db7ea tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/ports?device_id=3fb3211e-48f5-46f5-8035-ddbc35109aa8 HTTP/1.1" status: 200  len: 946 time: 0.0924826
May 25 17:42:59.926442 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-710259db-c57b-4e32-a584-0f0e7fabdcf6 req-4541dd1e-f1e6-401f-b0f3-ff1d0a9d2681 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/security-groups?id=dda11ec6-545c-479e-bba9-4390fea678fa&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0888991
May 25 17:42:59.935841 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.notifiers.nova [req-5818dd78-01b4-4a12-b804-96d9d1a34047 req-9f9d9046-5585-4035-a15a-4f713f977a4c service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 841b2456-1a8a-47bd-a481-929b9038fe0d {{(pid=99027) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 25 17:42:59.955888 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-5818dd78-01b4-4a12-b804-96d9d1a34047 req-9f9d9046-5585-4035-a15a-4f713f977a4c service neutron] Notify callbacks [] for port, precommit_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:42:59.965599 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1af2e88-b1f9-4ad7-8787-aacfc80d1771 req-3d1337c8-fbb4-4e6d-a296-dd83c519ac73 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:42:59.967307 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-c1af2e88-b1f9-4ad7-8787-aacfc80d1771 req-3d1337c8-fbb4-4e6d-a296-dd83c519ac73 service neutron] 10.222.0.125 "GET /v2.0/ports?device_id=432d7a94-0218-4907-bc7c-650f24a5b1e1 HTTP/1.1" status: 200  len: 1098 time: 0.0996008
May 25 17:42:59.969425 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.provisioning_blocks [req-5818dd78-01b4-4a12-b804-96d9d1a34047 req-9f9d9046-5585-4035-a15a-4f713f977a4c service neutron] Transition to ACTIVE for port object 841b2456-1a8a-47bd-a481-929b9038fe0d will not be triggered until provisioned by entity L2. {{(pid=99027) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 17:43:00.032835 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 41072) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:43:00.062926 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-bc39d059-6cba-4559-bf77-90a9c07dff01 admin admin] Notify callbacks [] for security_group, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:00.066625 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-c1af2e88-b1f9-4ad7-8787-aacfc80d1771 req-43dcdae9-c88c-4228-8353-a0971cf8c4f9 service neutron] 10.222.0.125 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0938418
May 25 17:43:00.093045 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-5818dd78-01b4-4a12-b804-96d9d1a34047 req-9f9d9046-5585-4035-a15a-4f713f977a4c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:00.094156 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-bc39d059-6cba-4559-bf77-90a9c07dff01 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:43:00.113966 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-85fd2b34-0182-421e-90a8-ef70bec7b1a7 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:43:00.158466 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 41078) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:43:00.178737 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-bc39d059-6cba-4559-bf77-90a9c07dff01 admin admin] Usage tracker for resource:security_group_rule and tenant:1f62e0aac75a4754949c9e053bd828f7 is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:43:00.197545 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-bc39d059-6cba-4559-bf77-90a9c07dff01 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:43:00.287978 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-bc39d059-6cba-4559-bf77-90a9c07dff01 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:43:00.328335 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-54c7d7ba-b062-4214-a879-719e2d5b802b admin admin] Notify callbacks [] for security_group, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:00.348444 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-54c7d7ba-b062-4214-a879-719e2d5b802b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:43:00.354738 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-54c7d7ba-b062-4214-a879-719e2d5b802b admin admin] Usage tracker for resource:security_group_rule and tenant:4ae078e971884bbbac4af17216f358b0 is out of sync, need to count used quota {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:43:00.356880 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f9d9046-5585-4035-a15a-4f713f977a4c service neutron] Pushing event updated for resources: {'Port': ['ID=841b2456-1a8a-47bd-a481-929b9038fe0d,revision_number=2']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:43:00.364471 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-54c7d7ba-b062-4214-a879-719e2d5b802b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:43:00.366149 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-54c7d7ba-b062-4214-a879-719e2d5b802b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:43:00.385826 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-9f9d9046-5585-4035-a15a-4f713f977a4c service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.276s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:43:00.521390 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.managers [req-5818dd78-01b4-4a12-b804-96d9d1a34047 req-9f9d9046-5585-4035-a15a-4f713f977a4c service neutron] Attempting to bind port 841b2456-1a8a-47bd-a481-929b9038fe0d on host hv-cinder-78956 for vnic_type normal with profile  {{(pid=99027) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 17:43:00.522471 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.managers [req-5818dd78-01b4-4a12-b804-96d9d1a34047 req-9f9d9046-5585-4035-a15a-4f713f977a4c service neutron] Attempting to bind port 841b2456-1a8a-47bd-a481-929b9038fe0d by drivers openvswitch,hyperv on host hv-cinder-78956 at level 0 using segments [{'id': '9ffd894c-b357-4c03-93af-a222f8984466', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1316, 'network_id': 'defaef08-c0f9-4608-b66d-b97e06e185bf'}] {{(pid=99027) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 17:43:00.522872 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5818dd78-01b4-4a12-b804-96d9d1a34047 req-9f9d9046-5585-4035-a15a-4f713f977a4c service neutron] Attempting to bind port 841b2456-1a8a-47bd-a481-929b9038fe0d on network defaef08-c0f9-4608-b66d-b97e06e185bf {{(pid=99027) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 17:43:00.534178 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5818dd78-01b4-4a12-b804-96d9d1a34047 req-9f9d9046-5585-4035-a15a-4f713f977a4c service neutron] Port 841b2456-1a8a-47bd-a481-929b9038fe0d on network defaef08-c0f9-4608-b66d-b97e06e185bf not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78956 {{(pid=99027) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 25 17:43:00.534422 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5818dd78-01b4-4a12-b804-96d9d1a34047 req-9f9d9046-5585-4035-a15a-4f713f977a4c service neutron] Attempting to bind port 841b2456-1a8a-47bd-a481-929b9038fe0d on network defaef08-c0f9-4608-b66d-b97e06e185bf {{(pid=99027) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 17:43:00.551834 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5818dd78-01b4-4a12-b804-96d9d1a34047 req-9f9d9046-5585-4035-a15a-4f713f977a4c service neutron] Checking agent: {'id': '4d02a528-6a0e-4977-985f-4bcff1ca6cb7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78956', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 17, 40, 41), 'started_at': datetime.datetime(2021, 5, 25, 17, 40, 41), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 17, 42, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=99027) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 17:43:00.552080 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5818dd78-01b4-4a12-b804-96d9d1a34047 req-9f9d9046-5585-4035-a15a-4f713f977a4c service neutron] Checking segment: {'id': '9ffd894c-b357-4c03-93af-a222f8984466', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1316, 'network_id': 'defaef08-c0f9-4608-b66d-b97e06e185bf'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=99027) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 17:43:00.552446 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5818dd78-01b4-4a12-b804-96d9d1a34047 req-9f9d9046-5585-4035-a15a-4f713f977a4c service neutron] Bound using segment: {'id': '9ffd894c-b357-4c03-93af-a222f8984466', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1316, 'network_id': 'defaef08-c0f9-4608-b66d-b97e06e185bf'} {{(pid=99027) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 17:43:00.553016 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.managers [req-5818dd78-01b4-4a12-b804-96d9d1a34047 req-9f9d9046-5585-4035-a15a-4f713f977a4c service neutron] Bound port: 841b2456-1a8a-47bd-a481-929b9038fe0d, host: hv-cinder-78956, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '9ffd894c-b357-4c03-93af-a222f8984466', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1316, 'network_id': 'defaef08-c0f9-4608-b66d-b97e06e185bf'}}] {{(pid=99027) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 17:43:00.553449 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-5818dd78-01b4-4a12-b804-96d9d1a34047 req-9f9d9046-5585-4035-a15a-4f713f977a4c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:00.576446 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2ab3f74-0a2b-42d1-bd3f-f938c2281854 req-af329953-7a53-4c5b-9f4a-71bc7279aa9a tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:00.577181 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-f2ab3f74-0a2b-42d1-bd3f-f938c2281854 req-af329953-7a53-4c5b-9f4a-71bc7279aa9a tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Synchronizing usage tracker for tenant:b4cdc54b260f4e79b87fdf4a43b12e16 on resource:port {{(pid=99027) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 17:43:00.596981 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-54c7d7ba-b062-4214-a879-719e2d5b802b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:00.638524 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b65ebd9-c52d-4f5e-b729-665f7940e315 req-adf48cd5-919d-426d-b31a-918ad1d5b39e tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:00.641034 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-6b65ebd9-c52d-4f5e-b729-665f7940e315 req-adf48cd5-919d-426d-b31a-918ad1d5b39e tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=78a85fac-d281-494d-90da-a47ddc8255e5 HTTP/1.1" status: 200  len: 943 time: 0.1803160
May 25 17:43:00.685525 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-54c7d7ba-b062-4214-a879-719e2d5b802b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:00.697681 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:43:00.734393 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-bc39d059-6cba-4559-bf77-90a9c07dff01 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:00.748443 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.db [req-5818dd78-01b4-4a12-b804-96d9d1a34047 req-9f9d9046-5585-4035-a15a-4f713f977a4c service neutron] For port 841b2456-1a8a-47bd-a481-929b9038fe0d, host hv-cinder-78956, cleared binding levels {{(pid=99027) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 17:43:00.751943 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.db [req-5818dd78-01b4-4a12-b804-96d9d1a34047 req-9f9d9046-5585-4035-a15a-4f713f977a4c service neutron] For port 841b2456-1a8a-47bd-a481-929b9038fe0d, host hv-cinder-78956, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=841b2456-1a8a-47bd-a481-929b9038fe0d,segment=NetworkSegment(9ffd894c-b357-4c03-93af-a222f8984466),segment_id=9ffd894c-b357-4c03-93af-a222f8984466)] {{(pid=99027) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 17:43:00.756846 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-54c7d7ba-b062-4214-a879-719e2d5b802b admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=4ae078e971884bbbac4af17216f358b0&name=default HTTP/1.1" status: 200  len: 2979 time: 0.5970643
May 25 17:43:00.759614 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 41096) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:43:00.759934 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-6b65ebd9-c52d-4f5e-b729-665f7940e315 req-85725999-a43e-48b1-bb07-618796cc15bb tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1119137
May 25 17:43:00.761589 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54c7d7ba-b062-4214-a879-719e2d5b802b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1a65305e-122b-4bbf-af8d-4b10d703cb95,revision_number=1']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:43:00.764668 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-54c7d7ba-b062-4214-a879-719e2d5b802b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.067s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:43:00.786249 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-f2ab3f74-0a2b-42d1-bd3f-f938c2281854 req-af329953-7a53-4c5b-9f4a-71bc7279aa9a tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Unset dirty status for tenant:b4cdc54b260f4e79b87fdf4a43b12e16 on resource:port {{(pid=99027) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 17:43:00.787937 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-f2ab3f74-0a2b-42d1-bd3f-f938c2281854 req-af329953-7a53-4c5b-9f4a-71bc7279aa9a tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] 10.222.0.122 "GET /v2.0/ports?device_id=446d90e5-0bef-47f6-852a-61b638d2a161 HTTP/1.1" status: 200  len: 944 time: 0.6100054
May 25 17:43:00.860777 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-f2ab3f74-0a2b-42d1-bd3f-f938c2281854 req-110490f4-a11f-4c4a-a539-30e3d880ae22 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] 10.222.0.122 "GET /v2.0/security-groups?id=82248efd-bb41-43a8-9551-d25c3e3aa06c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0635712
May 25 17:43:00.871320 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-bc39d059-6cba-4559-bf77-90a9c07dff01 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:00.881463 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-65d70856-37c4-4b05-8c5c-da5ce4464bfb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:43:00.904384 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-065dbd7b-a359-4c16-992d-061ab3123d55 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:00.937439 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-5818dd78-01b4-4a12-b804-96d9d1a34047 req-9f9d9046-5585-4035-a15a-4f713f977a4c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:00.939984 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-bc39d059-6cba-4559-bf77-90a9c07dff01 admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=1f62e0aac75a4754949c9e053bd828f7&name=default HTTP/1.1" status: 200  len: 2979 time: 0.9060249
May 25 17:43:00.943166 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 41108) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:43:00.947265 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc39d059-6cba-4559-bf77-90a9c07dff01 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0acf49b4-929d-420d-9fad-a425a6332421,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:43:00.957340 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-bc39d059-6cba-4559-bf77-90a9c07dff01 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:43:00.965037 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.003s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:43:01.029412 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-065dbd7b-a359-4c16-992d-061ab3123d55 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:01.047383 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5818dd78-01b4-4a12-b804-96d9d1a34047 req-9f9d9046-5585-4035-a15a-4f713f977a4c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:01.047383 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-5818dd78-01b4-4a12-b804-96d9d1a34047 req-9f9d9046-5585-4035-a15a-4f713f977a4c service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-239387', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for port, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:01.047876 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-5818dd78-01b4-4a12-b804-96d9d1a34047 req-9f9d9046-5585-4035-a15a-4f713f977a4c service neutron] 10.222.0.125 "PUT /v2.0/ports/841b2456-1a8a-47bd-a481-929b9038fe0d HTTP/1.1" status: 200  len: 1094 time: 1.7468829
May 25 17:43:01.048376 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '446d90e5-0bef-47f6-852a-61b638d2a161', 'tag': '841b2456-1a8a-47bd-a481-929b9038fe0d'}] {{(pid=99027) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 17:43:01.068179 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-e3c54091-5fb0-4105-a346-c62905bdbacd admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:01.101508 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f9d9046-5585-4035-a15a-4f713f977a4c service neutron] Pushing event updated for resources: {'Port': ['ID=841b2456-1a8a-47bd-a481-929b9038fe0d,revision_number=3']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:43:01.108142 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-9f9d9046-5585-4035-a15a-4f713f977a4c service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.148s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:43:01.129725 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '446d90e5-0bef-47f6-852a-61b638d2a161', 'tag': '841b2456-1a8a-47bd-a481-929b9038fe0d', 'status': 'completed', 'code': 200}
May 25 17:43:01.132361 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-e3c54091-5fb0-4105-a346-c62905bdbacd admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:01.217527 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-065dbd7b-a359-4c16-992d-061ab3123d55 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:01.222600 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-be1ce22a-c346-4dfc-a8f7-5241a76a2eb2 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:43:01.236049 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-065dbd7b-a359-4c16-992d-061ab3123d55 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1a65305e-122b-4bbf-af8d-4b10d703cb95,revision_number=None']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:43:01.241024 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-065dbd7b-a359-4c16-992d-061ab3123d55 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:43:01.258956 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-065dbd7b-a359-4c16-992d-061ab3123d55 admin admin] Notify callbacks [] for security_group, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:01.268129 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-065dbd7b-a359-4c16-992d-061ab3123d55 admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/1a65305e-122b-4bbf-af8d-4b10d703cb95 HTTP/1.1" status: 204  len: 168 time: 0.5070298
May 25 17:43:01.332070 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-e3c54091-5fb0-4105-a346-c62905bdbacd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:01.340736 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-08dd849f-bb17-41e7-9980-c87287e34154 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:43:01.362850 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3c54091-5fb0-4105-a346-c62905bdbacd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0acf49b4-929d-420d-9fad-a425a6332421,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:43:01.368000 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-e3c54091-5fb0-4105-a346-c62905bdbacd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:43:01.378742 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-e3c54091-5fb0-4105-a346-c62905bdbacd admin admin] Notify callbacks [] for security_group, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:01.380041 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-e3c54091-5fb0-4105-a346-c62905bdbacd admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/0acf49b4-929d-420d-9fad-a425a6332421 HTTP/1.1" status: 204  len: 168 time: 0.4343016
May 25 17:43:01.901144 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Device 8a9ac879-c35f-482a-b8f0-6355fbb9a900 details requested by agent hyperv_hv-cinder-78956 with host hv-cinder-78956 {{(pid=99028) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 25 17:43:01.957349 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ecaefec-46a7-4225-8dd6-9fc3c1eb822e req-dfdc2e0d-c9c9-4d07-ad4a-20c68a48eeb7 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:01.958705 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-5ecaefec-46a7-4225-8dd6-9fc3c1eb822e req-dfdc2e0d-c9c9-4d07-ad4a-20c68a48eeb7 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Synchronizing usage tracker for tenant:5b2f6ca8c5b94c2f8894c04f297b5f8b on resource:port {{(pid=99027) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 17:43:01.972410 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-5ecaefec-46a7-4225-8dd6-9fc3c1eb822e req-dfdc2e0d-c9c9-4d07-ad4a-20c68a48eeb7 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Unset dirty status for tenant:5b2f6ca8c5b94c2f8894c04f297b5f8b on resource:port {{(pid=99027) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 17:43:01.973684 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-5ecaefec-46a7-4225-8dd6-9fc3c1eb822e req-dfdc2e0d-c9c9-4d07-ad4a-20c68a48eeb7 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=78a85fac-d281-494d-90da-a47ddc8255e5 HTTP/1.1" status: 200  len: 943 time: 0.1010296
May 25 17:43:02.018894 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-5ecaefec-46a7-4225-8dd6-9fc3c1eb822e req-45cbcbd1-61c8-4457-889f-d5612bf4bdd1 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Synchronizing usage tracker for tenant:5b2f6ca8c5b94c2f8894c04f297b5f8b on resource:security_group {{(pid=99027) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 17:43:02.039647 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] For port 8a9ac879-c35f-482a-b8f0-6355fbb9a900, host hv-cinder-78956, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=8a9ac879-c35f-482a-b8f0-6355fbb9a900,segment=NetworkSegment(d619a116-4277-4bad-a1ec-8ca0357dd129),segment_id=d619a116-4277-4bad-a1ec-8ca0357dd129)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:43:02.055357 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Returning: {'device': '8a9ac879-c35f-482a-b8f0-6355fbb9a900', 'network_id': '2abe381d-082b-4294-8193-c6556a56adb4', 'port_id': '8a9ac879-c35f-482a-b8f0-6355fbb9a900', 'mac_address': 'fa:16:3e:de:0d:4f', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1329, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'e7ef8006-ae0e-4a18-b5c7-707d13fb7031', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=99028) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 25 17:43:02.114634 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-5ecaefec-46a7-4225-8dd6-9fc3c1eb822e req-45cbcbd1-61c8-4457-889f-d5612bf4bdd1 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Unset dirty status for tenant:5b2f6ca8c5b94c2f8894c04f297b5f8b on resource:security_group {{(pid=99027) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 17:43:02.115106 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:02.116391 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-5ecaefec-46a7-4225-8dd6-9fc3c1eb822e req-45cbcbd1-61c8-4457-889f-d5612bf4bdd1 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1359923
May 25 17:43:02.134294 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.notifiers.nova [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 8a9ac879-c35f-482a-b8f0-6355fbb9a900 {{(pid=99028) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 25 17:43:02.159149 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] For port 8a9ac879-c35f-482a-b8f0-6355fbb9a900, host hv-cinder-78956, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=8a9ac879-c35f-482a-b8f0-6355fbb9a900,segment=NetworkSegment(d619a116-4277-4bad-a1ec-8ca0357dd129),segment_id=d619a116-4277-4bad-a1ec-8ca0357dd129)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:43:02.217392 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:02.217543 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 41148) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:43:02.219382 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:43:02.240796 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-c83249f1-1865-4339-b2aa-89c023213850 admin admin] Notify callbacks [] for security_group, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:02.259363 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-c83249f1-1865-4339-b2aa-89c023213850 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:43:02.263440 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-c83249f1-1865-4339-b2aa-89c023213850 admin admin] Usage tracker for resource:security_group_rule and tenant:c5b64bfea7e946b2be30996428654bf3 is out of sync, need to count used quota {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:43:02.266576 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-c83249f1-1865-4339-b2aa-89c023213850 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:43:02.273187 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-c83249f1-1865-4339-b2aa-89c023213850 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:43:02.308136 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 41152) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:43:02.314328 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Pushing event updated for resources: {'Port': ['ID=8a9ac879-c35f-482a-b8f0-6355fbb9a900,revision_number=4']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:43:02.319153 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.099s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:43:02.377796 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-c83249f1-1865-4339-b2aa-89c023213850 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:02.393682 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a59b313-181a-47f1-a9ae-4585cb9f5dd9 req-5662c0f0-d7dc-4c17-8e53-d111dd57fb21 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:02.395547 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-5a59b313-181a-47f1-a9ae-4585cb9f5dd9 req-5662c0f0-d7dc-4c17-8e53-d111dd57fb21 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] 10.222.0.122 "GET /v2.0/ports?device_id=446d90e5-0bef-47f6-852a-61b638d2a161 HTTP/1.1" status: 200  len: 944 time: 0.1439071
May 25 17:43:02.462076 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-5a59b313-181a-47f1-a9ae-4585cb9f5dd9 req-7f72c946-4a00-433a-8686-1a8e4127dd3d tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] 10.222.0.122 "GET /v2.0/security-groups?id=82248efd-bb41-43a8-9551-d25c3e3aa06c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0573447
May 25 17:43:02.462899 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-3773cb75-9048-4de0-9d3a-a28906022034 admin admin] Notify callbacks [] for security_group, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:02.480374 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-3773cb75-9048-4de0-9d3a-a28906022034 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:43:02.487619 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-c83249f1-1865-4339-b2aa-89c023213850 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:02.491943 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:43:02.499547 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-3773cb75-9048-4de0-9d3a-a28906022034 admin admin] Usage tracker for resource:security_group_rule and tenant:bfd0cedb2ffe483aa62a9c0e84c3870b is out of sync, need to count used quota {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:43:02.504460 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-3773cb75-9048-4de0-9d3a-a28906022034 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:43:02.526731 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-3773cb75-9048-4de0-9d3a-a28906022034 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:43:02.546866 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-c83249f1-1865-4339-b2aa-89c023213850 admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=c5b64bfea7e946b2be30996428654bf3&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3282914
May 25 17:43:02.548813 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c83249f1-1865-4339-b2aa-89c023213850 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=abd92f76-79de-4759-88fe-a6fd477eac56,revision_number=1']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:43:02.549718 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 41164) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:43:02.553353 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-c83249f1-1865-4339-b2aa-89c023213850 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.060s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:43:02.617561 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-6580a7c3-8722-46d8-956d-f4594062a4de admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:02.630993 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-3773cb75-9048-4de0-9d3a-a28906022034 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:02.644089 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-6580a7c3-8722-46d8-956d-f4594062a4de admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:02.753988 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-3773cb75-9048-4de0-9d3a-a28906022034 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:02.758079 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-510dacd6-8610-4823-b4dc-1c4d243d59f5 req-2e111c14-fe96-46af-9a13-f5e6e7b95828 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:02.759783 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-510dacd6-8610-4823-b4dc-1c4d243d59f5 req-2e111c14-fe96-46af-9a13-f5e6e7b95828 service neutron] 10.222.0.125 "GET /v2.0/ports?tenant_id=b4cdc54b260f4e79b87fdf4a43b12e16&device_id=446d90e5-0bef-47f6-852a-61b638d2a161 HTTP/1.1" status: 200  len: 1097 time: 0.0952089
May 25 17:43:02.765193 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-59b56017-bf19-4545-ae95-6dcdc800972f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:43:02.809020 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-3773cb75-9048-4de0-9d3a-a28906022034 admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=bfd0cedb2ffe483aa62a9c0e84c3870b&name=default HTTP/1.1" status: 200  len: 2979 time: 0.5001664
May 25 17:43:02.810752 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3773cb75-9048-4de0-9d3a-a28906022034 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8778f697-e2cc-4457-8945-00c169bbe9b0,revision_number=1']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:43:02.813157 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 41170) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:43:02.815617 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-3773cb75-9048-4de0-9d3a-a28906022034 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:43:02.861278 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-6580a7c3-8722-46d8-956d-f4594062a4de admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:02.868565 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:43:02.885808 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6580a7c3-8722-46d8-956d-f4594062a4de admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=abd92f76-79de-4759-88fe-a6fd477eac56,revision_number=None']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:43:02.889871 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-3b492d6a-f5c1-47a9-96d5-5ed9d458e10e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:02.895953 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-6580a7c3-8722-46d8-956d-f4594062a4de admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:43:02.918426 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-6580a7c3-8722-46d8-956d-f4594062a4de admin admin] Notify callbacks [] for security_group, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:02.919538 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-6580a7c3-8722-46d8-956d-f4594062a4de admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/abd92f76-79de-4759-88fe-a6fd477eac56 HTTP/1.1" status: 204  len: 168 time: 0.3687787
May 25 17:43:02.932865 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-3b492d6a-f5c1-47a9-96d5-5ed9d458e10e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:02.962724 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-510dacd6-8610-4823-b4dc-1c4d243d59f5 req-1136d8a0-fe38-44f0-9d48-8a83243f9574 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:02.962724 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-510dacd6-8610-4823-b4dc-1c4d243d59f5 req-1136d8a0-fe38-44f0-9d48-8a83243f9574 service neutron] 10.222.0.125 "GET /v2.0/networks?tenant_id=b4cdc54b260f4e79b87fdf4a43b12e16&shared=False HTTP/1.1" status: 200  len: 913 time: 0.1943736
May 25 17:43:03.055161 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] get_ports_and_sgs() called for port_ids ['8a9ac879-c35f-482a-b8f0-6355fbb9a900'] {{(pid=99028) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 25 17:43:03.115644 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-3b492d6a-f5c1-47a9-96d5-5ed9d458e10e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:03.120889 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:43:03.126439 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-510dacd6-8610-4823-b4dc-1c4d243d59f5 req-16dd5808-378c-40c0-b3d1-75f0a2eb4e47 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:03.128193 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-510dacd6-8610-4823-b4dc-1c4d243d59f5 req-16dd5808-378c-40c0-b3d1-75f0a2eb4e47 service neutron] 10.222.0.125 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 871 time: 0.1632853
May 25 17:43:03.134000 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b492d6a-f5c1-47a9-96d5-5ed9d458e10e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8778f697-e2cc-4457-8945-00c169bbe9b0,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:43:03.136253 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-3b492d6a-f5c1-47a9-96d5-5ed9d458e10e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:43:03.143546 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-3b492d6a-f5c1-47a9-96d5-5ed9d458e10e admin admin] Notify callbacks [] for security_group, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:03.147640 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-3b492d6a-f5c1-47a9-96d5-5ed9d458e10e admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/8778f697-e2cc-4457-8945-00c169bbe9b0 HTTP/1.1" status: 204  len: 168 time: 0.3307242
May 25 17:43:03.285206 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5818dd78-01b4-4a12-b804-96d9d1a34047 req-439c27fd-8266-46ee-b1d3-d32973d28d8e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:03.286856 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-5818dd78-01b4-4a12-b804-96d9d1a34047 req-439c27fd-8266-46ee-b1d3-d32973d28d8e service neutron] 10.222.0.125 "GET /v2.0/ports?tenant_id=b4cdc54b260f4e79b87fdf4a43b12e16&device_id=446d90e5-0bef-47f6-852a-61b638d2a161 HTTP/1.1" status: 200  len: 1097 time: 0.1038809
May 25 17:43:03.410253 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-5818dd78-01b4-4a12-b804-96d9d1a34047 req-6e056b12-0a7e-4606-a2f8-0a1d791bf76f service neutron] 10.222.0.125 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=841b2456-1a8a-47bd-a481-929b9038fe0d HTTP/1.1" status: 200  len: 217 time: 0.1143293
May 25 17:43:03.494906 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5818dd78-01b4-4a12-b804-96d9d1a34047 req-0febfa29-619a-40ae-bf1d-c4e1e3e37cb8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:03.496371 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-5818dd78-01b4-4a12-b804-96d9d1a34047 req-0febfa29-619a-40ae-bf1d-c4e1e3e37cb8 service neutron] 10.222.0.125 "GET /v2.0/subnets?id=5be08358-9d04-4ee9-91ac-104e66e66e20 HTTP/1.1" status: 200  len: 850 time: 0.0832434
May 25 17:43:03.565517 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3fc53ef9-b57f-4fbd-916a-981a32f8d99f req-ead4d982-0cdf-4255-a220-e3d9d42fdd6a tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:03.567011 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-3fc53ef9-b57f-4fbd-916a-981a32f8d99f req-ead4d982-0cdf-4255-a220-e3d9d42fdd6a tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=78a85fac-d281-494d-90da-a47ddc8255e5 HTTP/1.1" status: 200  len: 944 time: 0.2017486
May 25 17:43:03.639400 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-3fc53ef9-b57f-4fbd-916a-981a32f8d99f req-af0c7c86-e6b9-4484-aaa4-1b4919b01d05 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0653801
May 25 17:43:03.642654 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5818dd78-01b4-4a12-b804-96d9d1a34047 req-2d64322b-f396-4c7c-8d1b-be5f5961f098 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:03.644029 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-5818dd78-01b4-4a12-b804-96d9d1a34047 req-2d64322b-f396-4c7c-8d1b-be5f5961f098 service neutron] 10.222.0.125 "GET /v2.0/ports?network_id=defaef08-c0f9-4608-b66d-b97e06e185bf&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1423888
May 25 17:43:03.904668 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Device 8a9ac879-c35f-482a-b8f0-6355fbb9a900 up at agent hyperv_hv-cinder-78956 {{(pid=99028) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 17:43:03.905496 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-5818dd78-01b4-4a12-b804-96d9d1a34047 req-07594e48-749f-484d-875f-9096563f3917 service neutron] 10.222.0.125 "GET /v2.0/networks/defaef08-c0f9-4608-b66d-b97e06e185bf?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2531507
May 25 17:43:04.117544 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6384a81-33d8-4766-8d64-41eb26f65ee8 req-6d869b04-0c1b-4d7a-b228-121e73c58f89 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:04.124522 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-e6384a81-33d8-4766-8d64-41eb26f65ee8 req-6d869b04-0c1b-4d7a-b228-121e73c58f89 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] 10.222.0.122 "GET /v2.0/ports?device_id=446d90e5-0bef-47f6-852a-61b638d2a161 HTTP/1.1" status: 200  len: 944 time: 0.3183510
May 25 17:43:04.144262 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Provisioning for port 8a9ac879-c35f-482a-b8f0-6355fbb9a900 completed by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 17:43:04.156085 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Provisioning complete for port 8a9ac879-c35f-482a-b8f0-6355fbb9a900 triggered by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 17:43:04.160720 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:04.209954 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-e6384a81-33d8-4766-8d64-41eb26f65ee8 req-56f07ea6-2344-45ff-969e-08d346199c95 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] 10.222.0.122 "GET /v2.0/security-groups?id=82248efd-bb41-43a8-9551-d25c3e3aa06c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0844846
May 25 17:43:04.222316 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-5818dd78-01b4-4a12-b804-96d9d1a34047 req-53aa46d8-7fce-4b24-8529-832821aebd69 service neutron] 10.222.0.125 "GET /v2.0/networks/defaef08-c0f9-4608-b66d-b97e06e185bf?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3091118
May 25 17:43:04.329541 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:04.356995 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '78a85fac-d281-494d-90da-a47ddc8255e5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8a9ac879-c35f-482a-b8f0-6355fbb9a900'}] {{(pid=99028) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 17:43:04.367498 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] For port 8a9ac879-c35f-482a-b8f0-6355fbb9a900, host hv-cinder-78956, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=8a9ac879-c35f-482a-b8f0-6355fbb9a900,segment=NetworkSegment(d619a116-4277-4bad-a1ec-8ca0357dd129),segment_id=d619a116-4277-4bad-a1ec-8ca0357dd129)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:43:04.406312 dv-cinder-789564-2-iscsi neutron-server[99028]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '78a85fac-d281-494d-90da-a47ddc8255e5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8a9ac879-c35f-482a-b8f0-6355fbb9a900', 'code': 200}
May 25 17:43:04.526390 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:04.528350 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-82c9a063-8ffd-4b7a-a437-cc97b290e03d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:43:04.626211 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Pushing event updated for resources: {'Port': ['ID=8a9ac879-c35f-482a-b8f0-6355fbb9a900,revision_number=5']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:43:04.629897 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.102s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:43:04.994465 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-449b324e-76b1-4874-a771-f30e92a45e5a req-939f6ca4-0336-43ef-a91b-a9a58632b687 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:04.997028 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-449b324e-76b1-4874-a771-f30e92a45e5a req-939f6ca4-0336-43ef-a91b-a9a58632b687 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=78a85fac-d281-494d-90da-a47ddc8255e5 HTTP/1.1" status: 200  len: 945 time: 0.1533239
May 25 17:43:05.005379 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c3314c5-4758-4c61-ae59-372df45eef5c req-8d7279d1-e737-4c33-932f-73231272f40b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:05.007654 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-9c3314c5-4758-4c61-ae59-372df45eef5c req-8d7279d1-e737-4c33-932f-73231272f40b service neutron] 10.222.0.125 "GET /v2.0/ports?device_id=78a85fac-d281-494d-90da-a47ddc8255e5 HTTP/1.1" status: 200  len: 1098 time: 0.1232274
May 25 17:43:05.078480 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-449b324e-76b1-4874-a771-f30e92a45e5a req-53780192-cbdb-40ab-8a58-760c825958f4 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0698447
May 25 17:43:05.082994 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-9c3314c5-4758-4c61-ae59-372df45eef5c req-da2be14c-e179-4536-acc3-f77dc3871e69 service neutron] Synchronizing usage tracker for tenant:cc52a0c8843849469724bf3edc7e3986 on resource:security_group {{(pid=99027) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 17:43:05.206873 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-9c3314c5-4758-4c61-ae59-372df45eef5c req-da2be14c-e179-4536-acc3-f77dc3871e69 service neutron] Unset dirty status for tenant:cc52a0c8843849469724bf3edc7e3986 on resource:security_group {{(pid=99027) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 17:43:05.208085 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-9c3314c5-4758-4c61-ae59-372df45eef5c req-da2be14c-e179-4536-acc3-f77dc3871e69 service neutron] 10.222.0.125 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1843762
May 25 17:43:05.457385 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-983f55ad-dbbd-43fb-9ce1-e9af4ff05a66 req-c2e8c791-cc3a-4e61-ba9c-6c53553b38d3 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:05.459332 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-983f55ad-dbbd-43fb-9ce1-e9af4ff05a66 req-c2e8c791-cc3a-4e61-ba9c-6c53553b38d3 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] 10.222.0.122 "GET /v2.0/ports?device_id=446d90e5-0bef-47f6-852a-61b638d2a161 HTTP/1.1" status: 200  len: 944 time: 0.1011713
May 25 17:43:05.511174 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-983f55ad-dbbd-43fb-9ce1-e9af4ff05a66 req-90dd9e80-e71b-4b7d-ab88-efff08e07afd tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] 10.222.0.122 "GET /v2.0/security-groups?id=82248efd-bb41-43a8-9551-d25c3e3aa06c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0451834
May 25 17:43:06.303822 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2bc3f3d5-c156-4489-92d0-5e8cac1d471b req-19981abe-ee78-496a-aa79-be2757280d3b tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:06.305417 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-2bc3f3d5-c156-4489-92d0-5e8cac1d471b req-19981abe-ee78-496a-aa79-be2757280d3b tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=78a85fac-d281-494d-90da-a47ddc8255e5 HTTP/1.1" status: 200  len: 945 time: 0.1076801
May 25 17:43:06.353640 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-2bc3f3d5-c156-4489-92d0-5e8cac1d471b req-d59406c3-756f-4481-8d08-63770c2b892b tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0419457
May 25 17:43:06.715435 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71cf278c-3725-4285-a840-d49c88d87812 req-90e43855-907c-466e-8017-dcf8b54b382e tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:06.716921 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-71cf278c-3725-4285-a840-d49c88d87812 req-90e43855-907c-466e-8017-dcf8b54b382e tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] 10.222.0.122 "GET /v2.0/ports?device_id=446d90e5-0bef-47f6-852a-61b638d2a161 HTTP/1.1" status: 200  len: 944 time: 0.0947053
May 25 17:43:06.763291 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-71cf278c-3725-4285-a840-d49c88d87812 req-b2bc1b5b-3c8f-4352-b952-ea13c6708d43 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] 10.222.0.122 "GET /v2.0/security-groups?id=82248efd-bb41-43a8-9551-d25c3e3aa06c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0404189
May 25 17:43:07.573800 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4b2ed18-3dcf-43dd-9994-bcde78f2f2b2 req-42cb8e06-552b-4e8a-827c-c67fdb9c2917 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:07.575407 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-e4b2ed18-3dcf-43dd-9994-bcde78f2f2b2 req-42cb8e06-552b-4e8a-827c-c67fdb9c2917 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=78a85fac-d281-494d-90da-a47ddc8255e5 HTTP/1.1" status: 200  len: 945 time: 0.0886550
May 25 17:43:07.629697 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-e4b2ed18-3dcf-43dd-9994-bcde78f2f2b2 req-48ebab20-5fe5-4b39-a32c-835827c4f25f tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0484438
May 25 17:43:07.931760 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Device 841b2456-1a8a-47bd-a481-929b9038fe0d details requested by agent hyperv_hv-cinder-78956 with host hv-cinder-78956 {{(pid=99028) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 25 17:43:07.965011 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 41378) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:43:08.099153 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 41386) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:43:08.124948 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3207360e-c883-4325-9090-bf0b94484a30 req-e7eb37af-0cb9-4374-8a8c-7541e0ed9587 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:08.126667 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-3207360e-c883-4325-9090-bf0b94484a30 req-e7eb37af-0cb9-4374-8a8c-7541e0ed9587 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] 10.222.0.122 "GET /v2.0/ports?device_id=446d90e5-0bef-47f6-852a-61b638d2a161 HTTP/1.1" status: 200  len: 944 time: 0.1929076
May 25 17:43:08.145376 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-4fef7258-9a7c-428d-8345-8f2fb675dacd admin admin] Notify callbacks [] for security_group, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:08.164844 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-4fef7258-9a7c-428d-8345-8f2fb675dacd admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:43:08.169994 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-4fef7258-9a7c-428d-8345-8f2fb675dacd admin admin] Usage tracker for resource:security_group_rule and tenant:53c70c1150de4891914e2e5f51f1c482 is out of sync, need to count used quota {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:43:08.174357 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-4fef7258-9a7c-428d-8345-8f2fb675dacd admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:43:08.182116 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-4fef7258-9a7c-428d-8345-8f2fb675dacd admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:43:08.205849 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-3207360e-c883-4325-9090-bf0b94484a30 req-3c4d19ff-f622-4e0e-991d-26db1a5f3e50 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] 10.222.0.122 "GET /v2.0/security-groups?id=82248efd-bb41-43a8-9551-d25c3e3aa06c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0699401
May 25 17:43:08.243164 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-ac51b8cd-6001-4ddb-8608-d02600c04fb6 admin admin] Notify callbacks [] for security_group, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:08.267733 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-ac51b8cd-6001-4ddb-8608-d02600c04fb6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:43:08.274601 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] For port 841b2456-1a8a-47bd-a481-929b9038fe0d, host hv-cinder-78956, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=841b2456-1a8a-47bd-a481-929b9038fe0d,segment=NetworkSegment(9ffd894c-b357-4c03-93af-a222f8984466),segment_id=9ffd894c-b357-4c03-93af-a222f8984466)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:43:08.276674 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-ac51b8cd-6001-4ddb-8608-d02600c04fb6 admin admin] Usage tracker for resource:security_group_rule and tenant:ea9e7ac742f1402baadf8418715002ab is out of sync, need to count used quota {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:43:08.280413 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-ac51b8cd-6001-4ddb-8608-d02600c04fb6 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:43:08.289800 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Returning: {'device': '841b2456-1a8a-47bd-a481-929b9038fe0d', 'network_id': 'defaef08-c0f9-4608-b66d-b97e06e185bf', 'port_id': '841b2456-1a8a-47bd-a481-929b9038fe0d', 'mac_address': 'fa:16:3e:e6:e6:e1', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1316, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '5be08358-9d04-4ee9-91ac-104e66e66e20', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=99028) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 25 17:43:08.290539 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-ac51b8cd-6001-4ddb-8608-d02600c04fb6 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:43:08.367826 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-4fef7258-9a7c-428d-8345-8f2fb675dacd admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:08.371817 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:08.404853 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.notifiers.nova [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 841b2456-1a8a-47bd-a481-929b9038fe0d {{(pid=99028) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 25 17:43:08.427961 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-ac51b8cd-6001-4ddb-8608-d02600c04fb6 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:08.430472 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] For port 841b2456-1a8a-47bd-a481-929b9038fe0d, host hv-cinder-78956, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=841b2456-1a8a-47bd-a481-929b9038fe0d,segment=NetworkSegment(9ffd894c-b357-4c03-93af-a222f8984466),segment_id=9ffd894c-b357-4c03-93af-a222f8984466)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:43:08.445787 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-4fef7258-9a7c-428d-8345-8f2fb675dacd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:08.453103 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-2154e082-d3d3-4d05-a833-3f0c9da9bf8e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:43:08.503731 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4fef7258-9a7c-428d-8345-8f2fb675dacd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a59f7a39-2998-4405-8183-dd99c8b672fc,revision_number=1']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:43:08.508861 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-ac51b8cd-6001-4ddb-8608-d02600c04fb6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:08.520607 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:08.523889 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-d329346d-8f64-4913-a945-427009f9577d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:43:08.547958 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-4fef7258-9a7c-428d-8345-8f2fb675dacd admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=53c70c1150de4891914e2e5f51f1c482&name=default HTTP/1.1" status: 200  len: 2979 time: 0.5817568
May 25 17:43:08.549644 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-4fef7258-9a7c-428d-8345-8f2fb675dacd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.096s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:43:08.550430 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-4fef7258-9a7c-428d-8345-8f2fb675dacd admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:43:08.560714 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 41402) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:43:08.560969 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-ac51b8cd-6001-4ddb-8608-d02600c04fb6 admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=ea9e7ac742f1402baadf8418715002ab&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4604242
May 25 17:43:08.563715 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 41404) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:43:08.567270 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21ba24a8-0989-4f0b-ace9-9787623130fc req-d91ead2f-cb60-498f-9a0c-634667c6edab tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:08.569916 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-21ba24a8-0989-4f0b-ace9-9787623130fc req-d91ead2f-cb60-498f-9a0c-634667c6edab tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=78a85fac-d281-494d-90da-a47ddc8255e5 HTTP/1.1" status: 200  len: 945 time: 0.2272656
May 25 17:43:08.624156 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a09313a-c1c7-4704-91df-24be83aba55c req-c537a5f2-2100-475d-a1d2-1638e962d1c6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:08.626753 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-3a09313a-c1c7-4704-91df-24be83aba55c req-c537a5f2-2100-475d-a1d2-1638e962d1c6 service neutron] 10.222.0.125 "GET /v2.0/ports?tenant_id=5b2f6ca8c5b94c2f8894c04f297b5f8b&device_id=78a85fac-d281-494d-90da-a47ddc8255e5 HTTP/1.1" status: 200  len: 1098 time: 0.1936085
May 25 17:43:08.627108 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Pushing event updated for resources: {'Port': ['ID=841b2456-1a8a-47bd-a481-929b9038fe0d,revision_number=4']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:43:08.629725 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac51b8cd-6001-4ddb-8608-d02600c04fb6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=283a1b85-e75a-4bd0-8413-3269427baf40,revision_number=1']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:43:08.650790 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-ac51b8cd-6001-4ddb-8608-d02600c04fb6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.100s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:43:08.651587 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.127s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:43:08.674552 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-e605148a-a5b1-4721-9964-6f5fba1a25cc admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:08.694834 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-e605148a-a5b1-4721-9964-6f5fba1a25cc admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:08.765310 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-21ba24a8-0989-4f0b-ace9-9787623130fc req-7521345f-d413-4832-a89f-498a7450e15d tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1794264
May 25 17:43:08.802383 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-9247970c-f8a4-45e4-ba1a-15db8eddd80e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:08.835992 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a09313a-c1c7-4704-91df-24be83aba55c req-9112d5cf-e8a1-46f8-80b8-d0c5699eafc9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:08.837482 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-3a09313a-c1c7-4704-91df-24be83aba55c req-9112d5cf-e8a1-46f8-80b8-d0c5699eafc9 service neutron] 10.222.0.125 "GET /v2.0/networks?id=2abe381d-082b-4294-8193-c6556a56adb4 HTTP/1.1" status: 200  len: 920 time: 0.1967258
May 25 17:43:08.845331 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-9247970c-f8a4-45e4-ba1a-15db8eddd80e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:08.863159 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-e605148a-a5b1-4721-9964-6f5fba1a25cc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:08.869726 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-0600cc52-96bd-4f44-86e3-62a1d0d92f1d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:43:08.925276 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-3a09313a-c1c7-4704-91df-24be83aba55c req-0b10de7b-1698-4406-b0bf-6593fd071354 service neutron] 10.222.0.125 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=8a9ac879-c35f-482a-b8f0-6355fbb9a900 HTTP/1.1" status: 200  len: 217 time: 0.0731370
May 25 17:43:08.945593 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e605148a-a5b1-4721-9964-6f5fba1a25cc admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=283a1b85-e75a-4bd0-8413-3269427baf40,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:43:08.949533 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-e605148a-a5b1-4721-9964-6f5fba1a25cc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.080s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:43:08.958278 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] get_ports_and_sgs() called for port_ids ['841b2456-1a8a-47bd-a481-929b9038fe0d'] {{(pid=99028) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 25 17:43:08.959854 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-e605148a-a5b1-4721-9964-6f5fba1a25cc admin admin] Notify callbacks [] for security_group, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:08.961032 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-e605148a-a5b1-4721-9964-6f5fba1a25cc admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/283a1b85-e75a-4bd0-8413-3269427baf40 HTTP/1.1" status: 204  len: 168 time: 0.3961842
May 25 17:43:09.040089 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a09313a-c1c7-4704-91df-24be83aba55c req-b1f21ca5-db71-4597-bb14-a2c907f2d41b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:09.042152 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-3a09313a-c1c7-4704-91df-24be83aba55c req-b1f21ca5-db71-4597-bb14-a2c907f2d41b service neutron] 10.222.0.125 "GET /v2.0/subnets?id=e7ef8006-ae0e-4a18-b5c7-707d13fb7031 HTTP/1.1" status: 200  len: 858 time: 0.1069961
May 25 17:43:09.102232 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-3a09313a-c1c7-4704-91df-24be83aba55c req-6880bacd-f505-4e2e-a64f-bede488549f8 service neutron] 10.222.0.125 "GET /v2.0/ports?network_id=2abe381d-082b-4294-8193-c6556a56adb4&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0536697
May 25 17:43:09.195784 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-9247970c-f8a4-45e4-ba1a-15db8eddd80e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:09.201444 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-b69984ae-83f0-4cc6-937e-92a681c39e86 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:43:09.222355 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9247970c-f8a4-45e4-ba1a-15db8eddd80e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a59f7a39-2998-4405-8183-dd99c8b672fc,revision_number=None']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:43:09.225656 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-9247970c-f8a4-45e4-ba1a-15db8eddd80e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:43:09.247899 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-9247970c-f8a4-45e4-ba1a-15db8eddd80e admin admin] Notify callbacks [] for security_group, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:09.259934 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-9247970c-f8a4-45e4-ba1a-15db8eddd80e admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/a59f7a39-2998-4405-8183-dd99c8b672fc HTTP/1.1" status: 204  len: 168 time: 0.6882486
May 25 17:43:09.319061 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-3a09313a-c1c7-4704-91df-24be83aba55c req-f859950b-4e06-45d0-a266-a16d1419abf1 service neutron] 10.222.0.125 "GET /v2.0/networks/2abe381d-082b-4294-8193-c6556a56adb4?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2111619
May 25 17:43:09.466322 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef257b07-b490-4b92-be48-dda79e9cbc27 req-482de294-7917-4551-8444-93edd6025fc5 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:09.467910 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-ef257b07-b490-4b92-be48-dda79e9cbc27 req-482de294-7917-4551-8444-93edd6025fc5 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] 10.222.0.122 "GET /v2.0/ports?device_id=446d90e5-0bef-47f6-852a-61b638d2a161 HTTP/1.1" status: 200  len: 945 time: 0.0888798
May 25 17:43:09.473442 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-3a09313a-c1c7-4704-91df-24be83aba55c req-f1adf672-95d1-4cfb-9638-aef294bd0d22 service neutron] 10.222.0.125 "GET /v2.0/networks/2abe381d-082b-4294-8193-c6556a56adb4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1489673
May 25 17:43:09.518363 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-ef257b07-b490-4b92-be48-dda79e9cbc27 req-e9aa5ba5-c875-45a8-a56f-1c9f57222374 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] 10.222.0.122 "GET /v2.0/security-groups?id=82248efd-bb41-43a8-9551-d25c3e3aa06c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0448799
May 25 17:43:09.897004 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 41454) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:43:09.917535 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-a8f1caea-8429-4922-8028-1df177bb447c admin admin] Notify callbacks [] for security_group, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:09.936290 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-a8f1caea-8429-4922-8028-1df177bb447c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:43:09.942692 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-a8f1caea-8429-4922-8028-1df177bb447c admin admin] Usage tracker for resource:security_group_rule and tenant:05ded22f474245efa22febcc438d2a25 is out of sync, need to count used quota {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:43:09.946152 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-a8f1caea-8429-4922-8028-1df177bb447c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:43:09.951971 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-a8f1caea-8429-4922-8028-1df177bb447c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:43:09.963119 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-097ff7a3-7193-4727-b0b3-9e2c6e967a18 req-ad6aa775-72cb-41db-99b0-bea002302887 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:09.963627 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Device 841b2456-1a8a-47bd-a481-929b9038fe0d up at agent hyperv_hv-cinder-78956 {{(pid=99028) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 17:43:09.964642 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-097ff7a3-7193-4727-b0b3-9e2c6e967a18 req-ad6aa775-72cb-41db-99b0-bea002302887 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=78a85fac-d281-494d-90da-a47ddc8255e5 HTTP/1.1" status: 200  len: 945 time: 0.0867391
May 25 17:43:10.026836 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-097ff7a3-7193-4727-b0b3-9e2c6e967a18 req-f3d9796f-f327-4e8a-9f05-d96cde15bf85 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0563068
May 25 17:43:10.086699 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-a8f1caea-8429-4922-8028-1df177bb447c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:10.146028 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 41466) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:43:10.149328 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Provisioning for port 841b2456-1a8a-47bd-a481-929b9038fe0d completed by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 17:43:10.155144 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Provisioning complete for port 841b2456-1a8a-47bd-a481-929b9038fe0d triggered by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 17:43:10.157229 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:10.166175 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-177d4da4-fc7b-4b3d-b4b8-7b8424809204 admin admin] Notify callbacks [] for security_group, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:10.182285 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-177d4da4-fc7b-4b3d-b4b8-7b8424809204 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:43:10.186395 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-177d4da4-fc7b-4b3d-b4b8-7b8424809204 admin admin] Usage tracker for resource:security_group_rule and tenant:a463afe80a8f4b4d92aebe0057001b88 is out of sync, need to count used quota {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:43:10.189363 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-177d4da4-fc7b-4b3d-b4b8-7b8424809204 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:43:10.195567 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-177d4da4-fc7b-4b3d-b4b8-7b8424809204 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:43:10.215089 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-a8f1caea-8429-4922-8028-1df177bb447c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:10.225355 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-aa7f2d94-cb9f-46e8-b481-9db8fe60626a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:43:10.266321 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8f1caea-8429-4922-8028-1df177bb447c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=46ce4641-4d2f-4b60-a1a8-0934fa714eb2,revision_number=1']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:43:10.269740 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-a8f1caea-8429-4922-8028-1df177bb447c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:43:10.292519 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-a8f1caea-8429-4922-8028-1df177bb447c admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=05ded22f474245efa22febcc438d2a25&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3941944
May 25 17:43:10.295530 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 41474) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:43:10.296156 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:10.338373 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '446d90e5-0bef-47f6-852a-61b638d2a161', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '841b2456-1a8a-47bd-a481-929b9038fe0d'}] {{(pid=99028) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 17:43:10.360176 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] For port 841b2456-1a8a-47bd-a481-929b9038fe0d, host hv-cinder-78956, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=841b2456-1a8a-47bd-a481-929b9038fe0d,segment=NetworkSegment(9ffd894c-b357-4c03-93af-a222f8984466),segment_id=9ffd894c-b357-4c03-93af-a222f8984466)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:43:10.392345 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-177d4da4-fc7b-4b3d-b4b8-7b8424809204 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:10.395988 dv-cinder-789564-2-iscsi neutron-server[99028]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '446d90e5-0bef-47f6-852a-61b638d2a161', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '841b2456-1a8a-47bd-a481-929b9038fe0d', 'code': 200}
May 25 17:43:10.463502 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-01e7b11f-c9d1-450d-8a0d-f331138a7d3f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:10.477920 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-01e7b11f-c9d1-450d-8a0d-f331138a7d3f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:10.720914 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f340ff2d-d948-4011-816b-f1b305d6b306 req-d080bf7f-db43-46a9-934b-3b88d8517169 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:10.722271 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-f340ff2d-d948-4011-816b-f1b305d6b306 req-d080bf7f-db43-46a9-934b-3b88d8517169 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] 10.222.0.122 "GET /v2.0/ports?device_id=446d90e5-0bef-47f6-852a-61b638d2a161 HTTP/1.1" status: 200  len: 945 time: 0.0856991
May 25 17:43:10.770048 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-f340ff2d-d948-4011-816b-f1b305d6b306 req-463c2d8d-e046-4bb7-b95d-b577544082b5 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] 10.222.0.122 "GET /v2.0/security-groups?id=82248efd-bb41-43a8-9551-d25c3e3aa06c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0409079
May 25 17:43:11.234917 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:11.235912 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-01e7b11f-c9d1-450d-8a0d-f331138a7d3f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:11.237588 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:43:11.241527 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-bc39d059-6cba-4559-bf77-90a9c07dff01 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:43:11.257631 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-694c4884-d3e1-4cb9-b1b4-6b38caebdb32 req-07ee2cce-95bf-432b-99d0-c01284276804 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:11.261321 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01e7b11f-c9d1-450d-8a0d-f331138a7d3f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=46ce4641-4d2f-4b60-a1a8-0934fa714eb2,revision_number=None']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:43:11.266056 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-694c4884-d3e1-4cb9-b1b4-6b38caebdb32 req-07ee2cce-95bf-432b-99d0-c01284276804 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=78a85fac-d281-494d-90da-a47ddc8255e5 HTTP/1.1" status: 200  len: 945 time: 0.1088276
May 25 17:43:11.269399 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-177d4da4-fc7b-4b3d-b4b8-7b8424809204 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:11.272168 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-01e7b11f-c9d1-450d-8a0d-f331138a7d3f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:43:11.276324 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-01e7b11f-c9d1-450d-8a0d-f331138a7d3f admin admin] Notify callbacks [] for security_group, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:11.292963 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-01e7b11f-c9d1-450d-8a0d-f331138a7d3f admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/46ce4641-4d2f-4b60-a1a8-0934fa714eb2 HTTP/1.1" status: 204  len: 168 time: 0.9908531
May 25 17:43:11.302117 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:43:11.347652 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Pushing event updated for resources: {'Port': ['ID=841b2456-1a8a-47bd-a481-929b9038fe0d,revision_number=5']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:43:11.351976 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.114s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:43:11.367575 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-177d4da4-fc7b-4b3d-b4b8-7b8424809204 admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=a463afe80a8f4b4d92aebe0057001b88&name=default HTTP/1.1" status: 200  len: 2979 time: 1.2159917
May 25 17:43:11.367684 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 41502) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:43:11.368075 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-177d4da4-fc7b-4b3d-b4b8-7b8424809204 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2c75d958-585e-4e17-bc57-26e5abbb7a02,revision_number=1']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:43:11.372809 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-177d4da4-fc7b-4b3d-b4b8-7b8424809204 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:43:11.375982 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-694c4884-d3e1-4cb9-b1b4-6b38caebdb32 req-69893870-2408-4f1f-b9ce-d0d26595314b tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1090527
May 25 17:43:11.497030 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-284c234f-96e5-487e-9e41-fa28ae0ecaf3 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:11.502976 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:11.534587 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-284c234f-96e5-487e-9e41-fa28ae0ecaf3 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:11.562219 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1505bc30-f99f-4706-b7cd-b91218481d2c req-382fa0f7-7b2e-47cf-9c95-5846a1c4b856 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:11.563674 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-1505bc30-f99f-4706-b7cd-b91218481d2c req-382fa0f7-7b2e-47cf-9c95-5846a1c4b856 service neutron] 10.222.0.125 "GET /v2.0/ports?device_id=446d90e5-0bef-47f6-852a-61b638d2a161 HTTP/1.1" status: 200  len: 1099 time: 0.1574557
May 25 17:43:11.615991 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-1505bc30-f99f-4706-b7cd-b91218481d2c req-131370b2-8426-4ea4-83f6-2e19a549544e service neutron] 10.222.0.125 "GET /v2.0/security-groups?id=82248efd-bb41-43a8-9551-d25c3e3aa06c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0405648
May 25 17:43:11.703160 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-284c234f-96e5-487e-9e41-fa28ae0ecaf3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:11.707953 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:43:11.720304 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-284c234f-96e5-487e-9e41-fa28ae0ecaf3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2c75d958-585e-4e17-bc57-26e5abbb7a02,revision_number=None']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:43:11.723276 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-284c234f-96e5-487e-9e41-fa28ae0ecaf3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:43:11.726282 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-284c234f-96e5-487e-9e41-fa28ae0ecaf3 admin admin] Notify callbacks [] for security_group, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:11.729026 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-284c234f-96e5-487e-9e41-fa28ae0ecaf3 admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/2c75d958-585e-4e17-bc57-26e5abbb7a02 HTTP/1.1" status: 204  len: 168 time: 0.3582168
May 25 17:43:11.969641 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff9be2bb-9331-4943-8875-7887946b6200 req-54023b7d-dba7-4f7e-a0e0-91e43d8d09ea tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:11.971106 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-ff9be2bb-9331-4943-8875-7887946b6200 req-54023b7d-dba7-4f7e-a0e0-91e43d8d09ea tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] 10.222.0.122 "GET /v2.0/ports?device_id=446d90e5-0bef-47f6-852a-61b638d2a161 HTTP/1.1" status: 200  len: 946 time: 0.0881755
May 25 17:43:12.018200 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-ff9be2bb-9331-4943-8875-7887946b6200 req-11e622a5-8645-40aa-a267-a9acd22a8bda tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] 10.222.0.122 "GET /v2.0/security-groups?id=82248efd-bb41-43a8-9551-d25c3e3aa06c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0412314
May 25 17:43:12.657558 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc972c9e-e36c-4511-9a50-f68cbf06914d req-1c8a7a27-a084-4ae4-9adf-d284914f5c16 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:12.662018 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-bc972c9e-e36c-4511-9a50-f68cbf06914d req-1c8a7a27-a084-4ae4-9adf-d284914f5c16 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=78a85fac-d281-494d-90da-a47ddc8255e5 HTTP/1.1" status: 200  len: 945 time: 0.1372304
May 25 17:43:12.720060 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-bc972c9e-e36c-4511-9a50-f68cbf06914d req-3387e103-9d22-4ce9-90f9-11459caa0011 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0514522
May 25 17:43:13.214445 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24a75721-3cc4-41b6-a81c-d0cadbf9896c req-8ece3b0a-8c1c-4e1f-b607-9eabe78239f5 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:13.216185 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-24a75721-3cc4-41b6-a81c-d0cadbf9896c req-8ece3b0a-8c1c-4e1f-b607-9eabe78239f5 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] 10.222.0.122 "GET /v2.0/ports?device_id=446d90e5-0bef-47f6-852a-61b638d2a161 HTTP/1.1" status: 200  len: 946 time: 0.0873973
May 25 17:43:13.266350 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-24a75721-3cc4-41b6-a81c-d0cadbf9896c req-9328e566-56de-4687-a123-1498b23d8c7c tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] 10.222.0.122 "GET /v2.0/security-groups?id=82248efd-bb41-43a8-9551-d25c3e3aa06c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0435917
May 25 17:43:13.332587 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 41590) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:43:13.462594 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-407e23bd-5d87-47a2-bc89-f7a60f0b9f15 req-49a99dfb-228e-448b-a52d-40ea719eb47e tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:13.464060 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-407e23bd-5d87-47a2-bc89-f7a60f0b9f15 req-49a99dfb-228e-448b-a52d-40ea719eb47e tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] 10.222.0.122 "GET /v2.0/ports?device_id=446d90e5-0bef-47f6-852a-61b638d2a161 HTTP/1.1" status: 200  len: 946 time: 0.0853620
May 25 17:43:13.473627 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 41596) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:43:13.478338 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-6eba753c-d73e-4f1b-a0f8-376e2e776da7 admin admin] Notify callbacks [] for security_group, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:13.479044 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.v2.base [None req-91af91a3-105e-495c-8d2a-4f25f4cafe91 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Request body: {'floatingip': {'port_id': '841b2456-1a8a-47bd-a481-929b9038fe0d'}} {{(pid=99026) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:43:13.504292 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-6eba753c-d73e-4f1b-a0f8-376e2e776da7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:43:13.511594 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-6eba753c-d73e-4f1b-a0f8-376e2e776da7 admin admin] Usage tracker for resource:security_group_rule and tenant:9185bf2dbd80425f974a6e69bf5efebb is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:43:13.514718 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-6eba753c-d73e-4f1b-a0f8-376e2e776da7 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:43:13.522061 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-6eba753c-d73e-4f1b-a0f8-376e2e776da7 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:43:13.572603 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-91af91a3-105e-495c-8d2a-4f25f4cafe91 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify callbacks [] for floatingip, before_update {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:13.622890 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-6eba753c-d73e-4f1b-a0f8-376e2e776da7 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:13.709444 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-6eba753c-d73e-4f1b-a0f8-376e2e776da7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:13.718511 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-895a4e5d-1dee-4eaa-9901-7959a4c515d6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:43:13.770100 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-6eba753c-d73e-4f1b-a0f8-376e2e776da7 admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=9185bf2dbd80425f974a6e69bf5efebb&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4363120
May 25 17:43:13.771046 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 41620) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:43:13.776192 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6eba753c-d73e-4f1b-a0f8-376e2e776da7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2b5513dd-62f5-43ec-9e0a-df49e39eb0be,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:43:13.779908 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-6eba753c-d73e-4f1b-a0f8-376e2e776da7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.061s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:43:13.959164 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-82e7db09-a951-4529-88ef-9ad4612d2511 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:14.009240 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf57c753-6088-4f2c-9b2d-7934667da026 req-56c2eadc-33fa-4a62-8db8-70f8ebaf5248 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:14.011346 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-bf57c753-6088-4f2c-9b2d-7934667da026 req-56c2eadc-33fa-4a62-8db8-70f8ebaf5248 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=78a85fac-d281-494d-90da-a47ddc8255e5 HTTP/1.1" status: 200  len: 945 time: 0.1427124
May 25 17:43:14.065698 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-82e7db09-a951-4529-88ef-9ad4612d2511 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:14.084910 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-bf57c753-6088-4f2c-9b2d-7934667da026 req-00f38bc7-f9b0-4652-ac35-cf347008734a tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0674603
May 25 17:43:14.186047 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 41632) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:43:14.518348 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.db.resource_extend [None req-91af91a3-105e-495c-8d2a-4f25f4cafe91 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] It took 0.14 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=99026) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}}
May 25 17:43:14.539866 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-8fec1ca0-7672-4e72-9431-fe9db4d5883a admin admin] Notify callbacks [] for security_group, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:14.561028 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-8fec1ca0-7672-4e72-9431-fe9db4d5883a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:43:14.567137 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-8fec1ca0-7672-4e72-9431-fe9db4d5883a admin admin] Usage tracker for resource:security_group_rule and tenant:2906b92a03064de8911eabd3b0c80c1d is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:43:14.571480 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-8fec1ca0-7672-4e72-9431-fe9db4d5883a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:43:14.598672 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-82e7db09-a951-4529-88ef-9ad4612d2511 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:14.613481 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-9bd132d6-0e31-454e-9804-7c6210741f70 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:43:14.615653 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-8fec1ca0-7672-4e72-9431-fe9db4d5883a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:43:14.631013 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82e7db09-a951-4529-88ef-9ad4612d2511 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2b5513dd-62f5-43ec-9e0a-df49e39eb0be,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:43:14.641692 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-91af91a3-105e-495c-8d2a-4f25f4cafe91 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify callbacks [] for floatingip, precommit_update {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:14.648805 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-82e7db09-a951-4529-88ef-9ad4612d2511 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:43:14.654162 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-82e7db09-a951-4529-88ef-9ad4612d2511 admin admin] Notify callbacks [] for security_group, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:14.655653 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-82e7db09-a951-4529-88ef-9ad4612d2511 admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/2b5513dd-62f5-43ec-9e0a-df49e39eb0be HTTP/1.1" status: 204  len: 168 time: 0.8828363
May 25 17:43:14.711124 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25fd3bef-2de8-46c9-af90-0d52e869bbf5 req-d69892e1-423a-49b8-b00b-564f79808677 tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:14.713409 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-25fd3bef-2de8-46c9-af90-0d52e869bbf5 req-d69892e1-423a-49b8-b00b-564f79808677 tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] 10.222.0.122 "GET /v2.0/ports?device_id=cab9bd8d-5b7a-4fc2-85cd-9d4f9884b4ee HTTP/1.1" status: 200  len: 946 time: 0.1338334
May 25 17:43:14.754469 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-91af91a3-105e-495c-8d2a-4f25f4cafe91 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-419865'] for floatingip, after_update {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:14.761410 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.agents_db [None req-14fae233-15dc-4576-836b-621c5f95b584 None None] Agent healthcheck: found 6 active agents {{(pid=99029) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 17:43:14.790993 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-25fd3bef-2de8-46c9-af90-0d52e869bbf5 req-f9629a52-61bd-4837-8ebf-67094811a694 tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] 10.222.0.122 "GET /v2.0/security-groups?id=36f94dea-f495-4a32-ab2e-aef5450d5564&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0717621
May 25 17:43:14.792591 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-8fec1ca0-7672-4e72-9431-fe9db4d5883a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:14.921892 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-8fec1ca0-7672-4e72-9431-fe9db4d5883a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:14.939365 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:43:14.941113 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.db.l3_db [None req-91af91a3-105e-495c-8d2a-4f25f4cafe91 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Floating IP b8a63c59-5bb4-4dba-9942-ee1a0066a9c7 associated. External IP: 172.27.3.117, port: 841b2456-1a8a-47bd-a481-929b9038fe0d.
May 25 17:43:15.004010 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8fec1ca0-7672-4e72-9431-fe9db4d5883a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f163119b-807e-4d40-b368-bc83db743125,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:43:15.016993 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-8fec1ca0-7672-4e72-9431-fe9db4d5883a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.078s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:43:15.027374 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-8fec1ca0-7672-4e72-9431-fe9db4d5883a admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=2906b92a03064de8911eabd3b0c80c1d&name=default HTTP/1.1" status: 200  len: 2979 time: 0.8399220
May 25 17:43:15.030149 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 41660) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:43:15.104476 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-cc523cda-a029-452b-9202-fc91728aac29 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:15.144608 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-cc523cda-a029-452b-9202-fc91728aac29 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:15.291689 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-cc523cda-a029-452b-9202-fc91728aac29 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:15.297055 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-01e7b11f-c9d1-450d-8a0d-f331138a7d3f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:43:15.317024 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc523cda-a029-452b-9202-fc91728aac29 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f163119b-807e-4d40-b368-bc83db743125,revision_number=None']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:43:15.324626 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-cc523cda-a029-452b-9202-fc91728aac29 admin admin] Notify callbacks [] for security_group, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:15.336198 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-cc523cda-a029-452b-9202-fc91728aac29 admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/f163119b-807e-4d40-b368-bc83db743125 HTTP/1.1" status: 204  len: 168 time: 0.2973070
May 25 17:43:15.338830 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-cc523cda-a029-452b-9202-fc91728aac29 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:43:15.494059 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6bcd410-4fb4-45b7-9a90-f813004c914c req-c3f4e6b2-2643-457e-be88-4723cbda6b23 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:15.495709 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-c6bcd410-4fb4-45b7-9a90-f813004c914c req-c3f4e6b2-2643-457e-be88-4723cbda6b23 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=78a85fac-d281-494d-90da-a47ddc8255e5 HTTP/1.1" status: 200  len: 945 time: 0.1952560
May 25 17:43:15.509421 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-91af91a3-105e-495c-8d2a-4f25f4cafe91 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Router d71e624d-d858-442b-b878-577be49edd03 has already been hosted by L3 agent eaeb6875-c4ed-43b6-8658-aa4e52324fdf {{(pid=99026) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 25 17:43:15.573919 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-c6bcd410-4fb4-45b7-9a90-f813004c914c req-00c3a8df-8b3c-4041-8e08-7ec17ffe4f8c tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0691729
May 25 17:43:15.766462 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-91af91a3-105e-495c-8d2a-4f25f4cafe91 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify agent at l3_agent.dv-cinder-789564-2-iscsi the message routers_updated {{(pid=99026) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 25 17:43:15.771463 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-91af91a3-105e-495c-8d2a-4f25f4cafe91 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-239387'] for floatingip, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:15.790513 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-335927c5-0784-434a-9147-b46f5da365c6 None None] Sync routers for ids ['d71e624d-d858-442b-b878-577be49edd03'] in dv-cinder-789564-2-iscsi {{(pid=99029) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 25 17:43:15.804686 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_dvrscheduler_db [None req-335927c5-0784-434a-9147-b46f5da365c6 None None] Routers {'d71e624d-d858-442b-b878-577be49edd03'} bound to L3 agent in host dv-cinder-789564-2-iscsi {{(pid=99029) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 17:43:15.808788 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_hamode_db [None req-335927c5-0784-434a-9147-b46f5da365c6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcae70ef790>, 'dv-cinder-789564-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-25T17:34:21Z,description=<?>,heartbeat_timestamp=2021-05-25T17:42:51Z,host='dv-cinder-789564-2-iscsi',id=eaeb6875-c4ed-43b6-8658-aa4e52324fdf,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T17:34:21Z,topic='l3_agent')) {'router_ids': ['d71e624d-d858-442b-b878-577be49edd03'], 'active': True} {{(pid=99029) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:43:15.908246 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-91af91a3-105e-495c-8d2a-4f25f4cafe91 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] 10.222.0.122 "PUT /v2.0/floatingips/b8a63c59-5bb4-4dba-9942-ee1a0066a9c7 HTTP/1.1" status: 200  len: 992 time: 2.4335520
May 25 17:43:15.910064 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '446d90e5-0bef-47f6-852a-61b638d2a161', 'tag': '841b2456-1a8a-47bd-a481-929b9038fe0d'}] {{(pid=99026) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 17:43:16.039297 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cab44fce-d235-4d74-b1ed-13c197a4ea37 req-cc2ee057-b0e7-4dc6-a88b-df4a936efa4c tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:16.041388 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-cab44fce-d235-4d74-b1ed-13c197a4ea37 req-cc2ee057-b0e7-4dc6-a88b-df4a936efa4c tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] 10.222.0.125 "GET /v2.0/ports?device_id=cab9bd8d-5b7a-4fc2-85cd-9d4f9884b4ee HTTP/1.1" status: 200  len: 946 time: 0.1720455
May 25 17:43:16.085425 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_dvr_db [None req-335927c5-0784-434a-9147-b46f5da365c6 None None] Set router d71e624d-d858-442b-b878-577be49edd03 gateway port host: dv-cinder-789564-2-iscsi {{(pid=99029) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 17:43:16.218760 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '446d90e5-0bef-47f6-852a-61b638d2a161', 'tag': '841b2456-1a8a-47bd-a481-929b9038fe0d', 'status': 'completed', 'code': 200}
May 25 17:43:16.316306 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3945b515-472f-4778-96b7-1898d2ed1b16 req-54337fec-5c00-4170-91d1-4afffc9c2c3b tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:16.317909 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-3945b515-472f-4778-96b7-1898d2ed1b16 req-54337fec-5c00-4170-91d1-4afffc9c2c3b tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] 10.222.0.122 "GET /v2.0/ports?device_id=cab9bd8d-5b7a-4fc2-85cd-9d4f9884b4ee HTTP/1.1" status: 200  len: 946 time: 0.2877614
May 25 17:43:16.345605 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17e9c454-5ea2-41e7-905f-c8a0700698ba req-c5022b76-feee-420e-8b53-08f43ae6bd0c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:16.347243 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-17e9c454-5ea2-41e7-905f-c8a0700698ba req-c5022b76-feee-420e-8b53-08f43ae6bd0c service neutron] 10.222.0.125 "GET /v2.0/ports?tenant_id=b4cdc54b260f4e79b87fdf4a43b12e16&device_id=446d90e5-0bef-47f6-852a-61b638d2a161 HTTP/1.1" status: 200  len: 1099 time: 0.0890076
May 25 17:43:16.373411 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.plugin [req-cab44fce-d235-4d74-b1ed-13c197a4ea37 req-2a900670-3f64-4a65-9262-2bc9c145145b tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] Deleting port 4d583d58-a3d8-4d10-883a-5959fa74e40c {{(pid=99027) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 17:43:16.376333 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-cab44fce-d235-4d74-b1ed-13c197a4ea37 req-2a900670-3f64-4a65-9262-2bc9c145145b tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781841220419'] for port, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:16.539668 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17e9c454-5ea2-41e7-905f-c8a0700698ba req-f323c75d-f2b2-452f-af86-188bc6a52dc1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:16.542358 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-3945b515-472f-4778-96b7-1898d2ed1b16 req-cb87165b-24d2-46f0-8c2b-c02eb2d51db3 tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] 10.222.0.122 "GET /v2.0/security-groups?id=36f94dea-f495-4a32-ab2e-aef5450d5564&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2130501
May 25 17:43:16.542864 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-17e9c454-5ea2-41e7-905f-c8a0700698ba req-f323c75d-f2b2-452f-af86-188bc6a52dc1 service neutron] 10.222.0.125 "GET /v2.0/networks?id=defaef08-c0f9-4608-b66d-b97e06e185bf HTTP/1.1" status: 200  len: 913 time: 0.1854503
May 25 17:43:16.662689 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.db [req-cab44fce-d235-4d74-b1ed-13c197a4ea37 req-2a900670-3f64-4a65-9262-2bc9c145145b tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] For port 4d583d58-a3d8-4d10-883a-5959fa74e40c, host hv-cinder-78956, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=4d583d58-a3d8-4d10-883a-5959fa74e40c,segment=NetworkSegment(cc9a1d0a-1ce8-490e-886f-4f9fc5e8fc3d),segment_id=cc9a1d0a-1ce8-490e-886f-4f9fc5e8fc3d)] {{(pid=99027) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:43:16.663298 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-cab44fce-d235-4d74-b1ed-13c197a4ea37 req-2a900670-3f64-4a65-9262-2bc9c145145b tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-418810'] for port, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:16.775511 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_hamode_db [None req-335927c5-0784-434a-9147-b46f5da365c6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcae70ef790>, [{'id': 'd71e624d-d858-442b-b878-577be49edd03', 'name': 'tempest-AttachVolumeTestJSON-1986395052-router', 'tenant_id': 'b4cdc54b260f4e79b87fdf4a43b12e16', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.176'}], 'enable_snat': True}, 'gw_port_id': '9635c7b0-eb08-41ee-980e-3da56221f88d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:42:22Z', 'updated_at': '2021-05-25T17:42:34Z', 'revision_number': 4, 'project_id': 'b4cdc54b260f4e79b87fdf4a43b12e16', 'gw_port': {'id': '9635c7b0-eb08-41ee-980e-3da56221f88d', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:44:59', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd71e624d-d858-442b-b878-577be49edd03', 'device_owner': 'network:router_gateway', 'standard_attr_id': 80, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.176', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:42:23Z', 'updated_at': '2021-05-25T17:42:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi', '_floatingips': [{'id': 'b8a63c59-5bb4-4dba-9942-ee1a0066a9c7', 'tenant_id': 'b4cdc54b260f4e79b87fdf4a43b12e16', 'floating_ip_address': '172.27.3.117', 'floating_network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'router_id': 'd71e624d-d858-442b-b878-577be49edd03', 'port_id': '841b2456-1a8a-47bd-a481-929b9038fe0d', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 145, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'defaef08-c0f9-4608-b66d-b97e06e185bf', 'mac_address': 'fa:16:3e:e6:e6:e1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '446d90e5-0bef-47f6-852a-61b638d2a161', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T17:42:48Z', 'updated_at': '2021-05-25T17:43:14Z', 'revision_number': 1, 'project_id': 'b4cdc54b260f4e79b87fdf4a43b12e16', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'd13f3233-9e09-41c7-8315-4eae735fe605', 'name': '', 'network_id': 'defaef08-c0f9-4608-b66d-b97e06e185bf', 'tenant_id': 'b4cdc54b260f4e79b87fdf4a43b12e16', 'mac_address': 'fa:16:3e:87:b7:74', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd71e624d-d858-442b-b878-577be49edd03', 'device_owner': 'network:router_interface', 'standard_attr_id': 106, 'fixed_ips': [{'subnet_id': '5be08358-9d04-4ee9-91ac-104e66e66e20', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:42:29Z', 'updated_at': '2021-05-25T17:42:46Z', 'revision_number': 5, 'project_id': 'b4cdc54b260f4e79b87fdf4a43b12e16', 'subnets': [{'id': '5be08358-9d04-4ee9-91ac-104e66e66e20', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-789564-2-iscsi', False) {} {{(pid=99029) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:43:16.790242 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-335927c5-0784-434a-9147-b46f5da365c6 None None] Checking router: d71e624d-d858-442b-b878-577be49edd03 for host: dv-cinder-789564-2-iscsi {{(pid=99029) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 25 17:43:16.806775 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_dvrscheduler_db [None req-335927c5-0784-434a-9147-b46f5da365c6 None None] Routers {'d71e624d-d858-442b-b878-577be49edd03'} bound to L3 agent in host dv-cinder-789564-2-iscsi {{(pid=99029) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 17:43:16.808092 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_hamode_db [None req-335927c5-0784-434a-9147-b46f5da365c6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcae70ef790>, 'dv-cinder-789564-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-25T17:34:21Z,description=<?>,heartbeat_timestamp=2021-05-25T17:42:51Z,host='dv-cinder-789564-2-iscsi',id=eaeb6875-c4ed-43b6-8658-aa4e52324fdf,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T17:34:21Z,topic='l3_agent')) {'router_ids': ['d71e624d-d858-442b-b878-577be49edd03'], 'active': True} {{(pid=99029) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:43:16.925930 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.plugin [req-cab44fce-d235-4d74-b1ed-13c197a4ea37 req-2a900670-3f64-4a65-9262-2bc9c145145b tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] Calling delete_port for 4d583d58-a3d8-4d10-883a-5959fa74e40c owned by compute:nova {{(pid=99027) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 17:43:16.998041 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-17e9c454-5ea2-41e7-905f-c8a0700698ba req-c10fc97b-21a7-4bfa-a261-48ee691945f5 service neutron] 10.222.0.125 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=841b2456-1a8a-47bd-a481-929b9038fe0d HTTP/1.1" status: 200  len: 1000 time: 0.4486544
May 25 17:43:17.109994 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17e9c454-5ea2-41e7-905f-c8a0700698ba req-2bf92389-0a65-4903-a04b-b4e651f91343 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:17.113159 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-17e9c454-5ea2-41e7-905f-c8a0700698ba req-2bf92389-0a65-4903-a04b-b4e651f91343 service neutron] 10.222.0.125 "GET /v2.0/subnets?id=5be08358-9d04-4ee9-91ac-104e66e66e20 HTTP/1.1" status: 200  len: 850 time: 0.1043599
May 25 17:43:17.154577 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_dvr_db [None req-335927c5-0784-434a-9147-b46f5da365c6 None None] Set router d71e624d-d858-442b-b878-577be49edd03 gateway port host: dv-cinder-789564-2-iscsi {{(pid=99029) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 17:43:17.306050 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32df42d1-4514-4155-b222-781ca9f3341c req-dc313170-db96-4cf2-91ce-5f0fe7936cf2 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:17.307586 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-32df42d1-4514-4155-b222-781ca9f3341c req-dc313170-db96-4cf2-91ce-5f0fe7936cf2 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=78a85fac-d281-494d-90da-a47ddc8255e5 HTTP/1.1" status: 200  len: 945 time: 0.4148762
May 25 17:43:17.334644 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-cab44fce-d235-4d74-b1ed-13c197a4ea37 req-2a900670-3f64-4a65-9262-2bc9c145145b tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781841222566', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781840788188'] for port, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:17.335608 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17e9c454-5ea2-41e7-905f-c8a0700698ba req-6801d00a-0815-4916-9a11-c892fb18b2c1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:17.337116 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-17e9c454-5ea2-41e7-905f-c8a0700698ba req-6801d00a-0815-4916-9a11-c892fb18b2c1 service neutron] 10.222.0.125 "GET /v2.0/ports?network_id=defaef08-c0f9-4608-b66d-b97e06e185bf&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.2166998
May 25 17:43:17.348245 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] get_ports_and_sgs() called for port_ids ['4d583d58-a3d8-4d10-883a-5959fa74e40c'] {{(pid=99028) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 25 17:43:17.350741 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:43:17.420138 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a900670-3f64-4a65-9262-2bc9c145145b tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] Pushing event deleted for resources: {'Port': ['ID=4d583d58-a3d8-4d10-883a-5959fa74e40c,revision_number=None']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:43:17.440412 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a900670-3f64-4a65-9262-2bc9c145145b tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:43:17.442110 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a900670-3f64-4a65-9262-2bc9c145145b tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:43:17.442525 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a900670-3f64-4a65-9262-2bc9c145145b tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:43:17.444199 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a900670-3f64-4a65-9262-2bc9c145145b tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:43:17.444523 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a900670-3f64-4a65-9262-2bc9c145145b tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:43:17.444914 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a900670-3f64-4a65-9262-2bc9c145145b tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:43:17.445281 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a900670-3f64-4a65-9262-2bc9c145145b tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:43:17.446129 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a900670-3f64-4a65-9262-2bc9c145145b tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:43:17.446543 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a900670-3f64-4a65-9262-2bc9c145145b tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:43:17.446884 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a900670-3f64-4a65-9262-2bc9c145145b tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:43:17.447220 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a900670-3f64-4a65-9262-2bc9c145145b tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:43:17.447551 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a900670-3f64-4a65-9262-2bc9c145145b tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:43:17.484954 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-2a900670-3f64-4a65-9262-2bc9c145145b tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.134s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:43:17.497209 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-32df42d1-4514-4155-b222-781ca9f3341c req-f4e52624-4c54-4cbf-89c4-6c620daf83b7 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1792967
May 25 17:43:17.578176 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-17e9c454-5ea2-41e7-905f-c8a0700698ba req-38f05ea2-722a-4665-bbb9-d21640aaaeb5 service neutron] 10.222.0.125 "GET /v2.0/networks/defaef08-c0f9-4608-b66d-b97e06e185bf?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2351289
May 25 17:43:17.580458 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.l3_dvrscheduler_db [req-cab44fce-d235-4d74-b1ed-13c197a4ea37 req-2a900670-3f64-4a65-9262-2bc9c145145b tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] No DVR routers for this DVR port 4d583d58-a3d8-4d10-883a-5959fa74e40c on host hv-cinder-78956 {{(pid=99027) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 25 17:43:17.584493 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_hamode_db [None req-335927c5-0784-434a-9147-b46f5da365c6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcae70ef790>, [{'id': 'd71e624d-d858-442b-b878-577be49edd03', 'name': 'tempest-AttachVolumeTestJSON-1986395052-router', 'tenant_id': 'b4cdc54b260f4e79b87fdf4a43b12e16', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.176'}], 'enable_snat': True}, 'gw_port_id': '9635c7b0-eb08-41ee-980e-3da56221f88d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:42:22Z', 'updated_at': '2021-05-25T17:42:34Z', 'revision_number': 4, 'project_id': 'b4cdc54b260f4e79b87fdf4a43b12e16', 'gw_port': {'id': '9635c7b0-eb08-41ee-980e-3da56221f88d', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:44:59', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd71e624d-d858-442b-b878-577be49edd03', 'device_owner': 'network:router_gateway', 'standard_attr_id': 80, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.176', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:42:23Z', 'updated_at': '2021-05-25T17:42:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi', '_floatingips': [{'id': 'b8a63c59-5bb4-4dba-9942-ee1a0066a9c7', 'tenant_id': 'b4cdc54b260f4e79b87fdf4a43b12e16', 'floating_ip_address': '172.27.3.117', 'floating_network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'router_id': 'd71e624d-d858-442b-b878-577be49edd03', 'port_id': '841b2456-1a8a-47bd-a481-929b9038fe0d', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 145, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'defaef08-c0f9-4608-b66d-b97e06e185bf', 'mac_address': 'fa:16:3e:e6:e6:e1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '446d90e5-0bef-47f6-852a-61b638d2a161', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T17:42:48Z', 'updated_at': '2021-05-25T17:43:14Z', 'revision_number': 1, 'project_id': 'b4cdc54b260f4e79b87fdf4a43b12e16', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'd13f3233-9e09-41c7-8315-4eae735fe605', 'name': '', 'network_id': 'defaef08-c0f9-4608-b66d-b97e06e185bf', 'tenant_id': 'b4cdc54b260f4e79b87fdf4a43b12e16', 'mac_address': 'fa:16:3e:87:b7:74', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd71e624d-d858-442b-b878-577be49edd03', 'device_owner': 'network:router_interface', 'standard_attr_id': 106, 'fixed_ips': [{'subnet_id': '5be08358-9d04-4ee9-91ac-104e66e66e20', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:42:29Z', 'updated_at': '2021-05-25T17:42:46Z', 'revision_number': 5, 'project_id': 'b4cdc54b260f4e79b87fdf4a43b12e16', 'subnets': [{'id': '5be08358-9d04-4ee9-91ac-104e66e66e20', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-789564-2-iscsi', False) {} {{(pid=99029) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:43:17.584817 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-cab44fce-d235-4d74-b1ed-13c197a4ea37 req-2a900670-3f64-4a65-9262-2bc9c145145b tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-239387'] for port, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:17.589055 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'cab9bd8d-5b7a-4fc2-85cd-9d4f9884b4ee', 'name': 'network-vif-deleted', 'tag': '4d583d58-a3d8-4d10-883a-5959fa74e40c'}] {{(pid=99027) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 17:43:17.589691 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-335927c5-0784-434a-9147-b46f5da365c6 None None] The sync data for ids ['d71e624d-d858-442b-b878-577be49edd03'] in dv-cinder-789564-2-iscsi is: [{'id': 'd71e624d-d858-442b-b878-577be49edd03', 'name': 'tempest-AttachVolumeTestJSON-1986395052-router', 'tenant_id': 'b4cdc54b260f4e79b87fdf4a43b12e16', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.176'}], 'enable_snat': True}, 'gw_port_id': '9635c7b0-eb08-41ee-980e-3da56221f88d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:42:22Z', 'updated_at': '2021-05-25T17:42:34Z', 'revision_number': 4, 'project_id': 'b4cdc54b260f4e79b87fdf4a43b12e16', 'gw_port': {'id': '9635c7b0-eb08-41ee-980e-3da56221f88d', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:44:59', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd71e624d-d858-442b-b878-577be49edd03', 'device_owner': 'network:router_gateway', 'standard_attr_id': 80, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.176', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:42:23Z', 'updated_at': '2021-05-25T17:42:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi', '_floatingips': [{'id': 'b8a63c59-5bb4-4dba-9942-ee1a0066a9c7', 'tenant_id': 'b4cdc54b260f4e79b87fdf4a43b12e16', 'floating_ip_address': '172.27.3.117', 'floating_network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'router_id': 'd71e624d-d858-442b-b878-577be49edd03', 'port_id': '841b2456-1a8a-47bd-a481-929b9038fe0d', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 145, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'defaef08-c0f9-4608-b66d-b97e06e185bf', 'mac_address': 'fa:16:3e:e6:e6:e1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '446d90e5-0bef-47f6-852a-61b638d2a161', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T17:42:48Z', 'updated_at': '2021-05-25T17:43:14Z', 'revision_number': 1, 'project_id': 'b4cdc54b260f4e79b87fdf4a43b12e16', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'd13f3233-9e09-41c7-8315-4eae735fe605', 'name': '', 'network_id': 'defaef08-c0f9-4608-b66d-b97e06e185bf', 'tenant_id': 'b4cdc54b260f4e79b87fdf4a43b12e16', 'mac_address': 'fa:16:3e:87:b7:74', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd71e624d-d858-442b-b878-577be49edd03', 'device_owner': 'network:router_interface', 'standard_attr_id': 106, 'fixed_ips': [{'subnet_id': '5be08358-9d04-4ee9-91ac-104e66e66e20', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:42:29Z', 'updated_at': '2021-05-25T17:42:46Z', 'revision_number': 5, 'project_id': 'b4cdc54b260f4e79b87fdf4a43b12e16', 'subnets': [{'id': '5be08358-9d04-4ee9-91ac-104e66e66e20', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=99029) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 25 17:43:17.683928 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'cab9bd8d-5b7a-4fc2-85cd-9d4f9884b4ee', 'name': 'network-vif-deleted', 'tag': '4d583d58-a3d8-4d10-883a-5959fa74e40c', 'status': 'completed', 'code': 200}
May 25 17:43:17.780941 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-cab44fce-d235-4d74-b1ed-13c197a4ea37 req-2a900670-3f64-4a65-9262-2bc9c145145b tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] 10.222.0.125 "DELETE /v2.0/ports/4d583d58-a3d8-4d10-883a-5959fa74e40c HTTP/1.1" status: 204  len: 173 time: 1.7011492
May 25 17:43:17.792973 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-a3e24e74-24eb-4949-868e-a7048686e4a3 req-ceb3a05f-6f8f-4c40-a911-38471174f151 tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] Synchronizing usage tracker for tenant:fb338a290a2242fea3a4b8ae2bc4a14c on resource:port {{(pid=99027) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 17:43:17.809016 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-17e9c454-5ea2-41e7-905f-c8a0700698ba req-eccf69b5-e034-4841-b6af-0de6ab57046e service neutron] 10.222.0.125 "GET /v2.0/networks/defaef08-c0f9-4608-b66d-b97e06e185bf?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2241192
May 25 17:43:17.871474 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5013e780-73e2-4687-a589-93b225b88d1f None None] New status for floating IP b8a63c59-5bb4-4dba-9942-ee1a0066a9c7: ACTIVE {{(pid=99028) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 25 17:43:17.880276 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-a3e24e74-24eb-4949-868e-a7048686e4a3 req-ceb3a05f-6f8f-4c40-a911-38471174f151 tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] Unset dirty status for tenant:fb338a290a2242fea3a4b8ae2bc4a14c on resource:port {{(pid=99027) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 17:43:17.882784 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-a3e24e74-24eb-4949-868e-a7048686e4a3 req-ceb3a05f-6f8f-4c40-a911-38471174f151 tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] 10.222.0.122 "GET /v2.0/ports?device_id=cab9bd8d-5b7a-4fc2-85cd-9d4f9884b4ee HTTP/1.1" status: 200  len: 210 time: 0.1503975
May 25 17:43:18.245717 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-5f3f66c2-df6e-4200-b97a-cbd820211ae6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:18.756857 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c0e17ca-a234-4a59-b8e5-82064b0ea63f req-8ebc0167-b92a-4383-9c0c-33d9104ca94a tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:18.759095 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-5c0e17ca-a234-4a59-b8e5-82064b0ea63f req-8ebc0167-b92a-4383-9c0c-33d9104ca94a tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=78a85fac-d281-494d-90da-a47ddc8255e5 HTTP/1.1" status: 200  len: 945 time: 0.1006351
May 25 17:43:18.834227 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-5c0e17ca-a234-4a59-b8e5-82064b0ea63f req-3ea3d6ab-3f01-47ee-aef6-a48b1b348938 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0663383
May 25 17:43:19.095026 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-c48e0b59-4571-4c82-ab6f-b94c72585c64 req-462749bc-eb47-4df0-af52-59efdee2a8aa tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] 10.222.0.122 "GET /v2.0/ports?device_id=cab9bd8d-5b7a-4fc2-85cd-9d4f9884b4ee HTTP/1.1" status: 200  len: 210 time: 0.0609670
May 25 17:43:20.028712 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da85275c-9598-4c1f-a79c-fbb4116bc5ce req-3e355226-2736-4f85-ace8-57fae83ea4ac tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:20.030201 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-da85275c-9598-4c1f-a79c-fbb4116bc5ce req-3e355226-2736-4f85-ace8-57fae83ea4ac tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=78a85fac-d281-494d-90da-a47ddc8255e5 HTTP/1.1" status: 200  len: 945 time: 0.0831079
May 25 17:43:20.074171 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-da85275c-9598-4c1f-a79c-fbb4116bc5ce req-38d223e8-fcda-41a0-aa60-c531b4168ad3 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0382349
May 25 17:43:20.234995 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Device 4d583d58-a3d8-4d10-883a-5959fa74e40c no longer exists at agent hyperv_hv-cinder-78956 {{(pid=99028) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 17:43:20.260667 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-393940e6-644f-4fe3-b1ec-4b07d9e42ff7 req-429e876b-1f9a-471e-881e-956aa8165cd8 tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] 10.222.0.122 "GET /v2.0/ports?device_id=cab9bd8d-5b7a-4fc2-85cd-9d4f9884b4ee HTTP/1.1" status: 200  len: 210 time: 0.0506260
May 25 17:43:20.293837 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.plugin [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] No Port match for: 4d583d58-a3d8-4d10-883a-5959fa74e40c {{(pid=99028) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 25 17:43:20.294376 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Device 4d583d58-a3d8-4d10-883a-5959fa74e40c not bound to the agent host hv-cinder-78956 {{(pid=99028) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 25 17:43:20.623182 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-8e879d1b-a898-4c88-b4eb-6225dcbbcce5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:20.806131 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:21.270651 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24882391-8d7c-4917-9a2a-62744c365103 req-ca08cc6c-978d-4361-a466-245976346f7d tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:21.273898 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-24882391-8d7c-4917-9a2a-62744c365103 req-ca08cc6c-978d-4361-a466-245976346f7d tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=78a85fac-d281-494d-90da-a47ddc8255e5 HTTP/1.1" status: 200  len: 945 time: 0.0876830
May 25 17:43:21.327432 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-24882391-8d7c-4917-9a2a-62744c365103 req-df0579be-0bd7-4f3c-9721-14f907024bad tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0475895
May 25 17:43:21.493907 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-8b048a4f-4c6e-4d17-8362-e656150e0ebc req-388319c2-55ae-465e-858c-50f87fc7e381 tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] 10.222.0.122 "GET /v2.0/ports?device_id=cab9bd8d-5b7a-4fc2-85cd-9d4f9884b4ee HTTP/1.1" status: 200  len: 210 time: 0.0843403
May 25 17:43:21.753477 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-7e261f94-b84f-443e-be49-3bc1ac903b55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:22.602352 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21e80bc0-c3c3-457a-ace6-b00e23bec23f req-413c32fb-5782-4c70-a25c-72eb4be5f5c4 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:22.604361 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-21e80bc0-c3c3-457a-ace6-b00e23bec23f req-413c32fb-5782-4c70-a25c-72eb4be5f5c4 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=78a85fac-d281-494d-90da-a47ddc8255e5 HTTP/1.1" status: 200  len: 945 time: 0.1323988
May 25 17:43:22.679932 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-21e80bc0-c3c3-457a-ace6-b00e23bec23f req-e855cf5f-f3a6-4091-91cc-127637c1ae75 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0673501
May 25 17:43:23.331418 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-6df2b2a7-a54e-4d57-9be3-033078b9d5b3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:23.547472 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb2b73f7-2f73-4d97-80df-72eba1e4c6ea req-623a6b89-66a5-4ee2-923c-b6d547c56ebe tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:23.552961 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-bb2b73f7-2f73-4d97-80df-72eba1e4c6ea req-623a6b89-66a5-4ee2-923c-b6d547c56ebe tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/networks?id=6c7eca3b-72f3-4ba8-9e95-614d64496512 HTTP/1.1" status: 200  len: 814 time: 0.1953783
May 25 17:43:23.565646 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-bb2b73f7-2f73-4d97-80df-72eba1e4c6ea req-5c89bd6d-90ee-4244-8df0-ac43a4d6ff32 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/quotas/5ae575cfd07c4a88aa626c15e6bccfd9 HTTP/1.1" status: 200  len: 375 time: 0.0094492
May 25 17:43:23.650422 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-bb2b73f7-2f73-4d97-80df-72eba1e4c6ea req-f9e14faf-f0aa-438a-aa90-4a1d54a3cc15 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/ports?tenant_id=5ae575cfd07c4a88aa626c15e6bccfd9&fields=id HTTP/1.1" status: 200  len: 255 time: 0.0781293
May 25 17:43:23.820653 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-bb2b73f7-2f73-4d97-80df-72eba1e4c6ea req-0486a23f-0deb-4615-a0b1-3061a406fffe service neutron] 10.222.0.122 "GET /v2.0/networks/6c7eca3b-72f3-4ba8-9e95-614d64496512?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1631224
May 25 17:43:23.920093 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a20a0e2-df33-44df-8c55-95b58404a9dc req-9d56ea0b-acef-4ea2-98d4-c64b041b431d tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:23.921748 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-8a20a0e2-df33-44df-8c55-95b58404a9dc req-9d56ea0b-acef-4ea2-98d4-c64b041b431d tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=78a85fac-d281-494d-90da-a47ddc8255e5 HTTP/1.1" status: 200  len: 945 time: 0.1082957
May 25 17:43:23.980046 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-8a20a0e2-df33-44df-8c55-95b58404a9dc req-f23f1784-a63e-4868-936d-a64513d72e91 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0493279
May 25 17:43:23.991514 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-bb2b73f7-2f73-4d97-80df-72eba1e4c6ea req-a70e28f8-802f-4458-9dfa-dfd8040b9fe4 service neutron] 10.222.0.122 "GET /v2.0/networks/6c7eca3b-72f3-4ba8-9e95-614d64496512?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1596627
May 25 17:43:24.269567 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-2403d0fc-2866-482f-8626-3652cadd89b2 req-755a8898-8727-42bf-a9e1-517dffa23406 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/ports?device_id=ac0d5316-763a-434a-82ea-c3d559ad0984 HTTP/1.1" status: 200  len: 210 time: 0.0529592
May 25 17:43:24.788084 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 42006) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:43:24.850123 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.db_base_plugin_v2 [None req-ac8fc7c9-306f-4854-97e8-c2d361babbde admin admin] Deleting subnet d821d422-628c-4d27-a03e-94485f09826d {{(pid=99026) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 25 17:43:24.853508 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-ac8fc7c9-306f-4854-97e8-c2d361babbde admin admin] Notify callbacks [] for subnet, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:24.909788 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-ac8fc7c9-306f-4854-97e8-c2d361babbde admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-14735050'] for subnet, precommit_delete_associations {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:24.978263 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-ac8fc7c9-306f-4854-97e8-c2d361babbde admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1474503'] for subnet, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:25.283240 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4dfbc2d3-7388-41be-aafb-d14dfb118edb req-6a34da90-e93c-4492-b2fe-6dc15f2225b0 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:25.284778 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-4dfbc2d3-7388-41be-aafb-d14dfb118edb req-6a34da90-e93c-4492-b2fe-6dc15f2225b0 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=78a85fac-d281-494d-90da-a47ddc8255e5 HTTP/1.1" status: 200  len: 945 time: 0.1570578
May 25 17:43:25.386482 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-4dfbc2d3-7388-41be-aafb-d14dfb118edb req-1bcdef85-ca21-4131-af8f-faf48f8259d3 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0729795
May 25 17:43:25.473743 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-e9696b6c-2d7b-4cfd-805b-6282242d82b4 req-458970e3-3dab-47c0-9701-e50cd20195ac tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/ports?device_id=ac0d5316-763a-434a-82ea-c3d559ad0984 HTTP/1.1" status: 200  len: 210 time: 0.0623183
May 25 17:43:25.537238 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-ac8fc7c9-306f-4854-97e8-c2d361babbde admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1473138', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114466', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-15477963', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-14794250'] for subnet, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:25.547423 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-b3224bc6-79fd-4b27-a845-dbd626c2ff4a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:43:25.611963 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac8fc7c9-306f-4854-97e8-c2d361babbde admin admin] Pushing event deleted for resources: {'Subnet': ['ID=d821d422-628c-4d27-a03e-94485f09826d,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:43:25.621570 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-ac8fc7c9-306f-4854-97e8-c2d361babbde admin admin] Notify callbacks [] for subnet, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:25.628247 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac8fc7c9-306f-4854-97e8-c2d361babbde admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:43:25.628247 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac8fc7c9-306f-4854-97e8-c2d361babbde admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:43:25.628814 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac8fc7c9-306f-4854-97e8-c2d361babbde admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:43:25.628814 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac8fc7c9-306f-4854-97e8-c2d361babbde admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:43:25.629193 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac8fc7c9-306f-4854-97e8-c2d361babbde admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:43:25.629541 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac8fc7c9-306f-4854-97e8-c2d361babbde admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:43:25.629887 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac8fc7c9-306f-4854-97e8-c2d361babbde admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:43:25.630295 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac8fc7c9-306f-4854-97e8-c2d361babbde admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:43:25.630639 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac8fc7c9-306f-4854-97e8-c2d361babbde admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:43:25.631109 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac8fc7c9-306f-4854-97e8-c2d361babbde admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:43:25.631459 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac8fc7c9-306f-4854-97e8-c2d361babbde admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:43:25.631798 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac8fc7c9-306f-4854-97e8-c2d361babbde admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:43:25.648545 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-ac8fc7c9-306f-4854-97e8-c2d361babbde admin admin] 10.222.0.122 "DELETE /v2.0/subnets/d821d422-628c-4d27-a03e-94485f09826d HTTP/1.1" status: 204  len: 168 time: 0.8570375
May 25 17:43:25.648545 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-ac8fc7c9-306f-4854-97e8-c2d361babbde admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.100s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:43:25.653919 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 42030) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:43:25.768845 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-61bad660-4409-4b35-8053-b5331f0a750e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1492659'] for network, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:25.902433 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-61bad660-4409-4b35-8053-b5331f0a750e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1470792', 'neutron.services.segments.db._delete_segments_for_network-8781841233116'] for network, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:25.918416 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-61bad660-4409-4b35-8053-b5331f0a750e admin admin] Subscribe: <bound method Plugin._prevent_segment_delete_with_subnet_associated of <neutron.services.segments.plugin.Plugin object at 0x7fcae684d1f0>> segment before_delete 55550000 {{(pid=99027) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:43:25.918816 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-61bad660-4409-4b35-8053-b5331f0a750e admin admin] Subscribe: <bound method Plugin._validate_auto_address_subnet_delete of <neutron.services.segments.plugin.Plugin object at 0x7fcae684d1f0>> subnet precommit_delete_associations 55550000 {{(pid=99027) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:43:25.919532 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-61bad660-4409-4b35-8053-b5331f0a750e admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_host_addition_to_aggregate of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fcae6a35ac0>> segment_host_mapping after_create 55550000 {{(pid=99027) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:43:25.919884 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-61bad660-4409-4b35-8053-b5331f0a750e admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_port_created_or_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fcae6a35ac0>> port after_create 55550000 {{(pid=99027) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:43:25.920198 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-61bad660-4409-4b35-8053-b5331f0a750e admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_port_created_or_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fcae6a35ac0>> port after_delete 55550000 {{(pid=99027) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:43:25.920537 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-61bad660-4409-4b35-8053-b5331f0a750e admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_port_updated of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fcae6a35ac0>> port after_update 55550000 {{(pid=99027) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:43:25.920832 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-61bad660-4409-4b35-8053-b5331f0a750e admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_segment_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fcae6a35ac0>> segment after_delete 55550000 {{(pid=99027) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:43:25.921165 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-61bad660-4409-4b35-8053-b5331f0a750e admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_created of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fcae6a35ac0>> subnet after_create 55550000 {{(pid=99027) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:43:25.921598 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-61bad660-4409-4b35-8053-b5331f0a750e admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fcae6a35ac0>> subnet after_delete 55550000 {{(pid=99027) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:43:25.921797 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-61bad660-4409-4b35-8053-b5331f0a750e admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_updated of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fcae6a35ac0>> subnet after_update 55550000 {{(pid=99027) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:43:26.049449 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-61bad660-4409-4b35-8053-b5331f0a750e admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_after_create of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7fcae6743820>> subnet after_create 55550000 {{(pid=99027) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:43:26.049883 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-61bad660-4409-4b35-8053-b5331f0a750e admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_after_delete of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7fcae6743820>> subnet after_delete 55550000 {{(pid=99027) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:43:26.050170 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-61bad660-4409-4b35-8053-b5331f0a750e admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_before_create of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7fcae6743820>> subnet before_create 55550000 {{(pid=99027) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:43:26.050499 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-61bad660-4409-4b35-8053-b5331f0a750e admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_before_update of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7fcae6743820>> subnet before_update 55550000 {{(pid=99027) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 25 17:43:26.050864 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.services.segments.db [None req-61bad660-4409-4b35-8053-b5331f0a750e admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fcae6a35730>,) {'filters': {'network_id': ['58926b0f-c6c9-44b1-aa59-d580f9359c87']}} {{(pid=99027) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:43:26.069795 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.services.segments.db [None req-61bad660-4409-4b35-8053-b5331f0a750e admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fcae6a35730>, 'cc9a1d0a-1ce8-490e-886f-4f9fc5e8fc3d') {'for_net_delete': True} {{(pid=99027) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:43:26.070595 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.services.segments.db [None req-61bad660-4409-4b35-8053-b5331f0a750e admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fcae6a35730>, 'cc9a1d0a-1ce8-490e-886f-4f9fc5e8fc3d') {} {{(pid=99027) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:43:26.082887 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-61bad660-4409-4b35-8053-b5331f0a750e admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8781841242525', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-15628874'] for segment, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:26.103107 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-61bad660-4409-4b35-8053-b5331f0a750e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1469168'] for segment, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:26.110869 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-61bad660-4409-4b35-8053-b5331f0a750e admin admin] Releasing vlan 1333 on physical network physnet1 to pool {{(pid=99027) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 25 17:43:26.111276 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-61bad660-4409-4b35-8053-b5331f0a750e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1469168', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-15469039'] for segment, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:26.129509 dv-cinder-789564-2-iscsi neutron-server[99027]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead
May 25 17:43:26.129509 dv-cinder-789564-2-iscsi neutron-server[99027]:   from cryptography.utils import int_from_bytes
May 25 17:43:26.129509 dv-cinder-789564-2-iscsi neutron-server[99027]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead
May 25 17:43:26.129509 dv-cinder-789564-2-iscsi neutron-server[99027]:   from cryptography.utils import int_from_bytes
May 25 17:43:26.129509 dv-cinder-789564-2-iscsi neutron-server[99027]: Traceback (most recent call last):
May 25 17:43:26.129509 dv-cinder-789564-2-iscsi neutron-server[99027]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 25 17:43:26.129509 dv-cinder-789564-2-iscsi neutron-server[99027]:     timer()
May 25 17:43:26.129509 dv-cinder-789564-2-iscsi neutron-server[99027]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 25 17:43:26.129509 dv-cinder-789564-2-iscsi neutron-server[99027]:     cb(*args, **kw)
May 25 17:43:26.129509 dv-cinder-789564-2-iscsi neutron-server[99027]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 25 17:43:26.129509 dv-cinder-789564-2-iscsi neutron-server[99027]:     return func(*args, **kwargs)
May 25 17:43:26.129509 dv-cinder-789564-2-iscsi neutron-server[99027]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 25 17:43:26.129509 dv-cinder-789564-2-iscsi neutron-server[99027]:     self._notify()
May 25 17:43:26.129509 dv-cinder-789564-2-iscsi neutron-server[99027]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 25 17:43:26.129509 dv-cinder-789564-2-iscsi neutron-server[99027]:     self.callback(batched_events)
May 25 17:43:26.129509 dv-cinder-789564-2-iscsi neutron-server[99027]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 25 17:43:26.129509 dv-cinder-789564-2-iscsi neutron-server[99027]:     event.method(event)
May 25 17:43:26.129509 dv-cinder-789564-2-iscsi neutron-server[99027]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 25 17:43:26.129509 dv-cinder-789564-2-iscsi neutron-server[99027]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 25 17:43:26.129509 dv-cinder-789564-2-iscsi neutron-server[99027]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 25 17:43:26.129509 dv-cinder-789564-2-iscsi neutron-server[99027]:     aggregate_uuid = self.p_client.list_aggregates(
May 25 17:43:26.129509 dv-cinder-789564-2-iscsi neutron-server[99027]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 25 17:43:26.129509 dv-cinder-789564-2-iscsi neutron-server[99027]:     return f(self, *a, **k)
May 25 17:43:26.129509 dv-cinder-789564-2-iscsi neutron-server[99027]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 25 17:43:26.129509 dv-cinder-789564-2-iscsi neutron-server[99027]:     return self._get(url).json()
May 25 17:43:26.129509 dv-cinder-789564-2-iscsi neutron-server[99027]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 25 17:43:26.129509 dv-cinder-789564-2-iscsi neutron-server[99027]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 25 17:43:26.129509 dv-cinder-789564-2-iscsi neutron-server[99027]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 25 17:43:26.129509 dv-cinder-789564-2-iscsi neutron-server[99027]:     return self.request(url, 'GET', **kwargs)
May 25 17:43:26.129509 dv-cinder-789564-2-iscsi neutron-server[99027]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 25 17:43:26.129509 dv-cinder-789564-2-iscsi neutron-server[99027]:     base_url = self.get_endpoint(auth, allow=allow,
May 25 17:43:26.129509 dv-cinder-789564-2-iscsi neutron-server[99027]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 25 17:43:26.129509 dv-cinder-789564-2-iscsi neutron-server[99027]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 25 17:43:26.129509 dv-cinder-789564-2-iscsi neutron-server[99027]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 25 17:43:26.129509 dv-cinder-789564-2-iscsi neutron-server[99027]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 25 17:43:26.129509 dv-cinder-789564-2-iscsi neutron-server[99027]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 25 17:43:26.388467 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-61bad660-4409-4b35-8053-b5331f0a750e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1470785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-459299', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551400', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-419883'] for network, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:26.392790 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:43:26.409606 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-61bad660-4409-4b35-8053-b5331f0a750e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for network, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:26.421312 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61bad660-4409-4b35-8053-b5331f0a750e admin admin] Pushing event deleted for resources: {'Network': ['ID=58926b0f-c6c9-44b1-aa59-d580f9359c87,revision_number=None']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:43:26.426777 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-61bad660-4409-4b35-8053-b5331f0a750e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.034s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:43:26.514840 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-61bad660-4409-4b35-8053-b5331f0a750e admin admin] 10.222.0.122 "DELETE /v2.0/networks/58926b0f-c6c9-44b1-aa59-d580f9359c87 HTTP/1.1" status: 204  len: 168 time: 0.8596303
May 25 17:43:26.627533 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74834a24-2f09-47b4-85ca-cb01da461f12 req-dce4447a-8185-495c-a632-61857a6d7b36 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:26.629026 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-74834a24-2f09-47b4-85ca-cb01da461f12 req-dce4447a-8185-495c-a632-61857a6d7b36 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=78a85fac-d281-494d-90da-a47ddc8255e5 HTTP/1.1" status: 200  len: 945 time: 0.1092072
May 25 17:43:26.684738 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-74834a24-2f09-47b4-85ca-cb01da461f12 req-e38811f7-5a23-44af-9064-435906d77fab tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0473692
May 25 17:43:26.750377 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-b6ed7a3f-6fed-46c0-9232-dbf7763763b1 req-0969ce1e-6bfa-4030-b9f0-c57aaaa80b70 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/ports?device_id=ac0d5316-763a-434a-82ea-c3d559ad0984 HTTP/1.1" status: 200  len: 210 time: 0.0864308
May 25 17:43:26.800612 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb2b73f7-2f73-4d97-80df-72eba1e4c6ea req-a47eb005-d330-42b0-9d00-81622c585e33 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:26.804567 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-bb2b73f7-2f73-4d97-80df-72eba1e4c6ea req-a47eb005-d330-42b0-9d00-81622c585e33 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.125 "GET /v2.0/networks?id=6c7eca3b-72f3-4ba8-9e95-614d64496512 HTTP/1.1" status: 200  len: 814 time: 0.3643374
May 25 17:43:26.817057 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.v2.base [req-bb2b73f7-2f73-4d97-80df-72eba1e4c6ea req-47e1e66b-17e3-4026-bd18-6d82608ee271 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Request body: {'port': {'device_id': 'ac0d5316-763a-434a-82ea-c3d559ad0984', 'network_id': '6c7eca3b-72f3-4ba8-9e95-614d64496512', 'admin_state_up': True, 'tenant_id': '5ae575cfd07c4a88aa626c15e6bccfd9'}} {{(pid=99026) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:43:26.914118 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 42058) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:43:26.981376 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 42066) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:43:26.981497 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [req-bb2b73f7-2f73-4d97-80df-72eba1e4c6ea req-47e1e66b-17e3-4026-bd18-6d82608ee271 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:43:26.992887 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [req-bb2b73f7-2f73-4d97-80df-72eba1e4c6ea req-47e1e66b-17e3-4026-bd18-6d82608ee271 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:43:27.058931 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 42072) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:43:27.065303 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-563c4d6c-e7d5-45d6-88d6-55dd66b1d17f admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=fb338a290a2242fea3a4b8ae2bc4a14c&name=default HTTP/1.1" status: 200  len: 2975 time: 0.0803475
May 25 17:43:27.137871 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-bb2b73f7-2f73-4d97-80df-72eba1e4c6ea req-47e1e66b-17e3-4026-bd18-6d82608ee271 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Made reservation on behalf of 5ae575cfd07c4a88aa626c15e6bccfd9 for: {'port': 1} {{(pid=99026) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 17:43:27.141725 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [req-bb2b73f7-2f73-4d97-80df-72eba1e4c6ea req-47e1e66b-17e3-4026-bd18-6d82608ee271 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:27.162263 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-6704f04b-cf55-4e37-b430-27b2a5b4e6d0 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:27.242723 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-6704f04b-cf55-4e37-b430-27b2a5b4e6d0 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:27.263247 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-63f50d31-110a-451e-98cf-2d1602cdb2ba admin admin] Notify callbacks [] for security_group, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:27.281541 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-63f50d31-110a-451e-98cf-2d1602cdb2ba admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:43:27.286106 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-63f50d31-110a-451e-98cf-2d1602cdb2ba admin admin] Usage tracker for resource:security_group_rule and tenant:9e13270264a1417bb48ead5c83b97674 is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:43:27.289905 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-63f50d31-110a-451e-98cf-2d1602cdb2ba admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:43:27.296405 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-63f50d31-110a-451e-98cf-2d1602cdb2ba admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:43:27.371587 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.db_base_plugin_common [req-bb2b73f7-2f73-4d97-80df-72eba1e4c6ea req-47e1e66b-17e3-4026-bd18-6d82608ee271 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Allocated IP 172.20.0.2 (6c7eca3b-72f3-4ba8-9e95-614d64496512/279772c8-d366-4fc6-9c34-e6ddf99b5e08/cd9e7667-ca15-4541-9b3a-687f6f585523) {{(pid=99026) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 17:43:27.496740 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-6704f04b-cf55-4e37-b430-27b2a5b4e6d0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:27.505721 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-7d6bf8a8-cb6e-4d0f-b5f0-cc1d09407f52 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:43:27.513122 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-63f50d31-110a-451e-98cf-2d1602cdb2ba admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:27.538028 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6704f04b-cf55-4e37-b430-27b2a5b4e6d0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=36f94dea-f495-4a32-ab2e-aef5450d5564,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:43:27.542453 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-6704f04b-cf55-4e37-b430-27b2a5b4e6d0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.037s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:43:27.611557 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [req-bb2b73f7-2f73-4d97-80df-72eba1e4c6ea req-47e1e66b-17e3-4026-bd18-6d82608ee271 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Notify callbacks [] for port, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:27.621196 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-63f50d31-110a-451e-98cf-2d1602cdb2ba admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:27.635979 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-284c234f-96e5-487e-9e41-fa28ae0ecaf3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:43:27.694558 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-63f50d31-110a-451e-98cf-2d1602cdb2ba admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=9e13270264a1417bb48ead5c83b97674&name=default HTTP/1.1" status: 200  len: 2979 time: 0.7790911
May 25 17:43:27.697185 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63f50d31-110a-451e-98cf-2d1602cdb2ba admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=47dfe9bb-bfed-463a-9731-be0ae59d1da4,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:43:27.697350 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 42088) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:43:27.701376 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-63f50d31-110a-451e-98cf-2d1602cdb2ba admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.065s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:43:27.756727 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-6704f04b-cf55-4e37-b430-27b2a5b4e6d0 admin admin] Notify callbacks [] for security_group, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:27.757879 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-6704f04b-cf55-4e37-b430-27b2a5b4e6d0 admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/36f94dea-f495-4a32-ab2e-aef5450d5564 HTTP/1.1" status: 204  len: 168 time: 0.6979508
May 25 17:43:27.777053 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-84cf2c4b-3da3-4d14-b65e-ae76cdbcdb8b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:27.794788 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [req-bb2b73f7-2f73-4d97-80df-72eba1e4c6ea req-47e1e66b-17e3-4026-bd18-6d82608ee271 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781840788179', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15476536'] for port, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:27.816587 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:43:27.929033 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-84cf2c4b-3da3-4d14-b65e-ae76cdbcdb8b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:27.961202 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-bb2b73f7-2f73-4d97-80df-72eba1e4c6ea req-47e1e66b-17e3-4026-bd18-6d82608ee271 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Network 6c7eca3b-72f3-4ba8-9e95-614d64496512 is already hosted by enough agents. {{(pid=99026) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 17:43:27.975247 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.scheduler.base_scheduler [req-bb2b73f7-2f73-4d97-80df-72eba1e4c6ea req-47e1e66b-17e3-4026-bd18-6d82608ee271 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Resources bound (agent type, host, resource id):  {{(pid=99026) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 17:43:27.987172 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.l3_dvrscheduler_db [req-bb2b73f7-2f73-4d97-80df-72eba1e4c6ea req-47e1e66b-17e3-4026-bd18-6d82608ee271 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Received port after_create {{(pid=99026) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 17:43:28.031308 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05f66fd7-2dd2-4e7a-8450-1c1d311b385d req-1729502a-206e-4a96-bd51-0d9201d98c9c tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:28.033064 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-05f66fd7-2dd2-4e7a-8450-1c1d311b385d req-1729502a-206e-4a96-bd51-0d9201d98c9c tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/ports?device_id=ac0d5316-763a-434a-82ea-c3d559ad0984 HTTP/1.1" status: 200  len: 931 time: 0.1283846
May 25 17:43:28.054598 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47e1e66b-17e3-4026-bd18-6d82608ee271 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Pushing event updated for resources: {'Port': ['ID=cd9e7667-ca15-4541-9b3a-687f6f585523,revision_number=1']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:43:28.061259 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-47e1e66b-17e3-4026-bd18-6d82608ee271 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.245s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:43:28.081350 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] get_ports_and_sgs() called for port_ids ['4698ed19-7e41-4457-a1fd-16d5f606084a'] {{(pid=99028) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 25 17:43:28.088764 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb2b73f7-2f73-4d97-80df-72eba1e4c6ea req-47e1e66b-17e3-4026-bd18-6d82608ee271 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:28.089453 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [req-bb2b73f7-2f73-4d97-80df-72eba1e4c6ea req-47e1e66b-17e3-4026-bd18-6d82608ee271 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-239387', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for port, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:28.096224 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-05f66fd7-2dd2-4e7a-8450-1c1d311b385d req-e01ed5c3-0270-4873-95c0-d947d6591e45 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/security-groups?id=dda11ec6-545c-479e-bba9-4390fea678fa&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0553393
May 25 17:43:28.110836 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4180ece7-698e-48c1-a8bd-b543828820e4 req-60b11c40-c7dc-48d2-92f0-c866319749ba tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:28.112390 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-4180ece7-698e-48c1-a8bd-b543828820e4 req-60b11c40-c7dc-48d2-92f0-c866319749ba tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=78a85fac-d281-494d-90da-a47ddc8255e5 HTTP/1.1" status: 200  len: 945 time: 0.2655520
May 25 17:43:28.189013 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-4180ece7-698e-48c1-a8bd-b543828820e4 req-5b8337f5-9e16-47e4-bea6-ea54ae71d2a3 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0502717
May 25 17:43:28.210494 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-84cf2c4b-3da3-4d14-b65e-ae76cdbcdb8b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:28.211563 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-84cf2c4b-3da3-4d14-b65e-ae76cdbcdb8b admin admin] Notify callbacks [] for security_group, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:28.212707 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-84cf2c4b-3da3-4d14-b65e-ae76cdbcdb8b admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/47dfe9bb-bfed-463a-9731-be0ae59d1da4 HTTP/1.1" status: 204  len: 168 time: 0.5144534
May 25 17:43:28.213958 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:43:28.227483 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84cf2c4b-3da3-4d14-b65e-ae76cdbcdb8b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=47dfe9bb-bfed-463a-9731-be0ae59d1da4,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:43:28.230808 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-84cf2c4b-3da3-4d14-b65e-ae76cdbcdb8b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:43:28.242087 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-bb2b73f7-2f73-4d97-80df-72eba1e4c6ea req-47e1e66b-17e3-4026-bd18-6d82608ee271 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.125 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.4307539
May 25 17:43:28.260457 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.v2.base [req-bb2b73f7-2f73-4d97-80df-72eba1e4c6ea req-b77e4b1c-86cc-4a74-80f7-6be7e53762d1 service neutron] Request body: {'port': {'device_id': 'ac0d5316-763a-434a-82ea-c3d559ad0984', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78956'}} {{(pid=99026) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:43:28.513028 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [req-bb2b73f7-2f73-4d97-80df-72eba1e4c6ea req-b77e4b1c-86cc-4a74-80f7-6be7e53762d1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:28.920243 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.notifiers.nova [req-bb2b73f7-2f73-4d97-80df-72eba1e4c6ea req-b77e4b1c-86cc-4a74-80f7-6be7e53762d1 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id cd9e7667-ca15-4541-9b3a-687f6f585523 {{(pid=99026) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 25 17:43:28.930077 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [req-bb2b73f7-2f73-4d97-80df-72eba1e4c6ea req-b77e4b1c-86cc-4a74-80f7-6be7e53762d1 service neutron] Notify callbacks [] for port, precommit_update {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:28.947302 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.provisioning_blocks [req-bb2b73f7-2f73-4d97-80df-72eba1e4c6ea req-b77e4b1c-86cc-4a74-80f7-6be7e53762d1 service neutron] Transition to ACTIVE for port object cd9e7667-ca15-4541-9b3a-687f6f585523 will not be triggered until provisioned by entity L2. {{(pid=99026) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 17:43:29.040364 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [req-bb2b73f7-2f73-4d97-80df-72eba1e4c6ea req-b77e4b1c-86cc-4a74-80f7-6be7e53762d1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15476529'] for port, after_update {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:29.045817 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:43:29.184940 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 42140) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:43:29.234749 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-2af4c851-e702-4a5c-a090-06cd9da857c4 admin admin] Notify callbacks [] for security_group, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:29.286221 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-2af4c851-e702-4a5c-a090-06cd9da857c4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:43:29.290692 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-2af4c851-e702-4a5c-a090-06cd9da857c4 admin admin] Usage tracker for resource:security_group_rule and tenant:edede703b5104609a1e20f54133a836f is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:43:29.296142 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-2af4c851-e702-4a5c-a090-06cd9da857c4 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:43:29.309248 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-2af4c851-e702-4a5c-a090-06cd9da857c4 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:43:29.354410 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b77e4b1c-86cc-4a74-80f7-6be7e53762d1 service neutron] Pushing event updated for resources: {'Port': ['ID=cd9e7667-ca15-4541-9b3a-687f6f585523,revision_number=2']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:43:29.374551 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 42148) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:43:29.375748 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-b77e4b1c-86cc-4a74-80f7-6be7e53762d1 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.330s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:43:29.482908 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04554f0e-b9da-46e7-9d49-b08f16e1d1da req-95d22563-2a83-46c1-be42-68a10d33a932 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:29.484572 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-04554f0e-b9da-46e7-9d49-b08f16e1d1da req-95d22563-2a83-46c1-be42-68a10d33a932 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=78a85fac-d281-494d-90da-a47ddc8255e5 HTTP/1.1" status: 200  len: 945 time: 0.1373093
May 25 17:43:29.486744 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-2af4c851-e702-4a5c-a090-06cd9da857c4 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:29.487318 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.managers [req-bb2b73f7-2f73-4d97-80df-72eba1e4c6ea req-b77e4b1c-86cc-4a74-80f7-6be7e53762d1 service neutron] Attempting to bind port cd9e7667-ca15-4541-9b3a-687f6f585523 on host hv-cinder-78956 for vnic_type normal with profile  {{(pid=99026) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 17:43:29.487872 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.managers [req-bb2b73f7-2f73-4d97-80df-72eba1e4c6ea req-b77e4b1c-86cc-4a74-80f7-6be7e53762d1 service neutron] Attempting to bind port cd9e7667-ca15-4541-9b3a-687f6f585523 by drivers openvswitch,hyperv on host hv-cinder-78956 at level 0 using segments [{'id': '87df170f-54cc-461b-a7ac-79e125fc526b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1304, 'network_id': '6c7eca3b-72f3-4ba8-9e95-614d64496512'}] {{(pid=99026) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 17:43:29.490071 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bb2b73f7-2f73-4d97-80df-72eba1e4c6ea req-b77e4b1c-86cc-4a74-80f7-6be7e53762d1 service neutron] Attempting to bind port cd9e7667-ca15-4541-9b3a-687f6f585523 on network 6c7eca3b-72f3-4ba8-9e95-614d64496512 {{(pid=99026) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 17:43:29.508883 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe67be45-aded-4bc6-a64c-07941e7246b5 req-394256e7-c360-40b3-be2f-64b8e2b051f5 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:29.509650 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [req-fe67be45-aded-4bc6-a64c-07941e7246b5 req-394256e7-c360-40b3-be2f-64b8e2b051f5 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Synchronizing usage tracker for tenant:5ae575cfd07c4a88aa626c15e6bccfd9 on resource:port {{(pid=99026) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 17:43:29.512332 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bb2b73f7-2f73-4d97-80df-72eba1e4c6ea req-b77e4b1c-86cc-4a74-80f7-6be7e53762d1 service neutron] Port cd9e7667-ca15-4541-9b3a-687f6f585523 on network 6c7eca3b-72f3-4ba8-9e95-614d64496512 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78956 {{(pid=99026) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 25 17:43:29.512653 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bb2b73f7-2f73-4d97-80df-72eba1e4c6ea req-b77e4b1c-86cc-4a74-80f7-6be7e53762d1 service neutron] Attempting to bind port cd9e7667-ca15-4541-9b3a-687f6f585523 on network 6c7eca3b-72f3-4ba8-9e95-614d64496512 {{(pid=99026) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 17:43:29.533832 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bb2b73f7-2f73-4d97-80df-72eba1e4c6ea req-b77e4b1c-86cc-4a74-80f7-6be7e53762d1 service neutron] Checking agent: {'id': '4d02a528-6a0e-4977-985f-4bcff1ca6cb7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78956', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 17, 40, 41), 'started_at': datetime.datetime(2021, 5, 25, 17, 40, 41), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 17, 43, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=99026) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 17:43:29.533832 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bb2b73f7-2f73-4d97-80df-72eba1e4c6ea req-b77e4b1c-86cc-4a74-80f7-6be7e53762d1 service neutron] Checking segment: {'id': '87df170f-54cc-461b-a7ac-79e125fc526b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1304, 'network_id': '6c7eca3b-72f3-4ba8-9e95-614d64496512'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=99026) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 17:43:29.534391 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bb2b73f7-2f73-4d97-80df-72eba1e4c6ea req-b77e4b1c-86cc-4a74-80f7-6be7e53762d1 service neutron] Bound using segment: {'id': '87df170f-54cc-461b-a7ac-79e125fc526b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1304, 'network_id': '6c7eca3b-72f3-4ba8-9e95-614d64496512'} {{(pid=99026) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 17:43:29.534688 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.managers [req-bb2b73f7-2f73-4d97-80df-72eba1e4c6ea req-b77e4b1c-86cc-4a74-80f7-6be7e53762d1 service neutron] Bound port: cd9e7667-ca15-4541-9b3a-687f6f585523, host: hv-cinder-78956, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '87df170f-54cc-461b-a7ac-79e125fc526b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1304, 'network_id': '6c7eca3b-72f3-4ba8-9e95-614d64496512'}}] {{(pid=99026) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 17:43:29.534922 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [req-bb2b73f7-2f73-4d97-80df-72eba1e4c6ea req-b77e4b1c-86cc-4a74-80f7-6be7e53762d1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:29.564456 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-04554f0e-b9da-46e7-9d49-b08f16e1d1da req-89dc7bb7-cf72-4604-b389-46519f8bb6e7 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0691340
May 25 17:43:29.587080 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-2af4c851-e702-4a5c-a090-06cd9da857c4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:29.603677 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:43:29.626056 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.v2.base [None req-8172b226-382c-417f-9669-fc758838ac67 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeShelveTestJSON-2113890446-network', 'tenant_id': 'cf02997eda314aee8fb322add2fbb921'}} {{(pid=99026) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:43:29.635986 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-8172b226-382c-417f-9669-fc758838ac67 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:43:29.654971 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-8172b226-382c-417f-9669-fc758838ac67 admin admin] Usage tracker for resource:network and tenant:cf02997eda314aee8fb322add2fbb921 is out of sync, need to count used quota {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:43:29.659330 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-8172b226-382c-417f-9669-fc758838ac67 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:43:29.682379 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-8172b226-382c-417f-9669-fc758838ac67 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:43:29.690310 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [req-fe67be45-aded-4bc6-a64c-07941e7246b5 req-394256e7-c360-40b3-be2f-64b8e2b051f5 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Unset dirty status for tenant:5ae575cfd07c4a88aa626c15e6bccfd9 on resource:port {{(pid=99026) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 17:43:29.691457 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-fe67be45-aded-4bc6-a64c-07941e7246b5 req-394256e7-c360-40b3-be2f-64b8e2b051f5 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/ports?device_id=ac0d5316-763a-434a-82ea-c3d559ad0984 HTTP/1.1" status: 200  len: 943 time: 0.4340451
May 25 17:43:29.700485 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2af4c851-e702-4a5c-a090-06cd9da857c4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=39c8f087-eff3-4d36-8732-b062e6c61800,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:43:29.709237 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-2af4c851-e702-4a5c-a090-06cd9da857c4 admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=edede703b5104609a1e20f54133a836f&name=default HTTP/1.1" status: 200  len: 2979 time: 0.5228257
May 25 17:43:29.710244 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 42160) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:43:29.731815 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.db [req-bb2b73f7-2f73-4d97-80df-72eba1e4c6ea req-b77e4b1c-86cc-4a74-80f7-6be7e53762d1 service neutron] For port cd9e7667-ca15-4541-9b3a-687f6f585523, host hv-cinder-78956, cleared binding levels {{(pid=99026) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 17:43:29.732248 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-2af4c851-e702-4a5c-a090-06cd9da857c4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.133s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:43:29.757552 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.db [req-bb2b73f7-2f73-4d97-80df-72eba1e4c6ea req-b77e4b1c-86cc-4a74-80f7-6be7e53762d1 service neutron] For port cd9e7667-ca15-4541-9b3a-687f6f585523, host hv-cinder-78956, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=cd9e7667-ca15-4541-9b3a-687f6f585523,segment=NetworkSegment(87df170f-54cc-461b-a7ac-79e125fc526b),segment_id=87df170f-54cc-461b-a7ac-79e125fc526b)] {{(pid=99026) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 17:43:29.775920 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-fe67be45-aded-4bc6-a64c-07941e7246b5 req-73c27411-3e93-4d73-9936-26e442f0671f tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/security-groups?id=dda11ec6-545c-479e-bba9-4390fea678fa&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0678821
May 25 17:43:29.785321 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8172b226-382c-417f-9669-fc758838ac67 admin admin] Made reservation on behalf of cf02997eda314aee8fb322add2fbb921 for: {'network': 1} {{(pid=99026) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 17:43:29.795512 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-8172b226-382c-417f-9669-fc758838ac67 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-1465344'] for network, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:29.796750 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-9105b9e3-e145-43de-98cd-f4c240069adc admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:29.809864 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-8172b226-382c-417f-9669-fc758838ac67 admin admin] Notify callbacks [] for security_group, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:29.825028 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-9105b9e3-e145-43de-98cd-f4c240069adc admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:29.827503 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-8172b226-382c-417f-9669-fc758838ac67 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:43:29.831262 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-8172b226-382c-417f-9669-fc758838ac67 admin admin] Usage tracker for resource:security_group_rule and tenant:cf02997eda314aee8fb322add2fbb921 is out of sync, need to count used quota {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:43:29.834505 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-8172b226-382c-417f-9669-fc758838ac67 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:43:29.837485 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [req-bb2b73f7-2f73-4d97-80df-72eba1e4c6ea req-b77e4b1c-86cc-4a74-80f7-6be7e53762d1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15476529'] for port, after_update {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:29.848247 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-8172b226-382c-417f-9669-fc758838ac67 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:43:29.852007 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:43:29.942506 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb2b73f7-2f73-4d97-80df-72eba1e4c6ea req-b77e4b1c-86cc-4a74-80f7-6be7e53762d1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:29.943633 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [req-bb2b73f7-2f73-4d97-80df-72eba1e4c6ea req-b77e4b1c-86cc-4a74-80f7-6be7e53762d1 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-239387', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for port, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:29.944634 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-bb2b73f7-2f73-4d97-80df-72eba1e4c6ea req-b77e4b1c-86cc-4a74-80f7-6be7e53762d1 service neutron] 10.222.0.125 "PUT /v2.0/ports/cd9e7667-ca15-4541-9b3a-687f6f585523 HTTP/1.1" status: 200  len: 1093 time: 1.6929898
May 25 17:43:29.945133 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ac0d5316-763a-434a-82ea-c3d559ad0984', 'tag': 'cd9e7667-ca15-4541-9b3a-687f6f585523'}] {{(pid=99026) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 17:43:29.966922 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b77e4b1c-86cc-4a74-80f7-6be7e53762d1 service neutron] Pushing event updated for resources: {'Port': ['ID=cd9e7667-ca15-4541-9b3a-687f6f585523,revision_number=3']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:43:29.970074 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-b77e4b1c-86cc-4a74-80f7-6be7e53762d1 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.118s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:43:30.003783 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ac0d5316-763a-434a-82ea-c3d559ad0984', 'tag': 'cd9e7667-ca15-4541-9b3a-687f6f585523', 'status': 'completed', 'code': 200}
May 25 17:43:30.006016 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-9105b9e3-e145-43de-98cd-f4c240069adc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:30.011598 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-8fec1ca0-7672-4e72-9431-fe9db4d5883a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:43:30.024841 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9105b9e3-e145-43de-98cd-f4c240069adc admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=39c8f087-eff3-4d36-8732-b062e6c61800,revision_number=None']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:43:30.028718 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-9105b9e3-e145-43de-98cd-f4c240069adc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:43:30.055337 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-9105b9e3-e145-43de-98cd-f4c240069adc admin admin] Notify callbacks [] for security_group, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:30.056716 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-9105b9e3-e145-43de-98cd-f4c240069adc admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/39c8f087-eff3-4d36-8732-b062e6c61800 HTTP/1.1" status: 204  len: 168 time: 0.3451962
May 25 17:43:30.105532 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-8172b226-382c-417f-9669-fc758838ac67 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:30.178064 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-8172b226-382c-417f-9669-fc758838ac67 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:30.182289 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:43:30.205938 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-8172b226-382c-417f-9669-fc758838ac67 admin admin] vlan segment allocate from pool success with {'vlan_id': 1318, 'physical_network': 'physnet1'}  {{(pid=99026) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 25 17:43:30.219166 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8172b226-382c-417f-9669-fc758838ac67 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=84d269c7-a51d-465e-86b0-06805e6e0c89,revision_number=1']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:43:30.223250 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-8172b226-382c-417f-9669-fc758838ac67 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.041s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:43:30.224827 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-8172b226-382c-417f-9669-fc758838ac67 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1469168'] for segment, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:30.225267 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.db.segments_db [None req-8172b226-382c-417f-9669-fc758838ac67 admin admin] Added segment e9a4953c-bd2f-4412-9030-8eb2cd20f5c5 of type vlan for network 45b850af-d423-458a-855a-d7f828a11fff
May 25 17:43:30.255660 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-8172b226-382c-417f-9669-fc758838ac67 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8781840806997'] for network, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:30.463429 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-8172b226-382c-417f-9669-fc758838ac67 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-459299', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551400'] for network, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:30.464920 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8172b226-382c-417f-9669-fc758838ac67 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:30.465673 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-8172b226-382c-417f-9669-fc758838ac67 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for network, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:30.471898 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:43:30.585718 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8172b226-382c-417f-9669-fc758838ac67 admin admin] Pushing event updated for resources: {'Network': ['ID=45b850af-d423-458a-855a-d7f828a11fff,revision_number=1']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:43:30.588664 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-8172b226-382c-417f-9669-fc758838ac67 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.117s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:43:30.600892 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Network 45b850af-d423-458a-855a-d7f828a11fff details requested by agent ovs-agent-dv-cinder-789564-2-iscsi with host dv-cinder-789564-2-iscsi {{(pid=99028) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 25 17:43:30.645355 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 42192) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:43:30.646602 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-8172b226-382c-417f-9669-fc758838ac67 admin admin] 10.222.0.122 "POST /v2.0/networks HTTP/1.1" status: 201  len: 891 time: 1.2665129
May 25 17:43:30.651746 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.v2.base [None req-966321f0-95c5-4e99-810c-e26892c7ef39 admin admin] Request body: {'subnet': {'network_id': '45b850af-d423-458a-855a-d7f828a11fff', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeShelveTestJSON-2113890446-subnet', 'tenant_id': 'cf02997eda314aee8fb322add2fbb921', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=99027) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:43:30.656944 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-966321f0-95c5-4e99-810c-e26892c7ef39 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:43:30.663916 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-966321f0-95c5-4e99-810c-e26892c7ef39 admin admin] Usage tracker for resource:subnet and tenant:cf02997eda314aee8fb322add2fbb921 is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:43:30.674597 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-966321f0-95c5-4e99-810c-e26892c7ef39 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:43:30.684164 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-966321f0-95c5-4e99-810c-e26892c7ef39 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:43:30.831333 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-966321f0-95c5-4e99-810c-e26892c7ef39 admin admin] Made reservation on behalf of cf02997eda314aee8fb322add2fbb921 for: {'subnet': 1} {{(pid=99027) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 17:43:30.835472 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-966321f0-95c5-4e99-810c-e26892c7ef39 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-14778112'] for subnet, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:30.851489 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07644640-7cd8-433f-a062-0cb8c3fe9679 req-2cbb5ccb-e9a9-46e1-a8b1-0418c12d4561 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:30.855468 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-07644640-7cd8-433f-a062-0cb8c3fe9679 req-2cbb5ccb-e9a9-46e1-a8b1-0418c12d4561 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=78a85fac-d281-494d-90da-a47ddc8255e5 HTTP/1.1" status: 200  len: 945 time: 0.1196287
May 25 17:43:30.904571 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-07644640-7cd8-433f-a062-0cb8c3fe9679 req-0f80db88-6208-4177-96ea-943ae737f8f5 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0455127
May 25 17:43:31.103242 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-340de082-f2c2-4078-ab66-c3eb5693b31f req-ff909e7f-95f3-4455-bf13-b0db50787633 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:31.104693 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-340de082-f2c2-4078-ab66-c3eb5693b31f req-ff909e7f-95f3-4455-bf13-b0db50787633 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/ports?device_id=ac0d5316-763a-434a-82ea-c3d559ad0984 HTTP/1.1" status: 200  len: 943 time: 0.0894139
May 25 17:43:31.152093 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-340de082-f2c2-4078-ab66-c3eb5693b31f req-9a6b225b-6e8a-42fe-9dfc-96394e2bf8bb tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/security-groups?id=dda11ec6-545c-479e-bba9-4390fea678fa&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0394373
May 25 17:43:31.367057 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-966321f0-95c5-4e99-810c-e26892c7ef39 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114466', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-15467018', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-14778134'] for subnet, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:31.370897 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:43:31.440521 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-966321f0-95c5-4e99-810c-e26892c7ef39 admin admin] Pushing event updated for resources: {'Subnet': ['ID=704d0a85-ee4f-4df2-90a3-a525dfe28461,revision_number=0']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:43:31.444590 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-966321f0-95c5-4e99-810c-e26892c7ef39 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:43:31.452084 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-966321f0-95c5-4e99-810c-e26892c7ef39 admin admin] Checking segment: {'id': 'e9a4953c-bd2f-4412-9030-8eb2cd20f5c5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1318, 'network_id': '45b850af-d423-458a-855a-d7f828a11fff'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=99027) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 17:43:31.452431 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-966321f0-95c5-4e99-810c-e26892c7ef39 admin admin] Network hostable DHCP agents. Network: 45b850af-d423-458a-855a-d7f828a11fff, hostable agents: ['c8b0a350-254b-4562-874b-120ecdef0e25'], hosted agents: [] {{(pid=99027) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 25 17:43:31.531216 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-966321f0-95c5-4e99-810c-e26892c7ef39 admin admin] Network 45b850af-d423-458a-855a-d7f828a11fff is scheduled to be hosted by DHCP agent c8b0a350-254b-4562-874b-120ecdef0e25 with binding_index 1 {{(pid=99027) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 25 17:43:31.628393 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.base_scheduler [None req-966321f0-95c5-4e99-810c-e26892c7ef39 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-789564-2-iscsi, 45b850af-d423-458a-855a-d7f828a11fff) {{(pid=99027) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 17:43:31.637454 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-51127963-df7b-4531-918a-40209ff16327 None None] Network 45b850af-d423-458a-855a-d7f828a11fff requested from dv-cinder-789564-2-iscsi {{(pid=99028) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 17:43:31.639950 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-966321f0-95c5-4e99-810c-e26892c7ef39 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:31.640540 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-966321f0-95c5-4e99-810c-e26892c7ef39 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for subnet, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:31.729289 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-966321f0-95c5-4e99-810c-e26892c7ef39 admin admin] 10.222.0.122 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 853 time: 1.0821855
May 25 17:43:31.730582 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 42222) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:43:31.736219 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.v2.base [None req-3a3ee8af-1471-47e1-9a8a-5341514849c7 admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeShelveTestJSON-2113890446-router', 'tenant_id': 'cf02997eda314aee8fb322add2fbb921', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb'}}} {{(pid=99026) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:43:31.743669 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-3a3ee8af-1471-47e1-9a8a-5341514849c7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:43:31.747704 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-3a3ee8af-1471-47e1-9a8a-5341514849c7 admin admin] Usage tracker for resource:router and tenant:cf02997eda314aee8fb322add2fbb921 is out of sync, need to count used quota {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:43:31.750575 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-3a3ee8af-1471-47e1-9a8a-5341514849c7 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:43:31.756694 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-3a3ee8af-1471-47e1-9a8a-5341514849c7 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:43:31.806117 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-3a3ee8af-1471-47e1-9a8a-5341514849c7 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-415064', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-6983'] for router, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:31.807190 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-3a3ee8af-1471-47e1-9a8a-5341514849c7 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-414296', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-419975', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-491114', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-6988'] for router, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:31.822624 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-3a3ee8af-1471-47e1-9a8a-5341514849c7 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:31.916883 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5eb65ca6-f074-4b97-bf0e-05fd6c06aa9c None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpe415bc4a-81ee-5198-a7be-1f5e4adc5586-45b850af-d423-458a-855a-d7f828a11fff', 'network_id': '45b850af-d423-458a-855a-d7f828a11fff', 'tenant_id': 'cf02997eda314aee8fb322add2fbb921', 'fixed_ips': [{'subnet_id': '704d0a85-ee4f-4df2-90a3-a525dfe28461'}]}} from dv-cinder-789564-2-iscsi. {{(pid=99028) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
May 25 17:43:31.916883 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-5eb65ca6-f074-4b97-bf0e-05fd6c06aa9c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_create {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:32.078762 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.db_base_plugin_common [None req-5eb65ca6-f074-4b97-bf0e-05fd6c06aa9c None None] Allocated IP 172.20.0.2 (45b850af-d423-458a-855a-d7f828a11fff/704d0a85-ee4f-4df2-90a3-a525dfe28461/20819f61-2e9b-4003-9d9f-151a9e6d2fd4) {{(pid=99028) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 17:43:32.316675 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-5eb65ca6-f074-4b97-bf0e-05fd6c06aa9c None None] Notify callbacks [] for port, precommit_create {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:32.324569 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-3a3ee8af-1471-47e1-9a8a-5341514849c7 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-420002', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-415082', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-6970'] for router, precommit_update {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:32.328901 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-5eb65ca6-f074-4b97-bf0e-05fd6c06aa9c None None] Transition to ACTIVE for port object 20819f61-2e9b-4003-9d9f-151a9e6d2fd4 will not be triggered until provisioned by entity L2. {{(pid=99028) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 17:43:32.351101 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-5eb65ca6-f074-4b97-bf0e-05fd6c06aa9c None None] Transition to ACTIVE for port object 20819f61-2e9b-4003-9d9f-151a9e6d2fd4 will not be triggered until provisioned by entity DHCP. {{(pid=99028) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 17:43:32.390842 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a80fd7ed-0725-4e11-9d91-af496e5f6231 req-89901e00-ef04-4fa0-9389-1330e6b1de98 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:32.392871 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-a80fd7ed-0725-4e11-9d91-af496e5f6231 req-89901e00-ef04-4fa0-9389-1330e6b1de98 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=78a85fac-d281-494d-90da-a47ddc8255e5 HTTP/1.1" status: 200  len: 945 time: 0.3353691
May 25 17:43:32.446505 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b560d2e-0cc0-433a-af63-8fc056d77376 req-7f5ddf78-5fbc-40d7-8de5-0b688c4998e9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:32.448023 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-6b560d2e-0cc0-433a-af63-8fc056d77376 req-7f5ddf78-5fbc-40d7-8de5-0b688c4998e9 service neutron] 10.222.0.125 "GET /v2.0/ports?tenant_id=5ae575cfd07c4a88aa626c15e6bccfd9&device_id=ac0d5316-763a-434a-82ea-c3d559ad0984 HTTP/1.1" status: 200  len: 1096 time: 0.1822438
May 25 17:43:32.469249 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-5eb65ca6-f074-4b97-bf0e-05fd6c06aa9c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781840788179'] for port, after_create {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:32.474828 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:43:32.480604 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-a80fd7ed-0725-4e11-9d91-af496e5f6231 req-ed3e984b-8fc2-44d0-a78f-b623c6c90809 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0808332
May 25 17:43:32.562326 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5eb65ca6-f074-4b97-bf0e-05fd6c06aa9c None None] Network 45b850af-d423-458a-855a-d7f828a11fff is already hosted by enough agents. {{(pid=99028) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 17:43:32.565776 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.scheduler.base_scheduler [None req-5eb65ca6-f074-4b97-bf0e-05fd6c06aa9c None None] Resources bound (agent type, host, resource id):  {{(pid=99028) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 17:43:32.571403 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5eb65ca6-f074-4b97-bf0e-05fd6c06aa9c None None] Received port after_create {{(pid=99028) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 17:43:32.575825 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5eb65ca6-f074-4b97-bf0e-05fd6c06aa9c None None] Pushing event updated for resources: {'Port': ['ID=20819f61-2e9b-4003-9d9f-151a9e6d2fd4,revision_number=1']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:43:32.608035 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5eb65ca6-f074-4b97-bf0e-05fd6c06aa9c None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:43:32.608530 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5eb65ca6-f074-4b97-bf0e-05fd6c06aa9c None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:43:32.608967 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5eb65ca6-f074-4b97-bf0e-05fd6c06aa9c None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:43:32.609428 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5eb65ca6-f074-4b97-bf0e-05fd6c06aa9c None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:43:32.610607 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5eb65ca6-f074-4b97-bf0e-05fd6c06aa9c None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:43:32.610607 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5eb65ca6-f074-4b97-bf0e-05fd6c06aa9c None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:43:32.610607 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5eb65ca6-f074-4b97-bf0e-05fd6c06aa9c None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:43:32.611089 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5eb65ca6-f074-4b97-bf0e-05fd6c06aa9c None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:43:32.611506 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5eb65ca6-f074-4b97-bf0e-05fd6c06aa9c None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:43:32.611995 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5eb65ca6-f074-4b97-bf0e-05fd6c06aa9c None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:43:32.612410 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5eb65ca6-f074-4b97-bf0e-05fd6c06aa9c None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:43:32.612825 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5eb65ca6-f074-4b97-bf0e-05fd6c06aa9c None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:43:32.622727 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-5eb65ca6-f074-4b97-bf0e-05fd6c06aa9c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.148s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:43:32.650423 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65107e14-1755-429a-811c-50d5741dd6d8 req-38c4d021-6f13-43a1-b803-275b9f811c8b tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:32.652003 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-65107e14-1755-429a-811c-50d5741dd6d8 req-38c4d021-6f13-43a1-b803-275b9f811c8b tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/ports?device_id=ac0d5316-763a-434a-82ea-c3d559ad0984 HTTP/1.1" status: 200  len: 943 time: 0.1117392
May 25 17:43:32.702983 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.managers [None req-5eb65ca6-f074-4b97-bf0e-05fd6c06aa9c None None] Attempting to bind port 20819f61-2e9b-4003-9d9f-151a9e6d2fd4 on host dv-cinder-789564-2-iscsi for vnic_type normal with profile  {{(pid=99028) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 17:43:32.704149 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.managers [None req-5eb65ca6-f074-4b97-bf0e-05fd6c06aa9c None None] Attempting to bind port 20819f61-2e9b-4003-9d9f-151a9e6d2fd4 by drivers openvswitch,hyperv on host dv-cinder-789564-2-iscsi at level 0 using segments [{'id': 'e9a4953c-bd2f-4412-9030-8eb2cd20f5c5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1318, 'network_id': '45b850af-d423-458a-855a-d7f828a11fff'}] {{(pid=99028) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 17:43:32.705007 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5eb65ca6-f074-4b97-bf0e-05fd6c06aa9c None None] Attempting to bind port 20819f61-2e9b-4003-9d9f-151a9e6d2fd4 on network 45b850af-d423-458a-855a-d7f828a11fff {{(pid=99028) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 17:43:32.715801 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5eb65ca6-f074-4b97-bf0e-05fd6c06aa9c None None] Checking agent: {'id': '7bb67520-1e97-4ad9-9b97-101068bbe1a3', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-789564-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 17, 34, 21), 'started_at': datetime.datetime(2021, 5, 25, 17, 34, 51), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 17, 43, 21), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-789564-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=99028) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 17:43:32.716338 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5eb65ca6-f074-4b97-bf0e-05fd6c06aa9c None None] Checking segment: {'id': 'e9a4953c-bd2f-4412-9030-8eb2cd20f5c5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1318, 'network_id': '45b850af-d423-458a-855a-d7f828a11fff'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=99028) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 17:43:32.716938 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-5eb65ca6-f074-4b97-bf0e-05fd6c06aa9c None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:32.717507 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5eb65ca6-f074-4b97-bf0e-05fd6c06aa9c None None] Bound using segment: {'id': 'e9a4953c-bd2f-4412-9030-8eb2cd20f5c5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1318, 'network_id': '45b850af-d423-458a-855a-d7f828a11fff'} {{(pid=99028) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 17:43:32.718100 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.managers [None req-5eb65ca6-f074-4b97-bf0e-05fd6c06aa9c None None] Bound port: 20819f61-2e9b-4003-9d9f-151a9e6d2fd4, host: dv-cinder-789564-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e9a4953c-bd2f-4412-9030-8eb2cd20f5c5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1318, 'network_id': '45b850af-d423-458a-855a-d7f828a11fff'}}] {{(pid=99028) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 17:43:32.718229 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-65107e14-1755-429a-811c-50d5741dd6d8 req-03781d08-249a-40de-9683-d494d8995d2c tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/security-groups?id=dda11ec6-545c-479e-bba9-4390fea678fa&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0595024
May 25 17:43:32.721580 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-5eb65ca6-f074-4b97-bf0e-05fd6c06aa9c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:32.803202 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b560d2e-0cc0-433a-af63-8fc056d77376 req-bb1d3e69-f369-42af-a784-4eb3e627ba8e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:32.804669 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-6b560d2e-0cc0-433a-af63-8fc056d77376 req-bb1d3e69-f369-42af-a784-4eb3e627ba8e service neutron] 10.222.0.125 "GET /v2.0/networks?tenant_id=5ae575cfd07c4a88aa626c15e6bccfd9&shared=False HTTP/1.1" status: 200  len: 916 time: 0.3475611
May 25 17:43:32.825176 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-5eb65ca6-f074-4b97-bf0e-05fd6c06aa9c None None] For port 20819f61-2e9b-4003-9d9f-151a9e6d2fd4, host dv-cinder-789564-2-iscsi, cleared binding levels {{(pid=99028) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 17:43:32.828298 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-5eb65ca6-f074-4b97-bf0e-05fd6c06aa9c None None] For port 20819f61-2e9b-4003-9d9f-151a9e6d2fd4, host dv-cinder-789564-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=20819f61-2e9b-4003-9d9f-151a9e6d2fd4,segment=NetworkSegment(e9a4953c-bd2f-4412-9030-8eb2cd20f5c5),segment_id=e9a4953c-bd2f-4412-9030-8eb2cd20f5c5)] {{(pid=99028) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 17:43:32.898104 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-5eb65ca6-f074-4b97-bf0e-05fd6c06aa9c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:32.903496 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:43:33.007990 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5eb65ca6-f074-4b97-bf0e-05fd6c06aa9c None None] Pushing event updated for resources: {'Port': ['ID=20819f61-2e9b-4003-9d9f-151a9e6d2fd4,revision_number=2']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:43:33.017824 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-5eb65ca6-f074-4b97-bf0e-05fd6c06aa9c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.114s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:43:33.034580 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-3a3ee8af-1471-47e1-9a8a-5341514849c7 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:33.067489 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-3a3ee8af-1471-47e1-9a8a-5341514849c7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:33.266435 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.db_base_plugin_common [None req-3a3ee8af-1471-47e1-9a8a-5341514849c7 admin admin] Allocated IP 172.27.3.226 (eb7ec72b-a691-481b-8d7e-42c05e13a8cb/d6898f5f-da0b-4428-97b4-4cbe3e83caaa/1e97124a-073a-4947-a6f2-359fb12ffe5e) {{(pid=99026) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 17:43:33.536445 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b560d2e-0cc0-433a-af63-8fc056d77376 req-c545563a-5b7e-4b57-9f7d-5b3e3138a506 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:33.538008 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-6b560d2e-0cc0-433a-af63-8fc056d77376 req-c545563a-5b7e-4b57-9f7d-5b3e3138a506 service neutron] 10.222.0.125 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 871 time: 0.2687984
May 25 17:43:33.584076 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-3a3ee8af-1471-47e1-9a8a-5341514849c7 admin admin] Notify callbacks [] for port, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:33.686078 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-3a3ee8af-1471-47e1-9a8a-5341514849c7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781840788179', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15476536'] for port, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:33.691280 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:43:33.744852 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-666508cd-226c-4bed-b89d-28bbdf1205f2 req-f7bef6e1-508f-4dc9-8b83-8a1d7841be31 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:33.746871 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-666508cd-226c-4bed-b89d-28bbdf1205f2 req-f7bef6e1-508f-4dc9-8b83-8a1d7841be31 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=78a85fac-d281-494d-90da-a47ddc8255e5 HTTP/1.1" status: 200  len: 945 time: 0.1114440
May 25 17:43:33.756705 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3a3ee8af-1471-47e1-9a8a-5341514849c7 admin admin] Network eb7ec72b-a691-481b-8d7e-42c05e13a8cb is already hosted by enough agents. {{(pid=99026) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 17:43:33.759519 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.scheduler.base_scheduler [None req-3a3ee8af-1471-47e1-9a8a-5341514849c7 admin admin] Resources bound (agent type, host, resource id):  {{(pid=99026) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 17:43:33.773364 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3a3ee8af-1471-47e1-9a8a-5341514849c7 admin admin] Received port after_create {{(pid=99026) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 17:43:33.805375 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-666508cd-226c-4bed-b89d-28bbdf1205f2 req-8cfe1b94-fc83-4b18-ba9c-41907b217eaf tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0488594
May 25 17:43:33.815424 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a3ee8af-1471-47e1-9a8a-5341514849c7 admin admin] Pushing event updated for resources: {'Port': ['ID=1e97124a-073a-4947-a6f2-359fb12ffe5e,revision_number=1']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:43:33.818908 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-3a3ee8af-1471-47e1-9a8a-5341514849c7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.127s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:43:34.015895 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbe9b7df-e2d2-4750-bec6-f3938d4e5a10 req-d9509bee-c543-4722-bade-07d0bfdc106a tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:34.017585 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-bbe9b7df-e2d2-4750-bec6-f3938d4e5a10 req-d9509bee-c543-4722-bade-07d0bfdc106a tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/ports?device_id=ac0d5316-763a-434a-82ea-c3d559ad0984 HTTP/1.1" status: 200  len: 943 time: 0.0948942
May 25 17:43:34.040059 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-158218a6-c429-4b03-8c38-a0005d03a3da None None] Network 45b850af-d423-458a-855a-d7f828a11fff requested from dv-cinder-789564-2-iscsi {{(pid=99028) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 17:43:34.066810 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-bbe9b7df-e2d2-4750-bec6-f3938d4e5a10 req-ef9ff9dc-c607-4591-8970-7124532399ef tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/security-groups?id=dda11ec6-545c-479e-bba9-4390fea678fa&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0428662
May 25 17:43:34.252127 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-b9aae3b4-02d5-4616-8fa8-975cb6d28d5a None None] Provisioning for port 20819f61-2e9b-4003-9d9f-151a9e6d2fd4 completed by entity DHCP. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 17:43:34.326876 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-3a3ee8af-1471-47e1-9a8a-5341514849c7 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:34.856884 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-3a3ee8af-1471-47e1-9a8a-5341514849c7 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-415057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-420065'] for router, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:34.955071 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb2b73f7-2f73-4d97-80df-72eba1e4c6ea req-843f8b2f-dee4-4660-8429-0e1f85d6f0c8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:34.956620 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-bb2b73f7-2f73-4d97-80df-72eba1e4c6ea req-843f8b2f-dee4-4660-8429-0e1f85d6f0c8 service neutron] 10.222.0.125 "GET /v2.0/ports?tenant_id=5ae575cfd07c4a88aa626c15e6bccfd9&device_id=ac0d5316-763a-434a-82ea-c3d559ad0984 HTTP/1.1" status: 200  len: 1096 time: 0.1770375
May 25 17:43:35.012083 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e54859b9-1bb8-4e95-b565-bbd6505a322a req-878801b5-8ac3-4301-be50-6d9153055d25 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:35.017541 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-e54859b9-1bb8-4e95-b565-bbd6505a322a req-878801b5-8ac3-4301-be50-6d9153055d25 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=78a85fac-d281-494d-90da-a47ddc8255e5 HTTP/1.1" status: 200  len: 945 time: 0.0898192
May 25 17:43:35.018131 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 42310) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:43:35.073840 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-e54859b9-1bb8-4e95-b565-bbd6505a322a req-1b2c146c-9375-4c69-9992-3b050f93eaea tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0528407
May 25 17:43:35.094458 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-bb2b73f7-2f73-4d97-80df-72eba1e4c6ea req-beb58978-d92f-4cdc-9a16-53d9493a1c31 service neutron] 10.222.0.125 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=cd9e7667-ca15-4541-9b3a-687f6f585523 HTTP/1.1" status: 200  len: 217 time: 0.1321111
May 25 17:43:35.181987 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb2b73f7-2f73-4d97-80df-72eba1e4c6ea req-0cc1fe2e-c0c5-4950-920e-4c9b9c88bf75 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:35.186307 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-bb2b73f7-2f73-4d97-80df-72eba1e4c6ea req-0cc1fe2e-c0c5-4950-920e-4c9b9c88bf75 service neutron] 10.222.0.125 "GET /v2.0/subnets?id=279772c8-d366-4fc6-9c34-e6ddf99b5e08 HTTP/1.1" status: 200  len: 854 time: 0.0818577
May 25 17:43:35.218092 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-bdfb0b74-f7a8-4efb-b0d0-30f7981ab2fc admin admin] Notify callbacks [] for security_group, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:35.251734 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-bb2b73f7-2f73-4d97-80df-72eba1e4c6ea req-013d7330-5d2f-4115-bdda-a915030ff6a8 service neutron] 10.222.0.125 "GET /v2.0/ports?network_id=6c7eca3b-72f3-4ba8-9e95-614d64496512&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0603518
May 25 17:43:35.259254 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-bdfb0b74-f7a8-4efb-b0d0-30f7981ab2fc admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:43:35.259609 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device 20819f61-2e9b-4003-9d9f-151a9e6d2fd4 up at agent ovs-agent-dv-cinder-789564-2-iscsi {{(pid=99028) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 17:43:35.263848 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-bdfb0b74-f7a8-4efb-b0d0-30f7981ab2fc admin admin] Usage tracker for resource:security_group_rule and tenant:62dddf5650cf4d51bd67736854d3e494 is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:43:35.268340 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-bdfb0b74-f7a8-4efb-b0d0-30f7981ab2fc admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:43:35.279082 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-bdfb0b74-f7a8-4efb-b0d0-30f7981ab2fc admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:43:35.385519 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-bdfb0b74-f7a8-4efb-b0d0-30f7981ab2fc admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:35.402193 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3a3ee8af-1471-47e1-9a8a-5341514849c7 admin admin] Router 3ca50ec5-218d-44ad-8ffc-4318f54d7350 is scheduled to L3 agent eaeb6875-c4ed-43b6-8658-aa4e52324fdf with binding_index 1 {{(pid=99026) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
May 25 17:43:35.451189 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Provisioning for port 20819f61-2e9b-4003-9d9f-151a9e6d2fd4 completed by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 17:43:35.456186 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Provisioning complete for port 20819f61-2e9b-4003-9d9f-151a9e6d2fd4 triggered by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 17:43:35.456568 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:35.479837 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-bdfb0b74-f7a8-4efb-b0d0-30f7981ab2fc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:35.488982 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-9105b9e3-e145-43de-98cd-f4c240069adc admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:43:35.535448 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-bdfb0b74-f7a8-4efb-b0d0-30f7981ab2fc admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=62dddf5650cf4d51bd67736854d3e494&name=default HTTP/1.1" status: 200  len: 2979 time: 0.5162148
May 25 17:43:35.536257 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 42326) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:43:35.539191 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bdfb0b74-f7a8-4efb-b0d0-30f7981ab2fc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f366de65-eac4-4616-bf00-ae5d64c5a05e,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:43:35.543844 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-bb2b73f7-2f73-4d97-80df-72eba1e4c6ea req-451698d4-5a20-48a1-9848-5cf246d6ab51 service neutron] 10.222.0.125 "GET /v2.0/networks/6c7eca3b-72f3-4ba8-9e95-614d64496512?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2522547
May 25 17:43:35.553584 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-bdfb0b74-f7a8-4efb-b0d0-30f7981ab2fc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.065s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:43:35.554756 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21ef702c-07cc-4a05-adea-650e795db4b6 req-0a2994c7-90cf-4d49-b84a-619e41608bd2 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:35.556248 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-21ef702c-07cc-4a05-adea-650e795db4b6 req-0a2994c7-90cf-4d49-b84a-619e41608bd2 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/ports?device_id=ac0d5316-763a-434a-82ea-c3d559ad0984 HTTP/1.1" status: 200  len: 943 time: 0.3099501
May 25 17:43:35.589966 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:35.629014 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] For port 20819f61-2e9b-4003-9d9f-151a9e6d2fd4, host dv-cinder-789564-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=20819f61-2e9b-4003-9d9f-151a9e6d2fd4,segment=NetworkSegment(e9a4953c-bd2f-4412-9030-8eb2cd20f5c5),segment_id=e9a4953c-bd2f-4412-9030-8eb2cd20f5c5)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:43:35.632718 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-de458754-0056-47c4-a2d9-3dba73c5942d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:35.659799 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-de458754-0056-47c4-a2d9-3dba73c5942d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:35.761173 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:35.762895 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:43:35.775639 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-21ef702c-07cc-4a05-adea-650e795db4b6 req-721d8e3a-2c19-4058-82dd-832ac78cc74b tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/security-groups?id=dda11ec6-545c-479e-bba9-4390fea678fa&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1618392
May 25 17:43:35.791092 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3a3ee8af-1471-47e1-9a8a-5341514849c7 admin admin] Notify agent at l3_agent.dv-cinder-789564-2-iscsi the message routers_updated {{(pid=99026) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 25 17:43:35.823098 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e4459660-3553-4992-9861-3d0f9342750a None None] Sync routers for ids ['3ca50ec5-218d-44ad-8ffc-4318f54d7350'] in dv-cinder-789564-2-iscsi {{(pid=99029) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 25 17:43:35.844983 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-bb2b73f7-2f73-4d97-80df-72eba1e4c6ea req-9a7e0b20-6529-430f-ba1d-b29955e4e2c7 service neutron] 10.222.0.125 "GET /v2.0/networks/6c7eca3b-72f3-4ba8-9e95-614d64496512?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2340939
May 25 17:43:35.857367 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e4459660-3553-4992-9861-3d0f9342750a None None] Routers {'3ca50ec5-218d-44ad-8ffc-4318f54d7350'} bound to L3 agent in host dv-cinder-789564-2-iscsi {{(pid=99029) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 17:43:35.858226 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_hamode_db [None req-e4459660-3553-4992-9861-3d0f9342750a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcae718d670>, 'dv-cinder-789564-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-25T17:34:21Z,description=<?>,heartbeat_timestamp=2021-05-25T17:43:21Z,host='dv-cinder-789564-2-iscsi',id=eaeb6875-c4ed-43b6-8658-aa4e52324fdf,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T17:34:21Z,topic='l3_agent')) {'router_ids': ['3ca50ec5-218d-44ad-8ffc-4318f54d7350'], 'active': True} {{(pid=99029) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:43:35.884930 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Pushing event updated for resources: {'Port': ['ID=20819f61-2e9b-4003-9d9f-151a9e6d2fd4,revision_number=3']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:43:35.888229 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.125s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:43:35.949027 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-3a3ee8af-1471-47e1-9a8a-5341514849c7 admin admin] Notify callbacks [] for router, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:35.950343 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-3a3ee8af-1471-47e1-9a8a-5341514849c7 admin admin] 10.222.0.122 "POST /v2.0/routers HTTP/1.1" status: 201  len: 929 time: 4.2185168
May 25 17:43:35.950827 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-de458754-0056-47c4-a2d9-3dba73c5942d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:35.952941 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 42346) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:43:35.955999 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-cafb6a1b-2218-4ef1-8268-3a5bf574b2d5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:43:35.967410 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de458754-0056-47c4-a2d9-3dba73c5942d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f366de65-eac4-4616-bf00-ae5d64c5a05e,revision_number=None']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:43:35.975748 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-de458754-0056-47c4-a2d9-3dba73c5942d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:43:35.976875 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-de458754-0056-47c4-a2d9-3dba73c5942d admin admin] Notify callbacks [] for security_group, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:35.978208 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-de458754-0056-47c4-a2d9-3dba73c5942d admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/f366de65-eac4-4616-bf00-ae5d64c5a05e HTTP/1.1" status: 204  len: 168 time: 0.4406326
May 25 17:43:36.087834 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_dvr_db [None req-e4459660-3553-4992-9861-3d0f9342750a None None] Set router 3ca50ec5-218d-44ad-8ffc-4318f54d7350 gateway port host: dv-cinder-789564-2-iscsi {{(pid=99029) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 17:43:36.457023 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_hamode_db [None req-e4459660-3553-4992-9861-3d0f9342750a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcae718d670>, [{'id': '3ca50ec5-218d-44ad-8ffc-4318f54d7350', 'name': 'tempest-AttachVolumeShelveTestJSON-2113890446-router', 'tenant_id': 'cf02997eda314aee8fb322add2fbb921', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.226'}], 'enable_snat': True}, 'gw_port_id': '1e97124a-073a-4947-a6f2-359fb12ffe5e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:43:31Z', 'updated_at': '2021-05-25T17:43:34Z', 'revision_number': 3, 'project_id': 'cf02997eda314aee8fb322add2fbb921', 'gw_port': {'id': '1e97124a-073a-4947-a6f2-359fb12ffe5e', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:c8:ed:c5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3ca50ec5-218d-44ad-8ffc-4318f54d7350', 'device_owner': 'network:router_gateway', 'standard_attr_id': 244, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.226', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:43:33Z', 'updated_at': '2021-05-25T17:43:33Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi'}], 'dv-cinder-789564-2-iscsi', False) {} {{(pid=99029) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:43:36.461551 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e4459660-3553-4992-9861-3d0f9342750a None None] Checking router: 3ca50ec5-218d-44ad-8ffc-4318f54d7350 for host: dv-cinder-789564-2-iscsi {{(pid=99029) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 25 17:43:36.461955 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e4459660-3553-4992-9861-3d0f9342750a None None] Updating router 3ca50ec5-218d-44ad-8ffc-4318f54d7350 port 1e97124a-073a-4947-a6f2-359fb12ffe5e binding host dv-cinder-789564-2-iscsi {{(pid=99029) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 25 17:43:36.519818 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron_lib.callbacks.manager [None req-e4459660-3553-4992-9861-3d0f9342750a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99029) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:36.533745 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af4339cf-afd5-4728-9b72-9f73d35d175d req-c2f40dfe-dc7a-476a-b082-11124c83e3b8 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:36.535233 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-af4339cf-afd5-4728-9b72-9f73d35d175d req-c2f40dfe-dc7a-476a-b082-11124c83e3b8 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=78a85fac-d281-494d-90da-a47ddc8255e5 HTTP/1.1" status: 200  len: 945 time: 0.3050847
May 25 17:43:36.684576 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-af4339cf-afd5-4728-9b72-9f73d35d175d req-07e4ad8b-ab60-40f9-a51b-29eded2993cc tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1422944
May 25 17:43:36.836356 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 42384) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:43:36.978343 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-a3f3bae6-7223-452e-964d-6c9e1c8187ca admin admin] Notify callbacks [] for security_group, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:36.978343 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-a3f3bae6-7223-452e-964d-6c9e1c8187ca admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:43:36.978343 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-a3f3bae6-7223-452e-964d-6c9e1c8187ca admin admin] Usage tracker for resource:security_group_rule and tenant:b55799ee5e634454b3bc8be709f2329f is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:43:36.978343 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-a3f3bae6-7223-452e-964d-6c9e1c8187ca admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:43:36.978769 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron_lib.callbacks.manager [None req-e4459660-3553-4992-9861-3d0f9342750a None None] Notify callbacks [] for port, precommit_update {{(pid=99029) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:36.979775 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-a3f3bae6-7223-452e-964d-6c9e1c8187ca admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:43:36.980005 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.provisioning_blocks [None req-e4459660-3553-4992-9861-3d0f9342750a None None] Transition to ACTIVE for port object 1e97124a-073a-4947-a6f2-359fb12ffe5e will not be triggered until provisioned by entity L2. {{(pid=99029) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 17:43:36.981943 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-650f39c4-e288-4d9d-93fd-6eb70c75b81e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:37.032587 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-a3f3bae6-7223-452e-964d-6c9e1c8187ca admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:37.061408 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd13b54a-67f8-4e67-b944-ffcd5ef0064a req-1001b47a-6d20-4cb5-ac4e-203903f100b8 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:37.082438 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-dd13b54a-67f8-4e67-b944-ffcd5ef0064a req-1001b47a-6d20-4cb5-ac4e-203903f100b8 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/ports?device_id=ac0d5316-763a-434a-82ea-c3d559ad0984 HTTP/1.1" status: 200  len: 943 time: 0.1171088
May 25 17:43:37.118336 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-dd13b54a-67f8-4e67-b944-ffcd5ef0064a req-6711d7a0-1e0d-4354-b274-37e9599b1d8a tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/security-groups?id=dda11ec6-545c-479e-bba9-4390fea678fa&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0475729
May 25 17:43:37.151026 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device 20819f61-2e9b-4003-9d9f-151a9e6d2fd4 up at agent ovs-agent-dv-cinder-789564-2-iscsi {{(pid=99028) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 17:43:37.213542 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.db_base_plugin_common [None req-650f39c4-e288-4d9d-93fd-6eb70c75b81e admin admin] Allocated IP 172.20.0.1 (45b850af-d423-458a-855a-d7f828a11fff/704d0a85-ee4f-4df2-90a3-a525dfe28461/ada7bf8b-4ba6-4629-8693-a2574922e458) {{(pid=99026) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 17:43:37.223021 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Provisioning complete for port 20819f61-2e9b-4003-9d9f-151a9e6d2fd4 triggered by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 17:43:37.223474 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:37.240781 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron_lib.callbacks.manager [None req-e4459660-3553-4992-9861-3d0f9342750a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99029) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:37.246298 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:43:37.268485 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-a3f3bae6-7223-452e-964d-6c9e1c8187ca admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:37.281698 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-9247970c-f8a4-45e4-ba1a-15db8eddd80e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:43:37.342053 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dbeb910a-808d-4310-a1b7-0890a74557fc None None] Pushing event updated for resources: {'Port': ['ID=1e97124a-073a-4947-a6f2-359fb12ffe5e,revision_number=2']} {{(pid=99029) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:43:37.349644 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-a3f3bae6-7223-452e-964d-6c9e1c8187ca admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=b55799ee5e634454b3bc8be709f2329f&name=default HTTP/1.1" status: 200  len: 2979 time: 0.5114877
May 25 17:43:37.350983 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dbeb910a-808d-4310-a1b7-0890a74557fc None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99029) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:43:37.351510 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dbeb910a-808d-4310-a1b7-0890a74557fc None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99029) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:43:37.351669 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3f3bae6-7223-452e-964d-6c9e1c8187ca admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ecc676a9-b44f-487a-8b27-b72ed6ccc32f,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:43:37.352159 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dbeb910a-808d-4310-a1b7-0890a74557fc None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99029) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:43:37.352671 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dbeb910a-808d-4310-a1b7-0890a74557fc None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99029) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:43:37.353200 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dbeb910a-808d-4310-a1b7-0890a74557fc None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99029) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:43:37.353693 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dbeb910a-808d-4310-a1b7-0890a74557fc None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99029) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:43:37.354170 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dbeb910a-808d-4310-a1b7-0890a74557fc None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99029) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:43:37.354647 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dbeb910a-808d-4310-a1b7-0890a74557fc None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99029) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:43:37.355137 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dbeb910a-808d-4310-a1b7-0890a74557fc None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99029) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:43:37.355613 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dbeb910a-808d-4310-a1b7-0890a74557fc None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99029) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:43:37.356091 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dbeb910a-808d-4310-a1b7-0890a74557fc None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99029) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:43:37.356560 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dbeb910a-808d-4310-a1b7-0890a74557fc None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99029) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:43:37.362667 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG oslo_concurrency.lockutils [None req-dbeb910a-808d-4310-a1b7-0890a74557fc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.116s {{(pid=99029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:43:37.372912 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 42396) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:43:37.376275 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-650f39c4-e288-4d9d-93fd-6eb70c75b81e admin admin] Notify callbacks [] for port, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:37.384991 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.plugins.ml2.managers [None req-e4459660-3553-4992-9861-3d0f9342750a None None] Attempting to bind port 1e97124a-073a-4947-a6f2-359fb12ffe5e on host dv-cinder-789564-2-iscsi for vnic_type normal with profile  {{(pid=99029) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 17:43:37.385570 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.plugins.ml2.managers [None req-e4459660-3553-4992-9861-3d0f9342750a None None] Attempting to bind port 1e97124a-073a-4947-a6f2-359fb12ffe5e by drivers openvswitch,hyperv on host dv-cinder-789564-2-iscsi at level 0 using segments [{'id': '471771f9-c462-4865-800d-0d5029e9eb3e', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb'}] {{(pid=99029) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 17:43:37.386105 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e4459660-3553-4992-9861-3d0f9342750a None None] Attempting to bind port 1e97124a-073a-4947-a6f2-359fb12ffe5e on network eb7ec72b-a691-481b-8d7e-42c05e13a8cb {{(pid=99029) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 17:43:37.393528 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e4459660-3553-4992-9861-3d0f9342750a None None] Checking agent: {'id': '7bb67520-1e97-4ad9-9b97-101068bbe1a3', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-789564-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 17, 34, 21), 'started_at': datetime.datetime(2021, 5, 25, 17, 34, 51), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 17, 43, 21), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-789564-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=99029) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 17:43:37.393918 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e4459660-3553-4992-9861-3d0f9342750a None None] Checking segment: {'id': '471771f9-c462-4865-800d-0d5029e9eb3e', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=99029) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 17:43:37.394203 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-a3f3bae6-7223-452e-964d-6c9e1c8187ca admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:43:37.394668 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron_lib.callbacks.manager [None req-e4459660-3553-4992-9861-3d0f9342750a None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=99029) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:37.395225 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e4459660-3553-4992-9861-3d0f9342750a None None] Bound using segment: {'id': '471771f9-c462-4865-800d-0d5029e9eb3e', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb'} {{(pid=99029) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 17:43:37.395788 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.plugins.ml2.managers [None req-e4459660-3553-4992-9861-3d0f9342750a None None] Bound port: 1e97124a-073a-4947-a6f2-359fb12ffe5e, host: dv-cinder-789564-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '471771f9-c462-4865-800d-0d5029e9eb3e', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb'}}] {{(pid=99029) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 17:43:37.396339 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron_lib.callbacks.manager [None req-e4459660-3553-4992-9861-3d0f9342750a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99029) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:37.397152 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.provisioning_blocks [None req-650f39c4-e288-4d9d-93fd-6eb70c75b81e admin admin] Transition to ACTIVE for port object ada7bf8b-4ba6-4629-8693-a2574922e458 will not be triggered until provisioned by entity DHCP. {{(pid=99026) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 17:43:37.461964 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-80b3d489-d907-4da4-bb46-3c1019967bd6 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:37.482546 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.plugins.ml2.db [None req-e4459660-3553-4992-9861-3d0f9342750a None None] For port 1e97124a-073a-4947-a6f2-359fb12ffe5e, host dv-cinder-789564-2-iscsi, cleared binding levels {{(pid=99029) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 17:43:37.486383 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.plugins.ml2.db [None req-e4459660-3553-4992-9861-3d0f9342750a None None] For port 1e97124a-073a-4947-a6f2-359fb12ffe5e, host dv-cinder-789564-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=1e97124a-073a-4947-a6f2-359fb12ffe5e,segment=NetworkSegment(471771f9-c462-4865-800d-0d5029e9eb3e),segment_id=471771f9-c462-4865-800d-0d5029e9eb3e)] {{(pid=99029) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 17:43:37.495610 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-80b3d489-d907-4da4-bb46-3c1019967bd6 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:37.523440 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-650f39c4-e288-4d9d-93fd-6eb70c75b81e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781840788179', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15476536'] for port, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:37.528556 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:43:37.577975 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron_lib.callbacks.manager [None req-e4459660-3553-4992-9861-3d0f9342750a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99029) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:37.582921 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:43:37.594992 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-650f39c4-e288-4d9d-93fd-6eb70c75b81e admin admin] Network 45b850af-d423-458a-855a-d7f828a11fff is already hosted by enough agents. {{(pid=99026) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 17:43:37.597981 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.scheduler.base_scheduler [None req-650f39c4-e288-4d9d-93fd-6eb70c75b81e admin admin] Resources bound (agent type, host, resource id):  {{(pid=99026) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 17:43:37.600943 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.l3_dvrscheduler_db [None req-650f39c4-e288-4d9d-93fd-6eb70c75b81e admin admin] Received port after_create {{(pid=99026) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 17:43:37.635037 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-80b3d489-d907-4da4-bb46-3c1019967bd6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:37.642780 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-904e32c8-a8a4-4c07-995f-ee8fbea79424 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:43:37.653429 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-650f39c4-e288-4d9d-93fd-6eb70c75b81e admin admin] Pushing event updated for resources: {'Port': ['ID=ada7bf8b-4ba6-4629-8693-a2574922e458,revision_number=1']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:43:37.656552 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-650f39c4-e288-4d9d-93fd-6eb70c75b81e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.128s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:43:37.677794 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-80b3d489-d907-4da4-bb46-3c1019967bd6 admin admin] Notify callbacks [] for security_group, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:37.678159 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-650f39c4-e288-4d9d-93fd-6eb70c75b81e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-421008'] for router_interface, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:37.684059 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-80b3d489-d907-4da4-bb46-3c1019967bd6 admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/ecc676a9-b44f-487a-8b27-b72ed6ccc32f HTTP/1.1" status: 204  len: 168 time: 0.3137853
May 25 17:43:37.686118 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e4459660-3553-4992-9861-3d0f9342750a None None] Routers {'3ca50ec5-218d-44ad-8ffc-4318f54d7350'} bound to L3 agent in host dv-cinder-789564-2-iscsi {{(pid=99029) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 17:43:37.688194 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_hamode_db [None req-e4459660-3553-4992-9861-3d0f9342750a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcae718d670>, 'dv-cinder-789564-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-25T17:34:21Z,description=<?>,heartbeat_timestamp=2021-05-25T17:43:21Z,host='dv-cinder-789564-2-iscsi',id=eaeb6875-c4ed-43b6-8658-aa4e52324fdf,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T17:34:21Z,topic='l3_agent')) {'router_ids': ['3ca50ec5-218d-44ad-8ffc-4318f54d7350'], 'active': True} {{(pid=99029) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:43:37.689187 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80b3d489-d907-4da4-bb46-3c1019967bd6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ecc676a9-b44f-487a-8b27-b72ed6ccc32f,revision_number=None']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:43:37.700348 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-80b3d489-d907-4da4-bb46-3c1019967bd6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.057s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:43:37.826007 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dbeb910a-808d-4310-a1b7-0890a74557fc None None] Pushing event updated for resources: {'Port': ['ID=1e97124a-073a-4947-a6f2-359fb12ffe5e,revision_number=3']} {{(pid=99029) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:43:37.879904 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG oslo_concurrency.lockutils [None req-dbeb910a-808d-4310-a1b7-0890a74557fc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.296s {{(pid=99029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:43:37.926083 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_dvr_db [None req-e4459660-3553-4992-9861-3d0f9342750a None None] Set router 3ca50ec5-218d-44ad-8ffc-4318f54d7350 gateway port host: dv-cinder-789564-2-iscsi {{(pid=99029) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 17:43:37.970954 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-650f39c4-e288-4d9d-93fd-6eb70c75b81e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:37.989756 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4cddac81-4f2e-4cd9-a890-d68c0f063a85 req-efe08341-1a5d-475a-9c1f-21e7d0388f3c tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:37.991213 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-4cddac81-4f2e-4cd9-a890-d68c0f063a85 req-efe08341-1a5d-475a-9c1f-21e7d0388f3c tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=78a85fac-d281-494d-90da-a47ddc8255e5 HTTP/1.1" status: 200  len: 945 time: 0.1469078
May 25 17:43:38.039362 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-38ce4798-f7e3-482c-8e03-432738c8c760 None None] Provisioning for port ada7bf8b-4ba6-4629-8693-a2574922e458 completed by entity DHCP. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 17:43:38.046536 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-38ce4798-f7e3-482c-8e03-432738c8c760 None None] Provisioning complete for port ada7bf8b-4ba6-4629-8693-a2574922e458 triggered by entity DHCP. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 17:43:38.046922 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-38ce4798-f7e3-482c-8e03-432738c8c760 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:38.088324 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-4cddac81-4f2e-4cd9-a890-d68c0f063a85 req-c973b9a9-5b9d-41a7-9e0f-ebe2091746c3 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0914159
May 25 17:43:38.119224 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.plugin [None req-38ce4798-f7e3-482c-8e03-432738c8c760 None None] Port ada7bf8b-4ba6-4629-8693-a2574922e458 cannot update to ACTIVE because it is not bound. {{(pid=99028) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 25 17:43:38.245840 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_hamode_db [None req-e4459660-3553-4992-9861-3d0f9342750a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcae718d670>, [{'id': '3ca50ec5-218d-44ad-8ffc-4318f54d7350', 'name': 'tempest-AttachVolumeShelveTestJSON-2113890446-router', 'tenant_id': 'cf02997eda314aee8fb322add2fbb921', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.226'}], 'enable_snat': True}, 'gw_port_id': '1e97124a-073a-4947-a6f2-359fb12ffe5e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:43:31Z', 'updated_at': '2021-05-25T17:43:34Z', 'revision_number': 3, 'project_id': 'cf02997eda314aee8fb322add2fbb921', 'gw_port': {'id': '1e97124a-073a-4947-a6f2-359fb12ffe5e', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:c8:ed:c5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3ca50ec5-218d-44ad-8ffc-4318f54d7350', 'device_owner': 'network:router_gateway', 'standard_attr_id': 244, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.226', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:43:33Z', 'updated_at': '2021-05-25T17:43:37Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi'}], 'dv-cinder-789564-2-iscsi', False) {} {{(pid=99029) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:43:38.252469 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e4459660-3553-4992-9861-3d0f9342750a None None] The sync data for ids ['3ca50ec5-218d-44ad-8ffc-4318f54d7350'] in dv-cinder-789564-2-iscsi is: [{'id': '3ca50ec5-218d-44ad-8ffc-4318f54d7350', 'name': 'tempest-AttachVolumeShelveTestJSON-2113890446-router', 'tenant_id': 'cf02997eda314aee8fb322add2fbb921', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.226'}], 'enable_snat': True}, 'gw_port_id': '1e97124a-073a-4947-a6f2-359fb12ffe5e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:43:31Z', 'updated_at': '2021-05-25T17:43:34Z', 'revision_number': 3, 'project_id': 'cf02997eda314aee8fb322add2fbb921', 'gw_port': {'id': '1e97124a-073a-4947-a6f2-359fb12ffe5e', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:c8:ed:c5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3ca50ec5-218d-44ad-8ffc-4318f54d7350', 'device_owner': 'network:router_gateway', 'standard_attr_id': 244, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.226', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:43:33Z', 'updated_at': '2021-05-25T17:43:37Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi'}] {{(pid=99029) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 25 17:43:38.300908 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Device cd9e7667-ca15-4541-9b3a-687f6f585523 details requested by agent hyperv_hv-cinder-78956 with host hv-cinder-78956 {{(pid=99028) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 25 17:43:38.493654 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] For port cd9e7667-ca15-4541-9b3a-687f6f585523, host hv-cinder-78956, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=cd9e7667-ca15-4541-9b3a-687f6f585523,segment=NetworkSegment(87df170f-54cc-461b-a7ac-79e125fc526b),segment_id=87df170f-54cc-461b-a7ac-79e125fc526b)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:43:38.500523 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-650f39c4-e288-4d9d-93fd-6eb70c75b81e admin admin] Notify callbacks [] for port, precommit_update {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:38.509711 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Returning: {'device': 'cd9e7667-ca15-4541-9b3a-687f6f585523', 'network_id': '6c7eca3b-72f3-4ba8-9e95-614d64496512', 'port_id': 'cd9e7667-ca15-4541-9b3a-687f6f585523', 'mac_address': 'fa:16:3e:77:00:84', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1304, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '279772c8-d366-4fc6-9c34-e6ddf99b5e08', 'ip_address': '172.20.0.2'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=99028) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 25 17:43:38.513727 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-de36a2e0-d849-4626-afa9-a9fe99e955e4 req-37e6301d-13e8-4ed6-8506-7fca29e59f9c service neutron] 10.222.0.125 "GET /v2.0/ports?device_id=3fb3211e-48f5-46f5-8035-ddbc35109aa8&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.1583889
May 25 17:43:38.522991 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62a2de37-5f41-40db-80bb-8c479fb17e01 req-a29f239a-7925-4a47-8542-4fabbafd5234 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:38.560169 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-62a2de37-5f41-40db-80bb-8c479fb17e01 req-a29f239a-7925-4a47-8542-4fabbafd5234 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/ports?device_id=ac0d5316-763a-434a-82ea-c3d559ad0984 HTTP/1.1" status: 200  len: 943 time: 0.2605965
May 25 17:43:38.616092 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-650f39c4-e288-4d9d-93fd-6eb70c75b81e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15476529'] for port, after_update {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:38.655570 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-20656e40-86f4-4c3e-85c5-439b64c63cce admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:43:38.683475 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:38.704992 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.notifiers.nova [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id cd9e7667-ca15-4541-9b3a-687f6f585523 {{(pid=99028) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 25 17:43:38.731101 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 42426) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:43:38.748305 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] For port cd9e7667-ca15-4541-9b3a-687f6f585523, host hv-cinder-78956, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=cd9e7667-ca15-4541-9b3a-687f6f585523,segment=NetworkSegment(87df170f-54cc-461b-a7ac-79e125fc526b),segment_id=87df170f-54cc-461b-a7ac-79e125fc526b)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:43:38.772569 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-6d079018-ef7c-4a54-93a5-899a525ac57e admin admin] Notify callbacks [] for security_group, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:38.799651 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-6d079018-ef7c-4a54-93a5-899a525ac57e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:43:38.806951 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-6d079018-ef7c-4a54-93a5-899a525ac57e admin admin] Usage tracker for resource:security_group_rule and tenant:10ee3c71bf894f858b266f8228c35c11 is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:43:38.811869 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-6d079018-ef7c-4a54-93a5-899a525ac57e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:43:38.820715 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-6d079018-ef7c-4a54-93a5-899a525ac57e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:43:38.821827 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-62a2de37-5f41-40db-80bb-8c479fb17e01 req-fcadb7cf-feda-4071-8df9-ce4192200246 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/security-groups?id=dda11ec6-545c-479e-bba9-4390fea678fa&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2603881
May 25 17:43:38.868715 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-650f39c4-e288-4d9d-93fd-6eb70c75b81e admin admin] Pushing event updated for resources: {'Port': ['ID=ada7bf8b-4ba6-4629-8693-a2574922e458,revision_number=2']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:43:38.878922 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-650f39c4-e288-4d9d-93fd-6eb70c75b81e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.223s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:43:38.880591 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-650f39c4-e288-4d9d-93fd-6eb70c75b81e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-549394', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-420925'] for router_interface, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:38.909776 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:38.911146 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:43:38.940174 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-6d079018-ef7c-4a54-93a5-899a525ac57e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:38.987313 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de36a2e0-d849-4626-afa9-a9fe99e955e4 req-1731f26a-5c14-48fe-b1fc-ba745ca4c9bc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:38.988962 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-de36a2e0-d849-4626-afa9-a9fe99e955e4 req-1731f26a-5c14-48fe-b1fc-ba745ca4c9bc service neutron] 10.222.0.125 "GET /v2.0/ports?tenant_id=5ae575cfd07c4a88aa626c15e6bccfd9&device_id=3fb3211e-48f5-46f5-8035-ddbc35109aa8 HTTP/1.1" status: 200  len: 1099 time: 0.2892945
May 25 17:43:39.011736 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Pushing event updated for resources: {'Port': ['ID=cd9e7667-ca15-4541-9b3a-687f6f585523,revision_number=4']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:43:39.015159 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.104s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:43:39.023386 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-6d079018-ef7c-4a54-93a5-899a525ac57e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:39.033427 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-30ba8546-17e0-4e14-90a3-ab9c7e1764d0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:43:39.081787 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-6d079018-ef7c-4a54-93a5-899a525ac57e admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=10ee3c71bf894f858b266f8228c35c11&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3484938
May 25 17:43:39.089144 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 42438) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:43:39.144932 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d079018-ef7c-4a54-93a5-899a525ac57e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ba5cbc34-1ae8-4871-93d2-b909a98289d6,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:43:39.159961 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] get_ports_and_sgs() called for port_ids ['cd9e7667-ca15-4541-9b3a-687f6f585523'] {{(pid=99028) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 25 17:43:39.165625 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-6d079018-ef7c-4a54-93a5-899a525ac57e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.132s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:43:39.175788 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-650f39c4-e288-4d9d-93fd-6eb70c75b81e admin admin] Network 45b850af-d423-458a-855a-d7f828a11fff is already hosted by enough agents. {{(pid=99026) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 17:43:39.179516 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.scheduler.base_scheduler [None req-650f39c4-e288-4d9d-93fd-6eb70c75b81e admin admin] Resources bound (agent type, host, resource id):  {{(pid=99026) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 17:43:39.220732 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-38b5192d-bdcd-44a9-afd5-f49fcdd0ff8e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:39.276560 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device 1e97124a-073a-4947-a6f2-359fb12ffe5e up at agent ovs-agent-dv-cinder-789564-2-iscsi {{(pid=99028) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 17:43:39.305943 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-38b5192d-bdcd-44a9-afd5-f49fcdd0ff8e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:39.339831 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de36a2e0-d849-4626-afa9-a9fe99e955e4 req-5ec94606-a69c-417e-a41e-d7a7fc1d9a72 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:39.341792 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-de36a2e0-d849-4626-afa9-a9fe99e955e4 req-5ec94606-a69c-417e-a41e-d7a7fc1d9a72 service neutron] 10.222.0.125 "GET /v2.0/networks?id=6c7eca3b-72f3-4ba8-9e95-614d64496512 HTTP/1.1" status: 200  len: 916 time: 0.3186610
May 25 17:43:39.481388 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3192dca-ab0f-47b2-8d4f-cd816d12cc88 req-41dac15b-c37b-4d2f-9562-04733d5e2f34 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:39.482874 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-b3192dca-ab0f-47b2-8d4f-cd816d12cc88 req-41dac15b-c37b-4d2f-9562-04733d5e2f34 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=78a85fac-d281-494d-90da-a47ddc8255e5 HTTP/1.1" status: 200  len: 945 time: 0.1319230
May 25 17:43:39.497691 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Provisioning for port 1e97124a-073a-4947-a6f2-359fb12ffe5e completed by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 17:43:39.512268 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Provisioning complete for port 1e97124a-073a-4947-a6f2-359fb12ffe5e triggered by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 17:43:39.512268 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:39.556675 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-b3192dca-ab0f-47b2-8d4f-cd816d12cc88 req-d6820448-89fa-40e2-bede-1dc123cd7950 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0598533
May 25 17:43:39.593539 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-38b5192d-bdcd-44a9-afd5-f49fcdd0ff8e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:39.598017 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-dffe99da-4bc8-4410-a840-c8c275c4854d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:43:39.613746 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-de36a2e0-d849-4626-afa9-a9fe99e955e4 req-236cbbaf-e5fd-4037-9389-435d13f3a7d8 service neutron] 10.222.0.125 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=4698ed19-7e41-4457-a1fd-16d5f606084a HTTP/1.1" status: 200  len: 217 time: 0.1699464
May 25 17:43:39.626194 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38b5192d-bdcd-44a9-afd5-f49fcdd0ff8e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ba5cbc34-1ae8-4871-93d2-b909a98289d6,revision_number=None']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:43:39.628474 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-38b5192d-bdcd-44a9-afd5-f49fcdd0ff8e admin admin] Notify callbacks [] for security_group, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:39.630731 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-38b5192d-bdcd-44a9-afd5-f49fcdd0ff8e admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/ba5cbc34-1ae8-4871-93d2-b909a98289d6 HTTP/1.1" status: 204  len: 168 time: 0.5394204
May 25 17:43:39.633553 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-38b5192d-bdcd-44a9-afd5-f49fcdd0ff8e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.036s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:43:39.717028 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 42452) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:43:39.720673 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-650f39c4-e288-4d9d-93fd-6eb70c75b81e admin admin] Router 3ca50ec5-218d-44ad-8ffc-4318f54d7350 has already been hosted by L3 agent eaeb6875-c4ed-43b6-8658-aa4e52324fdf {{(pid=99026) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 25 17:43:39.728114 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-b0544bbe-97b1-4b62-90df-cc8046848da7 None None] Provisioning complete for port ada7bf8b-4ba6-4629-8693-a2574922e458 triggered by entity DHCP. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 17:43:39.728490 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-b0544bbe-97b1-4b62-90df-cc8046848da7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:39.729528 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de36a2e0-d849-4626-afa9-a9fe99e955e4 req-5589f0dc-8788-47a0-afe2-77a1f3d95e6c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:39.731164 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-de36a2e0-d849-4626-afa9-a9fe99e955e4 req-5589f0dc-8788-47a0-afe2-77a1f3d95e6c service neutron] 10.222.0.125 "GET /v2.0/subnets?id=279772c8-d366-4fc6-9c34-e6ddf99b5e08 HTTP/1.1" status: 200  len: 854 time: 0.1118295
May 25 17:43:39.857332 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-de36a2e0-d849-4626-afa9-a9fe99e955e4 req-dc98826a-50f6-4681-8c90-1c80c458c6cc service neutron] 10.222.0.125 "GET /v2.0/ports?network_id=6c7eca3b-72f3-4ba8-9e95-614d64496512&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.1152573
May 25 17:43:39.877720 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.plugin [None req-b0544bbe-97b1-4b62-90df-cc8046848da7 None None] Port ada7bf8b-4ba6-4629-8693-a2574922e458 cannot update to ACTIVE because it is not bound. {{(pid=99028) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 25 17:43:39.887717 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:39.936661 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] For port 1e97124a-073a-4947-a6f2-359fb12ffe5e, host dv-cinder-789564-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=1e97124a-073a-4947-a6f2-359fb12ffe5e,segment=NetworkSegment(471771f9-c462-4865-800d-0d5029e9eb3e),segment_id=471771f9-c462-4865-800d-0d5029e9eb3e)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:43:40.006333 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:40.011095 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:43:40.104632 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b6a5988-0822-4fdd-aae4-bb6df4ffe7aa req-e282f06e-2909-4694-9e4a-3953d9d16837 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:40.115677 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-5b6a5988-0822-4fdd-aae4-bb6df4ffe7aa req-e282f06e-2909-4694-9e4a-3953d9d16837 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/ports?device_id=ac0d5316-763a-434a-82ea-c3d559ad0984 HTTP/1.1" status: 200  len: 944 time: 0.1169968
May 25 17:43:40.171152 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Pushing event updated for resources: {'Port': ['ID=1e97124a-073a-4947-a6f2-359fb12ffe5e,revision_number=4']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:43:40.178534 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-5b6a5988-0822-4fdd-aae4-bb6df4ffe7aa req-6d98d62c-ba7c-4617-aa0b-c1e94570d7a5 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/security-groups?id=dda11ec6-545c-479e-bba9-4390fea678fa&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0545099
May 25 17:43:40.184259 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.176s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:43:40.298285 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-41c29a59-f6f8-424b-a235-908009210219 admin admin] Notify callbacks [] for security_group, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:40.347633 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-41c29a59-f6f8-424b-a235-908009210219 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:43:40.352026 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-de36a2e0-d849-4626-afa9-a9fe99e955e4 req-63c376af-7042-4249-9ac6-56b541319a4e service neutron] 10.222.0.125 "GET /v2.0/networks/6c7eca3b-72f3-4ba8-9e95-614d64496512?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.4681046
May 25 17:43:40.359536 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-41c29a59-f6f8-424b-a235-908009210219 admin admin] Usage tracker for resource:security_group_rule and tenant:a01beaf044f440bfb714b84d1ff6b949 is out of sync, need to count used quota {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:43:40.397175 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-41c29a59-f6f8-424b-a235-908009210219 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:43:40.550405 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-650f39c4-e288-4d9d-93fd-6eb70c75b81e admin admin] Notify agent at l3_agent.dv-cinder-789564-2-iscsi the message routers_updated {{(pid=99026) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 25 17:43:40.561879 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e581c549-a4d6-4951-bc04-c9f40a1cf5c3 None None] Sync routers for ids ['3ca50ec5-218d-44ad-8ffc-4318f54d7350'] in dv-cinder-789564-2-iscsi {{(pid=99028) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 25 17:43:40.582298 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-41c29a59-f6f8-424b-a235-908009210219 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:43:40.582799 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e581c549-a4d6-4951-bc04-c9f40a1cf5c3 None None] Routers {'3ca50ec5-218d-44ad-8ffc-4318f54d7350'} bound to L3 agent in host dv-cinder-789564-2-iscsi {{(pid=99028) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 17:43:40.584510 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-e581c549-a4d6-4951-bc04-c9f40a1cf5c3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcae7167a30>, 'dv-cinder-789564-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-25T17:34:21Z,description=<?>,heartbeat_timestamp=2021-05-25T17:43:21Z,host='dv-cinder-789564-2-iscsi',id=eaeb6875-c4ed-43b6-8658-aa4e52324fdf,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T17:34:21Z,topic='l3_agent')) {'router_ids': ['3ca50ec5-218d-44ad-8ffc-4318f54d7350'], 'active': True} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:43:40.609195 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-650f39c4-e288-4d9d-93fd-6eb70c75b81e admin admin] 10.222.0.122 "PUT /v2.0/routers/3ca50ec5-218d-44ad-8ffc-4318f54d7350/add_router_interface HTTP/1.1" status: 200  len: 503 time: 4.6549065
May 25 17:43:40.732916 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-de36a2e0-d849-4626-afa9-a9fe99e955e4 req-78fb7536-ba78-48b9-94a4-1ef6e96d9e49 service neutron] 10.222.0.125 "GET /v2.0/networks/6c7eca3b-72f3-4ba8-9e95-614d64496512?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3700452
May 25 17:43:40.974929 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvr_db [None req-e581c549-a4d6-4951-bc04-c9f40a1cf5c3 None None] Set router 3ca50ec5-218d-44ad-8ffc-4318f54d7350 gateway port host: dv-cinder-789564-2-iscsi {{(pid=99028) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 17:43:41.009457 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-41c29a59-f6f8-424b-a235-908009210219 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:41.107330 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89967b36-e475-4164-9196-8905e41f0b7d req-58307e3b-73e0-4424-ad8a-b7e30e5c2aa0 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:41.116869 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-89967b36-e475-4164-9196-8905e41f0b7d req-58307e3b-73e0-4424-ad8a-b7e30e5c2aa0 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=78a85fac-d281-494d-90da-a47ddc8255e5 HTTP/1.1" status: 200  len: 945 time: 0.2987590
May 25 17:43:41.146290 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-41c29a59-f6f8-424b-a235-908009210219 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:41.158861 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:43:41.203918 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41c29a59-f6f8-424b-a235-908009210219 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1830aa3c-84ca-4e73-8ad9-761f579134a7,revision_number=1']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:43:41.225699 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-41c29a59-f6f8-424b-a235-908009210219 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.067s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:43:41.245668 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device 1e97124a-073a-4947-a6f2-359fb12ffe5e up at agent ovs-agent-dv-cinder-789564-2-iscsi {{(pid=99028) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 17:43:41.248140 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-89967b36-e475-4164-9196-8905e41f0b7d req-92cc9d7e-48f0-470a-af92-ee304b56f59c tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1300428
May 25 17:43:41.253008 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-41c29a59-f6f8-424b-a235-908009210219 admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=a01beaf044f440bfb714b84d1ff6b949&name=default HTTP/1.1" status: 200  len: 2979 time: 1.5324490
May 25 17:43:41.253324 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 42512) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:43:41.356769 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-d41a9d13-9f9b-43d8-8608-fe13e42c9a84 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:41.442826 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-d41a9d13-9f9b-43d8-8608-fe13e42c9a84 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:41.505655 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 42522) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:43:41.511225 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6995b692-c8c1-405c-b531-74f100320038 req-927b7907-27a2-42f3-848b-7c3b804bfa2c tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:41.511826 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.v2.base [None req-806ba3ad-b912-4756-928f-2bf35c911b01 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Request body: {'security_group': {'name': 'tempest-securitygroup--530386844', 'description': 'tempest-description--1288383438'}} {{(pid=99027) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:43:41.512761 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-6995b692-c8c1-405c-b531-74f100320038 req-927b7907-27a2-42f3-848b-7c3b804bfa2c tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/ports?device_id=ac0d5316-763a-434a-82ea-c3d559ad0984 HTTP/1.1" status: 200  len: 944 time: 0.1295121
May 25 17:43:41.530480 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-806ba3ad-b912-4756-928f-2bf35c911b01 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:43:41.534491 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-806ba3ad-b912-4756-928f-2bf35c911b01 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Usage tracker for resource:security_group and tenant:cf02997eda314aee8fb322add2fbb921 is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:43:41.537996 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-806ba3ad-b912-4756-928f-2bf35c911b01 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:43:41.544711 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-806ba3ad-b912-4756-928f-2bf35c911b01 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:43:41.553902 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Provisioning complete for port 1e97124a-073a-4947-a6f2-359fb12ffe5e triggered by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 17:43:41.554278 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:41.584342 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-6995b692-c8c1-405c-b531-74f100320038 req-d947296a-5dc0-4133-bec4-d37663e010d9 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/security-groups?id=dda11ec6-545c-479e-bba9-4390fea678fa&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0610576
May 25 17:43:41.595019 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:41.608282 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-d41a9d13-9f9b-43d8-8608-fe13e42c9a84 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:41.616258 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-e3c54091-5fb0-4105-a346-c62905bdbacd admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:43:41.634995 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-806ba3ad-b912-4756-928f-2bf35c911b01 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify callbacks [] for security_group, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:41.642057 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d41a9d13-9f9b-43d8-8608-fe13e42c9a84 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1830aa3c-84ca-4e73-8ad9-761f579134a7,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:43:41.653733 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-d41a9d13-9f9b-43d8-8608-fe13e42c9a84 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.037s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:43:41.658241 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-d41a9d13-9f9b-43d8-8608-fe13e42c9a84 admin admin] Notify callbacks [] for security_group, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:41.658383 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-806ba3ad-b912-4756-928f-2bf35c911b01 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:43:41.662435 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-d41a9d13-9f9b-43d8-8608-fe13e42c9a84 admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/1830aa3c-84ca-4e73-8ad9-761f579134a7 HTTP/1.1" status: 204  len: 168 time: 0.4082279
May 25 17:43:41.681251 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-806ba3ad-b912-4756-928f-2bf35c911b01 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Usage tracker for resource:security_group_rule and tenant:cf02997eda314aee8fb322add2fbb921 is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:43:41.686030 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-806ba3ad-b912-4756-928f-2bf35c911b01 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:43:41.705706 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-806ba3ad-b912-4756-928f-2bf35c911b01 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:43:41.721719 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-e581c549-a4d6-4951-bc04-c9f40a1cf5c3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcae7167a30>, [{'id': '3ca50ec5-218d-44ad-8ffc-4318f54d7350', 'name': 'tempest-AttachVolumeShelveTestJSON-2113890446-router', 'tenant_id': 'cf02997eda314aee8fb322add2fbb921', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.226'}], 'enable_snat': True}, 'gw_port_id': '1e97124a-073a-4947-a6f2-359fb12ffe5e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:43:31Z', 'updated_at': '2021-05-25T17:43:37Z', 'revision_number': 4, 'project_id': 'cf02997eda314aee8fb322add2fbb921', 'gw_port': {'id': '1e97124a-073a-4947-a6f2-359fb12ffe5e', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:c8:ed:c5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3ca50ec5-218d-44ad-8ffc-4318f54d7350', 'device_owner': 'network:router_gateway', 'standard_attr_id': 244, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.226', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:43:33Z', 'updated_at': '2021-05-25T17:43:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi', '_interfaces': [{'id': 'ada7bf8b-4ba6-4629-8693-a2574922e458', 'name': '', 'network_id': '45b850af-d423-458a-855a-d7f828a11fff', 'tenant_id': 'cf02997eda314aee8fb322add2fbb921', 'mac_address': 'fa:16:3e:59:34:b7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3ca50ec5-218d-44ad-8ffc-4318f54d7350', 'device_owner': 'network:router_interface', 'standard_attr_id': 255, 'fixed_ips': [{'subnet_id': '704d0a85-ee4f-4df2-90a3-a525dfe28461', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:43:37Z', 'updated_at': '2021-05-25T17:43:38Z', 'revision_number': 2, 'project_id': 'cf02997eda314aee8fb322add2fbb921', 'subnets': [{'id': '704d0a85-ee4f-4df2-90a3-a525dfe28461', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-789564-2-iscsi', False) {} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:43:41.726293 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e581c549-a4d6-4951-bc04-c9f40a1cf5c3 None None] Checking router: 3ca50ec5-218d-44ad-8ffc-4318f54d7350 for host: dv-cinder-789564-2-iscsi {{(pid=99028) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 25 17:43:41.726653 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e581c549-a4d6-4951-bc04-c9f40a1cf5c3 None None] Updating router 3ca50ec5-218d-44ad-8ffc-4318f54d7350 port ada7bf8b-4ba6-4629-8693-a2574922e458 binding host dv-cinder-789564-2-iscsi {{(pid=99028) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 25 17:43:41.785987 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-e581c549-a4d6-4951-bc04-c9f40a1cf5c3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:41.812913 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-806ba3ad-b912-4756-928f-2bf35c911b01 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify callbacks [] for security_group, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:41.881033 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-806ba3ad-b912-4756-928f-2bf35c911b01 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:41.886549 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-6d079018-ef7c-4a54-93a5-899a525ac57e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:43:41.919540 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-806ba3ad-b912-4756-928f-2bf35c911b01 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Pushing event updated for resources: {'SecurityGroup': ['ID=fa654e78-f61f-461b-b301-3690d1826946,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:43:41.934476 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-806ba3ad-b912-4756-928f-2bf35c911b01 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:43:41.988951 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-806ba3ad-b912-4756-928f-2bf35c911b01 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify callbacks [] for security_group, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:41.990916 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-806ba3ad-b912-4756-928f-2bf35c911b01 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.122 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1779 time: 0.4835801
May 25 17:43:41.994033 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 42540) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:43:42.001606 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.v2.base [None req-8ef1d05f-f6d8-41f9-92a6-51a6f3abd183 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Request body: {'security_group_rule': {'security_group_id': 'fa654e78-f61f-461b-b301-3690d1826946', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=99027) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:43:42.008418 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-8ef1d05f-f6d8-41f9-92a6-51a6f3abd183 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:43:42.013322 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-8ef1d05f-f6d8-41f9-92a6-51a6f3abd183 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Usage tracker for resource:security_group_rule and tenant:cf02997eda314aee8fb322add2fbb921 is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:43:42.017425 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-8ef1d05f-f6d8-41f9-92a6-51a6f3abd183 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:43:42.023795 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-8ef1d05f-f6d8-41f9-92a6-51a6f3abd183 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:43:42.137776 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-8ef1d05f-f6d8-41f9-92a6-51a6f3abd183 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify callbacks [] for security_group_rule, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:42.164678 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Device cd9e7667-ca15-4541-9b3a-687f6f585523 up at agent hyperv_hv-cinder-78956 {{(pid=99028) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 17:43:42.216048 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-8ef1d05f-f6d8-41f9-92a6-51a6f3abd183 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:42.293520 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-e581c549-a4d6-4951-bc04-c9f40a1cf5c3 None None] Notify callbacks [] for port, precommit_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:42.308292 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-e581c549-a4d6-4951-bc04-c9f40a1cf5c3 None None] Transition to ACTIVE for port object ada7bf8b-4ba6-4629-8693-a2574922e458 will not be triggered until provisioned by entity L2. {{(pid=99028) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 17:43:42.308771 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-8ef1d05f-f6d8-41f9-92a6-51a6f3abd183 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459369'] for security_group_rule, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:42.311507 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:43:42.330801 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ef1d05f-f6d8-41f9-92a6-51a6f3abd183 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=dab78c58-25d3-4be9-886f-58ddd1ace7d6,revision_number=0']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:43:42.341886 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-8ef1d05f-f6d8-41f9-92a6-51a6f3abd183 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:43:42.383045 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Provisioning for port cd9e7667-ca15-4541-9b3a-687f6f585523 completed by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 17:43:42.386414 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-e581c549-a4d6-4951-bc04-c9f40a1cf5c3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:42.393359 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:43:42.444059 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Provisioning complete for port cd9e7667-ca15-4541-9b3a-687f6f585523 triggered by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 17:43:42.444449 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:42.445722 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-8ef1d05f-f6d8-41f9-92a6-51a6f3abd183 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify callbacks [] for security_group_rule, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:42.447276 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-8ef1d05f-f6d8-41f9-92a6-51a6f3abd183 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.122 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 0.4519379
May 25 17:43:42.449755 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 42556) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:43:42.456560 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.v2.base [None req-0a6a4bbc-e1a1-4a3a-8fcb-f91fdd525edc tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Request body: {'security_group_rule': {'security_group_id': 'fa654e78-f61f-461b-b301-3690d1826946', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=99027) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:43:42.458640 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3f8222f-9f09-4b81-8d30-87a7598c3799 req-3e1f929b-c00f-4555-bd84-bdf175c20128 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:42.460211 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-e3f8222f-9f09-4b81-8d30-87a7598c3799 req-3e1f929b-c00f-4555-bd84-bdf175c20128 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=78a85fac-d281-494d-90da-a47ddc8255e5 HTTP/1.1" status: 200  len: 945 time: 0.0875876
May 25 17:43:42.470274 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-0a6a4bbc-e1a1-4a3a-8fcb-f91fdd525edc tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:43:42.476621 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-0a6a4bbc-e1a1-4a3a-8fcb-f91fdd525edc tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Usage tracker for resource:security_group_rule and tenant:cf02997eda314aee8fb322add2fbb921 is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:43:42.480805 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-0a6a4bbc-e1a1-4a3a-8fcb-f91fdd525edc tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:43:42.487410 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-0a6a4bbc-e1a1-4a3a-8fcb-f91fdd525edc tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:43:42.516109 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-e3f8222f-9f09-4b81-8d30-87a7598c3799 req-9334a217-df72-420c-a81a-036abba10e93 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0488963
May 25 17:43:42.532641 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 42560) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:43:42.554398 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-a61f25df-84a2-440b-822d-639601627753 admin admin] Notify callbacks [] for security_group, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:42.570996 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-a61f25df-84a2-440b-822d-639601627753 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:43:42.575107 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-a61f25df-84a2-440b-822d-639601627753 admin admin] Usage tracker for resource:security_group_rule and tenant:8a05968ab280442c9a3fefe875828054 is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:43:42.578065 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-a61f25df-84a2-440b-822d-639601627753 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:43:42.579340 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09f76bfc-ecac-4cd4-80fa-1e2d2668d569 None None] Pushing event updated for resources: {'Port': ['ID=ada7bf8b-4ba6-4629-8693-a2574922e458,revision_number=3']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:43:42.586291 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-a61f25df-84a2-440b-822d-639601627753 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:43:42.607619 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-09f76bfc-ecac-4cd4-80fa-1e2d2668d569 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.215s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:43:42.626350 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-0a6a4bbc-e1a1-4a3a-8fcb-f91fdd525edc tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify callbacks [] for security_group_rule, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:42.713892 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-0a6a4bbc-e1a1-4a3a-8fcb-f91fdd525edc tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:42.726399 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.managers [None req-e581c549-a4d6-4951-bc04-c9f40a1cf5c3 None None] Attempting to bind port ada7bf8b-4ba6-4629-8693-a2574922e458 on host dv-cinder-789564-2-iscsi for vnic_type normal with profile  {{(pid=99028) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 17:43:42.726784 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.managers [None req-e581c549-a4d6-4951-bc04-c9f40a1cf5c3 None None] Attempting to bind port ada7bf8b-4ba6-4629-8693-a2574922e458 by drivers openvswitch,hyperv on host dv-cinder-789564-2-iscsi at level 0 using segments [{'id': 'e9a4953c-bd2f-4412-9030-8eb2cd20f5c5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1318, 'network_id': '45b850af-d423-458a-855a-d7f828a11fff'}] {{(pid=99028) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 17:43:42.727162 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e581c549-a4d6-4951-bc04-c9f40a1cf5c3 None None] Attempting to bind port ada7bf8b-4ba6-4629-8693-a2574922e458 on network 45b850af-d423-458a-855a-d7f828a11fff {{(pid=99028) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 17:43:42.742882 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e581c549-a4d6-4951-bc04-c9f40a1cf5c3 None None] Checking agent: {'id': '7bb67520-1e97-4ad9-9b97-101068bbe1a3', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-789564-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 17, 34, 21), 'started_at': datetime.datetime(2021, 5, 25, 17, 34, 51), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 17, 43, 21), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-789564-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=99028) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 17:43:42.743264 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e581c549-a4d6-4951-bc04-c9f40a1cf5c3 None None] Checking segment: {'id': 'e9a4953c-bd2f-4412-9030-8eb2cd20f5c5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1318, 'network_id': '45b850af-d423-458a-855a-d7f828a11fff'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=99028) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 17:43:42.743680 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-e581c549-a4d6-4951-bc04-c9f40a1cf5c3 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:42.744079 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e581c549-a4d6-4951-bc04-c9f40a1cf5c3 None None] Bound using segment: {'id': 'e9a4953c-bd2f-4412-9030-8eb2cd20f5c5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1318, 'network_id': '45b850af-d423-458a-855a-d7f828a11fff'} {{(pid=99028) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 17:43:42.744567 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.managers [None req-e581c549-a4d6-4951-bc04-c9f40a1cf5c3 None None] Bound port: ada7bf8b-4ba6-4629-8693-a2574922e458, host: dv-cinder-789564-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e9a4953c-bd2f-4412-9030-8eb2cd20f5c5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1318, 'network_id': '45b850af-d423-458a-855a-d7f828a11fff'}}] {{(pid=99028) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 17:43:42.744939 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-e581c549-a4d6-4951-bc04-c9f40a1cf5c3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:42.805254 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-0a6a4bbc-e1a1-4a3a-8fcb-f91fdd525edc tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459369'] for security_group_rule, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:42.813515 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:42.850239 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-70e711d7-5e4a-4e3d-b90a-9a765026fc1e tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:43:42.869459 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ac0d5316-763a-434a-82ea-c3d559ad0984', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'cd9e7667-ca15-4541-9b3a-687f6f585523'}] {{(pid=99028) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 17:43:42.878969 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a6a4bbc-e1a1-4a3a-8fcb-f91fdd525edc tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d34a03c0-f13f-44c8-95d0-ca4f15bc204e,revision_number=0']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:43:42.884510 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-0a6a4bbc-e1a1-4a3a-8fcb-f91fdd525edc tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.036s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:43:42.888951 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-a61f25df-84a2-440b-822d-639601627753 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:42.895855 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbe1fcfa-82f1-4d10-b0fd-3827e4507f7e req-83a88291-16de-4386-b675-87534392c5f1 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:42.898315 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-bbe1fcfa-82f1-4d10-b0fd-3827e4507f7e req-83a88291-16de-4386-b675-87534392c5f1 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/ports?device_id=ac0d5316-763a-434a-82ea-c3d559ad0984 HTTP/1.1" status: 200  len: 944 time: 0.1597440
May 25 17:43:42.902776 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] For port cd9e7667-ca15-4541-9b3a-687f6f585523, host hv-cinder-78956, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=cd9e7667-ca15-4541-9b3a-687f6f585523,segment=NetworkSegment(87df170f-54cc-461b-a7ac-79e125fc526b),segment_id=87df170f-54cc-461b-a7ac-79e125fc526b)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:43:42.908762 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-e581c549-a4d6-4951-bc04-c9f40a1cf5c3 None None] For port ada7bf8b-4ba6-4629-8693-a2574922e458, host dv-cinder-789564-2-iscsi, cleared binding levels {{(pid=99028) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 17:43:42.912760 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-e581c549-a4d6-4951-bc04-c9f40a1cf5c3 None None] For port ada7bf8b-4ba6-4629-8693-a2574922e458, host dv-cinder-789564-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=ada7bf8b-4ba6-4629-8693-a2574922e458,segment=NetworkSegment(e9a4953c-bd2f-4412-9030-8eb2cd20f5c5),segment_id=e9a4953c-bd2f-4412-9030-8eb2cd20f5c5)] {{(pid=99028) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 17:43:42.919918 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-0a6a4bbc-e1a1-4a3a-8fcb-f91fdd525edc tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify callbacks [] for security_group_rule, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:42.922387 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-0a6a4bbc-e1a1-4a3a-8fcb-f91fdd525edc tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.122 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.4702489
May 25 17:43:42.930320 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 42572) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:43:42.935448 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.v2.base [None req-68cc1310-b1dd-450f-aaf6-f6a3464f6496 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Request body: {'floatingip': {'floating_network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb'}} {{(pid=99027) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:43:42.941466 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-68cc1310-b1dd-450f-aaf6-f6a3464f6496 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:43:42.944884 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-bbe1fcfa-82f1-4d10-b0fd-3827e4507f7e req-e1b5e958-4037-49ca-8e29-18ac0a56e1c0 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/security-groups?id=dda11ec6-545c-479e-bba9-4390fea678fa&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0412869
May 25 17:43:42.946341 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-68cc1310-b1dd-450f-aaf6-f6a3464f6496 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Usage tracker for resource:floatingip and tenant:cf02997eda314aee8fb322add2fbb921 is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:43:42.955720 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-68cc1310-b1dd-450f-aaf6-f6a3464f6496 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:43:42.964846 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-68cc1310-b1dd-450f-aaf6-f6a3464f6496 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:43:42.997614 dv-cinder-789564-2-iscsi neutron-server[99028]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ac0d5316-763a-434a-82ea-c3d559ad0984', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'cd9e7667-ca15-4541-9b3a-687f6f585523', 'code': 200}
May 25 17:43:43.017396 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:43.018661 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-a61f25df-84a2-440b-822d-639601627753 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:43.019193 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:43:43.027803 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-065dbd7b-a359-4c16-992d-061ab3123d55 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:43:43.047910 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-e581c549-a4d6-4951-bc04-c9f40a1cf5c3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:43.067119 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-a61f25df-84a2-440b-822d-639601627753 admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=8a05968ab280442c9a3fefe875828054&name=default HTTP/1.1" status: 200  len: 2979 time: 0.5327106
May 25 17:43:43.070629 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 42576) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:43:43.070961 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a61f25df-84a2-440b-822d-639601627753 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=65c8f802-d066-41ab-a861-379a903e437e,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:43:43.074379 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-a61f25df-84a2-440b-822d-639601627753 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:43:43.103002 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e581c549-a4d6-4951-bc04-c9f40a1cf5c3 None None] Routers {'3ca50ec5-218d-44ad-8ffc-4318f54d7350'} bound to L3 agent in host dv-cinder-789564-2-iscsi {{(pid=99028) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 17:43:43.103511 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-e581c549-a4d6-4951-bc04-c9f40a1cf5c3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcae7167a30>, 'dv-cinder-789564-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-25T17:34:21Z,description=<?>,heartbeat_timestamp=2021-05-25T17:43:21Z,host='dv-cinder-789564-2-iscsi',id=eaeb6875-c4ed-43b6-8658-aa4e52324fdf,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T17:34:21Z,topic='l3_agent')) {'router_ids': ['3ca50ec5-218d-44ad-8ffc-4318f54d7350'], 'active': True} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:43:43.182163 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-68cc1310-b1dd-450f-aaf6-f6a3464f6496 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify callbacks [] for floatingip, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:43.191575 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-036801c0-0024-4f19-8990-3aeedd310d4a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:43.213913 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Pushing event updated for resources: {'Port': ['ID=cd9e7667-ca15-4541-9b3a-687f6f585523,revision_number=5']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:43:43.224969 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.205s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:43:43.225471 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-09f76bfc-ecac-4cd4-80fa-1e2d2668d569 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.168s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:43:43.236956 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-036801c0-0024-4f19-8990-3aeedd310d4a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:43.409702 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-68cc1310-b1dd-450f-aaf6-f6a3464f6496 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:43.418464 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09f76bfc-ecac-4cd4-80fa-1e2d2668d569 None None] Pushing event updated for resources: {'Port': ['ID=ada7bf8b-4ba6-4629-8693-a2574922e458,revision_number=4']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:43:43.426511 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-09f76bfc-ecac-4cd4-80fa-1e2d2668d569 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.201s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:43:43.449975 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvr_db [None req-e581c549-a4d6-4951-bc04-c9f40a1cf5c3 None None] Set router 3ca50ec5-218d-44ad-8ffc-4318f54d7350 gateway port host: dv-cinder-789564-2-iscsi {{(pid=99028) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 17:43:43.514687 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-036801c0-0024-4f19-8990-3aeedd310d4a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:43.523726 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:43:43.543338 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-036801c0-0024-4f19-8990-3aeedd310d4a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=65c8f802-d066-41ab-a861-379a903e437e,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:43:43.572227 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-036801c0-0024-4f19-8990-3aeedd310d4a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.041s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:43:43.575414 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-036801c0-0024-4f19-8990-3aeedd310d4a admin admin] Notify callbacks [] for security_group, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:43.582027 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-036801c0-0024-4f19-8990-3aeedd310d4a admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/65c8f802-d066-41ab-a861-379a903e437e HTTP/1.1" status: 204  len: 168 time: 0.5098395
May 25 17:43:43.699642 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.db_base_plugin_common [None req-68cc1310-b1dd-450f-aaf6-f6a3464f6496 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Allocated IP 172.27.3.6 (eb7ec72b-a691-481b-8d7e-42c05e13a8cb/d6898f5f-da0b-4428-97b4-4cbe3e83caaa/89860521-7707-4358-ae75-85fa1eb2c669) {{(pid=99027) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 17:43:43.822931 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-902c524e-52ab-47fa-8c95-5237a9364ac1 req-3752566b-2d58-43f7-be89-eb17a05b66b3 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:43.824869 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-902c524e-52ab-47fa-8c95-5237a9364ac1 req-3752566b-2d58-43f7-be89-eb17a05b66b3 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=78a85fac-d281-494d-90da-a47ddc8255e5 HTTP/1.1" status: 200  len: 945 time: 0.1448054
May 25 17:43:43.902389 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-902c524e-52ab-47fa-8c95-5237a9364ac1 req-5ce43296-3ca8-454d-aef3-298ca442c003 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0712724
May 25 17:43:43.967076 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-68cc1310-b1dd-450f-aaf6-f6a3464f6496 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify callbacks [] for port, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:43.986592 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-e581c549-a4d6-4951-bc04-c9f40a1cf5c3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcae7167a30>, [{'id': '3ca50ec5-218d-44ad-8ffc-4318f54d7350', 'name': 'tempest-AttachVolumeShelveTestJSON-2113890446-router', 'tenant_id': 'cf02997eda314aee8fb322add2fbb921', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.226'}], 'enable_snat': True}, 'gw_port_id': '1e97124a-073a-4947-a6f2-359fb12ffe5e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:43:31Z', 'updated_at': '2021-05-25T17:43:37Z', 'revision_number': 4, 'project_id': 'cf02997eda314aee8fb322add2fbb921', 'gw_port': {'id': '1e97124a-073a-4947-a6f2-359fb12ffe5e', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:c8:ed:c5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3ca50ec5-218d-44ad-8ffc-4318f54d7350', 'device_owner': 'network:router_gateway', 'standard_attr_id': 244, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.226', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:43:33Z', 'updated_at': '2021-05-25T17:43:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi', '_interfaces': [{'id': 'ada7bf8b-4ba6-4629-8693-a2574922e458', 'name': '', 'network_id': '45b850af-d423-458a-855a-d7f828a11fff', 'tenant_id': 'cf02997eda314aee8fb322add2fbb921', 'mac_address': 'fa:16:3e:59:34:b7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3ca50ec5-218d-44ad-8ffc-4318f54d7350', 'device_owner': 'network:router_interface', 'standard_attr_id': 255, 'fixed_ips': [{'subnet_id': '704d0a85-ee4f-4df2-90a3-a525dfe28461', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:43:37Z', 'updated_at': '2021-05-25T17:43:42Z', 'revision_number': 4, 'project_id': 'cf02997eda314aee8fb322add2fbb921', 'subnets': [{'id': '704d0a85-ee4f-4df2-90a3-a525dfe28461', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-789564-2-iscsi', False) {} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:43:43.992300 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e581c549-a4d6-4951-bc04-c9f40a1cf5c3 None None] The sync data for ids ['3ca50ec5-218d-44ad-8ffc-4318f54d7350'] in dv-cinder-789564-2-iscsi is: [{'id': '3ca50ec5-218d-44ad-8ffc-4318f54d7350', 'name': 'tempest-AttachVolumeShelveTestJSON-2113890446-router', 'tenant_id': 'cf02997eda314aee8fb322add2fbb921', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.226'}], 'enable_snat': True}, 'gw_port_id': '1e97124a-073a-4947-a6f2-359fb12ffe5e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:43:31Z', 'updated_at': '2021-05-25T17:43:37Z', 'revision_number': 4, 'project_id': 'cf02997eda314aee8fb322add2fbb921', 'gw_port': {'id': '1e97124a-073a-4947-a6f2-359fb12ffe5e', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:c8:ed:c5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3ca50ec5-218d-44ad-8ffc-4318f54d7350', 'device_owner': 'network:router_gateway', 'standard_attr_id': 244, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.226', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:43:33Z', 'updated_at': '2021-05-25T17:43:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi', '_interfaces': [{'id': 'ada7bf8b-4ba6-4629-8693-a2574922e458', 'name': '', 'network_id': '45b850af-d423-458a-855a-d7f828a11fff', 'tenant_id': 'cf02997eda314aee8fb322add2fbb921', 'mac_address': 'fa:16:3e:59:34:b7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3ca50ec5-218d-44ad-8ffc-4318f54d7350', 'device_owner': 'network:router_interface', 'standard_attr_id': 255, 'fixed_ips': [{'subnet_id': '704d0a85-ee4f-4df2-90a3-a525dfe28461', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:43:37Z', 'updated_at': '2021-05-25T17:43:42Z', 'revision_number': 4, 'project_id': 'cf02997eda314aee8fb322add2fbb921', 'subnets': [{'id': '704d0a85-ee4f-4df2-90a3-a525dfe28461', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=99028) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 25 17:43:44.086936 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-68cc1310-b1dd-450f-aaf6-f6a3464f6496 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781840788179', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15468986'] for port, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:44.094689 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-9f9d9046-5585-4035-a15a-4f713f977a4c service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:43:44.156465 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f80a3d0f-4289-42b2-8e60-61e4b55521c4 req-3a8884b0-a39f-40af-86fd-0b173dd689bc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:44.158012 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-f80a3d0f-4289-42b2-8e60-61e4b55521c4 req-3a8884b0-a39f-40af-86fd-0b173dd689bc service neutron] 10.222.0.125 "GET /v2.0/ports?device_id=ac0d5316-763a-434a-82ea-c3d559ad0984 HTTP/1.1" status: 200  len: 1098 time: 0.1423101
May 25 17:43:44.237577 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-68cc1310-b1dd-450f-aaf6-f6a3464f6496 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Network eb7ec72b-a691-481b-8d7e-42c05e13a8cb is already hosted by enough agents. {{(pid=99027) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 17:43:44.242698 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.base_scheduler [None req-68cc1310-b1dd-450f-aaf6-f6a3464f6496 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Resources bound (agent type, host, resource id):  {{(pid=99027) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 17:43:44.247980 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.l3_dvrscheduler_db [None req-68cc1310-b1dd-450f-aaf6-f6a3464f6496 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Received port after_create {{(pid=99027) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 17:43:44.261949 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-f80a3d0f-4289-42b2-8e60-61e4b55521c4 req-87ce26d3-7688-49ba-8c41-f91e22979ee5 service neutron] 10.222.0.125 "GET /v2.0/security-groups?id=dda11ec6-545c-479e-bba9-4390fea678fa&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0873816
May 25 17:43:44.291161 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68cc1310-b1dd-450f-aaf6-f6a3464f6496 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Pushing event updated for resources: {'Port': ['ID=89860521-7707-4358-ae75-85fa1eb2c669,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:43:44.302750 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-68cc1310-b1dd-450f-aaf6-f6a3464f6496 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.210s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:43:44.360900 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a1447d4-3b2b-4c24-a172-14ada24aedc2 req-88386a81-0cad-4343-b4c1-50b8980a2e51 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:44.360900 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-4a1447d4-3b2b-4c24-a172-14ada24aedc2 req-88386a81-0cad-4343-b4c1-50b8980a2e51 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/ports?device_id=ac0d5316-763a-434a-82ea-c3d559ad0984 HTTP/1.1" status: 200  len: 945 time: 0.2075341
May 25 17:43:44.371438 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-68cc1310-b1dd-450f-aaf6-f6a3464f6496 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify callbacks [] for floatingip, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:44.424053 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-4a1447d4-3b2b-4c24-a172-14ada24aedc2 req-d3a2a2e4-ce6f-40ec-8d8d-b7fc7ad2a734 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/security-groups?id=dda11ec6-545c-479e-bba9-4390fea678fa&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0564024
May 25 17:43:44.549776 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 42606) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:43:44.574297 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-0d125e76-b103-44fc-8e45-34ac115d4c63 admin admin] Notify callbacks [] for security_group, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:44.575908 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-68cc1310-b1dd-450f-aaf6-f6a3464f6496 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:44.590530 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-0d125e76-b103-44fc-8e45-34ac115d4c63 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:43:44.594738 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-0d125e76-b103-44fc-8e45-34ac115d4c63 admin admin] Usage tracker for resource:security_group_rule and tenant:356bbdf3829749ecbe3c0c2c11bb153a is out of sync, need to count used quota {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:43:44.597920 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-0d125e76-b103-44fc-8e45-34ac115d4c63 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:43:44.605469 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-0d125e76-b103-44fc-8e45-34ac115d4c63 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:43:44.808827 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-68cc1310-b1dd-450f-aaf6-f6a3464f6496 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify callbacks [] for port, precommit_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:44.825494 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-0d125e76-b103-44fc-8e45-34ac115d4c63 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:44.891208 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-68cc1310-b1dd-450f-aaf6-f6a3464f6496 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15468979'] for port, after_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:44.891733 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-0d125e76-b103-44fc-8e45-34ac115d4c63 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:44.895593 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:43:44.901094 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-3773cb75-9048-4de0-9d3a-a28906022034 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:43:44.953031 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-0d125e76-b103-44fc-8e45-34ac115d4c63 admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=356bbdf3829749ecbe3c0c2c11bb153a&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3998768
May 25 17:43:44.953031 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d125e76-b103-44fc-8e45-34ac115d4c63 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b3c3f3f5-7690-4126-8fb2-4867aa731e8e,revision_number=1']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:43:44.953973 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 42614) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:43:44.957210 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-0d125e76-b103-44fc-8e45-34ac115d4c63 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.056s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:43:45.011535 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68cc1310-b1dd-450f-aaf6-f6a3464f6496 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Pushing event updated for resources: {'Port': ['ID=89860521-7707-4358-ae75-85fa1eb2c669,revision_number=2']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:43:45.015067 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-68cc1310-b1dd-450f-aaf6-f6a3464f6496 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.120s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:43:45.021074 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-68cc1310-b1dd-450f-aaf6-f6a3464f6496 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-419865'] for floatingip, after_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:45.032813 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-61c5eb24-c63e-41c6-9b18-572a0526d57c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:45.072580 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-61c5eb24-c63e-41c6-9b18-572a0526d57c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:45.153045 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-68cc1310-b1dd-450f-aaf6-f6a3464f6496 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-239387'] for floatingip, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:45.154396 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-68cc1310-b1dd-450f-aaf6-f6a3464f6496 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.122 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 691 time: 2.2228889
May 25 17:43:45.195081 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device ada7bf8b-4ba6-4629-8693-a2574922e458 up at agent ovs-agent-dv-cinder-789564-2-iscsi {{(pid=99028) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 17:43:45.234094 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-61c5eb24-c63e-41c6-9b18-572a0526d57c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:45.243485 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-82e7db09-a951-4529-88ef-9ad4612d2511 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:43:45.256082 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b513f27-4b88-4216-af9d-67d26faafcbf req-8e354490-f019-43dc-ab69-f94f3df1b466 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:45.262683 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61c5eb24-c63e-41c6-9b18-572a0526d57c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b3c3f3f5-7690-4126-8fb2-4867aa731e8e,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:43:45.272123 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-9b513f27-4b88-4216-af9d-67d26faafcbf req-8e354490-f019-43dc-ab69-f94f3df1b466 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=78a85fac-d281-494d-90da-a47ddc8255e5 HTTP/1.1" status: 200  len: 945 time: 0.1788256
May 25 17:43:45.275381 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-61c5eb24-c63e-41c6-9b18-572a0526d57c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.032s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:43:45.279615 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-61c5eb24-c63e-41c6-9b18-572a0526d57c admin admin] Notify callbacks [] for security_group, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:45.284179 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-61c5eb24-c63e-41c6-9b18-572a0526d57c admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/b3c3f3f5-7690-4126-8fb2-4867aa731e8e HTTP/1.1" status: 204  len: 168 time: 0.3285525
May 25 17:43:45.375483 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-9b513f27-4b88-4216-af9d-67d26faafcbf req-03a5d80b-9b31-4c01-8182-2dad3aa0a1a8 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1006911
May 25 17:43:45.533768 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [req-54ec1e38-d17d-4198-a9e8-eca6c7965e41 req-00d78ce0-58cf-414d-9af0-ca95f0ae9a03 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Synchronizing usage tracker for tenant:cf02997eda314aee8fb322add2fbb921 on resource:security_group {{(pid=99026) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 17:43:45.592323 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Provisioning for port ada7bf8b-4ba6-4629-8693-a2574922e458 completed by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 17:43:45.603107 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Provisioning complete for port ada7bf8b-4ba6-4629-8693-a2574922e458 triggered by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 17:43:45.604060 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:45.692751 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-439d92fc-7001-4316-b205-1eeb53fcf2d6 req-fff183d2-329e-4f4b-b05d-90d5b8ada691 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:45.694418 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-439d92fc-7001-4316-b205-1eeb53fcf2d6 req-fff183d2-329e-4f4b-b05d-90d5b8ada691 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/ports?device_id=ac0d5316-763a-434a-82ea-c3d559ad0984 HTTP/1.1" status: 200  len: 945 time: 0.1143787
May 25 17:43:45.747117 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-439d92fc-7001-4316-b205-1eeb53fcf2d6 req-b9332100-3e9d-47bd-bdba-0682aa7e1625 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/security-groups?id=dda11ec6-545c-479e-bba9-4390fea678fa&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0446410
May 25 17:43:45.772574 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [req-54ec1e38-d17d-4198-a9e8-eca6c7965e41 req-00d78ce0-58cf-414d-9af0-ca95f0ae9a03 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Unset dirty status for tenant:cf02997eda314aee8fb322add2fbb921 on resource:security_group {{(pid=99026) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 17:43:45.774719 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-54ec1e38-d17d-4198-a9e8-eca6c7965e41 req-00d78ce0-58cf-414d-9af0-ca95f0ae9a03 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.122 "GET /v2.0/security-groups?name=tempest-securitygroup--530386844&fields=id&tenant_id=cf02997eda314aee8fb322add2fbb921 HTTP/1.1" status: 200  len: 267 time: 0.3014808
May 25 17:43:45.812922 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:45.856925 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] For port ada7bf8b-4ba6-4629-8693-a2574922e458, host dv-cinder-789564-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=ada7bf8b-4ba6-4629-8693-a2574922e458,segment=NetworkSegment(e9a4953c-bd2f-4412-9030-8eb2cd20f5c5),segment_id=e9a4953c-bd2f-4412-9030-8eb2cd20f5c5)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:43:45.921242 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:45.923133 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-5eb65ca6-f074-4b97-bf0e-05fd6c06aa9c None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:43:45.967836 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54ec1e38-d17d-4198-a9e8-eca6c7965e41 req-5c93c166-4c6a-4de0-8acd-c7ad339dc897 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:45.968552 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [req-54ec1e38-d17d-4198-a9e8-eca6c7965e41 req-5c93c166-4c6a-4de0-8acd-c7ad339dc897 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Synchronizing usage tracker for tenant:cf02997eda314aee8fb322add2fbb921 on resource:network {{(pid=99026) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 17:43:46.036899 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Pushing event updated for resources: {'Port': ['ID=ada7bf8b-4ba6-4629-8693-a2574922e458,revision_number=5']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:43:46.043122 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.118s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:43:46.063057 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [req-54ec1e38-d17d-4198-a9e8-eca6c7965e41 req-5c93c166-4c6a-4de0-8acd-c7ad339dc897 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Unset dirty status for tenant:cf02997eda314aee8fb322add2fbb921 on resource:network {{(pid=99026) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 17:43:46.064993 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-54ec1e38-d17d-4198-a9e8-eca6c7965e41 req-5c93c166-4c6a-4de0-8acd-c7ad339dc897 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.122 "GET /v2.0/networks?id=45b850af-d423-458a-855a-d7f828a11fff HTTP/1.1" status: 200  len: 817 time: 0.2810178
May 25 17:43:46.086216 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-54ec1e38-d17d-4198-a9e8-eca6c7965e41 req-9728dc76-4198-4a1d-8946-62a273db2cf0 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.122 "GET /v2.0/quotas/cf02997eda314aee8fb322add2fbb921 HTTP/1.1" status: 200  len: 375 time: 0.0140092
May 25 17:43:46.181228 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [req-54ec1e38-d17d-4198-a9e8-eca6c7965e41 req-94a9c5d4-6d55-47c6-9e4b-eef2b1ff60b4 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Synchronizing usage tracker for tenant:cf02997eda314aee8fb322add2fbb921 on resource:port {{(pid=99026) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 17:43:46.263259 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [req-54ec1e38-d17d-4198-a9e8-eca6c7965e41 req-94a9c5d4-6d55-47c6-9e4b-eef2b1ff60b4 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Unset dirty status for tenant:cf02997eda314aee8fb322add2fbb921 on resource:port {{(pid=99026) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 17:43:46.269177 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-54ec1e38-d17d-4198-a9e8-eca6c7965e41 req-94a9c5d4-6d55-47c6-9e4b-eef2b1ff60b4 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.122 "GET /v2.0/ports?tenant_id=cf02997eda314aee8fb322add2fbb921&fields=id HTTP/1.1" status: 200  len: 348 time: 0.1749201
May 25 17:43:46.421498 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-54ec1e38-d17d-4198-a9e8-eca6c7965e41 req-7691762c-d1f7-41bf-b37a-a7f88562a798 service neutron] 10.222.0.122 "GET /v2.0/networks/45b850af-d423-458a-855a-d7f828a11fff?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1342685
May 25 17:43:46.579521 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-54ec1e38-d17d-4198-a9e8-eca6c7965e41 req-63b18b3a-c6c1-4200-95b3-4915dc8346f2 service neutron] 10.222.0.122 "GET /v2.0/networks/45b850af-d423-458a-855a-d7f828a11fff?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1513376
May 25 17:43:46.616172 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75f61fb2-228d-45a3-8fe3-2fc1ade5bb17 req-641ec4ae-4147-4f8b-8278-0a5c0a82f911 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:46.617673 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-75f61fb2-228d-45a3-8fe3-2fc1ade5bb17 req-641ec4ae-4147-4f8b-8278-0a5c0a82f911 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=78a85fac-d281-494d-90da-a47ddc8255e5 HTTP/1.1" status: 200  len: 945 time: 0.0845776
May 25 17:43:46.662949 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-75f61fb2-228d-45a3-8fe3-2fc1ade5bb17 req-4db75807-b199-467c-a6a9-560c1f9d7825 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0394568
May 25 17:43:47.022881 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e17844f4-2bf4-4957-8797-da42142970c5 req-1cb7dcc4-8ecc-468d-9607-3bb600ff728f tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:47.024461 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-e17844f4-2bf4-4957-8797-da42142970c5 req-1cb7dcc4-8ecc-468d-9607-3bb600ff728f tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/ports?device_id=ac0d5316-763a-434a-82ea-c3d559ad0984 HTTP/1.1" status: 200  len: 945 time: 0.1655097
May 25 17:43:47.097262 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-e17844f4-2bf4-4957-8797-da42142970c5 req-5d4b6d27-163a-4337-af12-86b20af0ede0 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/security-groups?id=dda11ec6-545c-479e-bba9-4390fea678fa&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0668459
May 25 17:43:47.112515 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-72e71e84-975b-4cde-92c7-e1f096ba92ac req-8a18c5fa-53bc-4382-9e4f-7c919f1e7427 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.122 "GET /v2.0/ports?device_id=00d13d2c-33fc-42ec-a80d-4cd8155b6fe1 HTTP/1.1" status: 200  len: 210 time: 0.1137531
May 25 17:43:47.167433 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device ada7bf8b-4ba6-4629-8693-a2574922e458 up at agent ovs-agent-dv-cinder-789564-2-iscsi {{(pid=99028) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 17:43:47.243573 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Provisioning complete for port ada7bf8b-4ba6-4629-8693-a2574922e458 triggered by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 17:43:47.243946 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:47.929876 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f01d7c3-e61f-4932-903b-ce64753905a9 req-4cc2ba17-7976-4f2c-ae72-26c3fea9cbfc tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:47.931347 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-1f01d7c3-e61f-4932-903b-ce64753905a9 req-4cc2ba17-7976-4f2c-ae72-26c3fea9cbfc tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=78a85fac-d281-494d-90da-a47ddc8255e5 HTTP/1.1" status: 200  len: 945 time: 0.1530442
May 25 17:43:47.981403 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-1f01d7c3-e61f-4932-903b-ce64753905a9 req-4f03ab3e-76b8-49d0-8ed0-a4ad6692dbaa tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0440645
May 25 17:43:48.154117 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-686c5b99-bfe7-4a9b-8509-8da13c0fac0c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:48.297194 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99492067-c2db-4875-8404-86d6fda86c05 req-cd9da8c6-2ae5-434b-9cb1-753eda80206a tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:48.298658 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-99492067-c2db-4875-8404-86d6fda86c05 req-cd9da8c6-2ae5-434b-9cb1-753eda80206a tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/ports?device_id=ac0d5316-763a-434a-82ea-c3d559ad0984 HTTP/1.1" status: 200  len: 945 time: 0.0817022
May 25 17:43:48.342843 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-99492067-c2db-4875-8404-86d6fda86c05 req-d0a7dc81-98d5-4129-a6b5-05ccab788bc4 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/security-groups?id=dda11ec6-545c-479e-bba9-4390fea678fa&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0379972
May 25 17:43:48.480830 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-6f1cf70f-1ef3-4172-b24d-0350997b1bea req-4c222ada-4476-4fe5-8197-7bffdcea55cb tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.122 "GET /v2.0/ports?device_id=00d13d2c-33fc-42ec-a80d-4cd8155b6fe1 HTTP/1.1" status: 200  len: 210 time: 0.0422397
May 25 17:43:49.188368 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1321ffc-bbbb-4770-8d9e-2b4d95035888 req-e78a9acf-6bd3-4afe-81a6-513b76e5418a tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:49.189848 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-c1321ffc-bbbb-4770-8d9e-2b4d95035888 req-e78a9acf-6bd3-4afe-81a6-513b76e5418a tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=78a85fac-d281-494d-90da-a47ddc8255e5 HTTP/1.1" status: 200  len: 945 time: 0.0878944
May 25 17:43:49.235536 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-c1321ffc-bbbb-4770-8d9e-2b4d95035888 req-2b94d351-2ecf-4f24-b57d-e4827b828743 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0398910
May 25 17:43:49.540855 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41d80e0b-5c50-4207-b4b9-ea7f8ad76bf9 req-36763848-3b9d-49aa-8019-3279ad701be7 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:49.542399 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-41d80e0b-5c50-4207-b4b9-ea7f8ad76bf9 req-36763848-3b9d-49aa-8019-3279ad701be7 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/ports?device_id=ac0d5316-763a-434a-82ea-c3d559ad0984 HTTP/1.1" status: 200  len: 945 time: 0.0929258
May 25 17:43:49.592110 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-41d80e0b-5c50-4207-b4b9-ea7f8ad76bf9 req-e8cb1759-777b-4b5c-ada3-828f9a64466b tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/security-groups?id=dda11ec6-545c-479e-bba9-4390fea678fa&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0432582
May 25 17:43:49.663120 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-8e1d0b31-5354-4599-8a53-49bce9385855 req-730fe953-d6bc-4f31-8c83-d5efea31bb57 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.122 "GET /v2.0/ports?device_id=00d13d2c-33fc-42ec-a80d-4cd8155b6fe1 HTTP/1.1" status: 200  len: 210 time: 0.0502417
May 25 17:43:50.461770 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff90da39-1f12-4138-ac0b-5354c93db44c req-500bd411-be19-4e4a-b0cc-073f6431ccb6 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:50.463245 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-ff90da39-1f12-4138-ac0b-5354c93db44c req-500bd411-be19-4e4a-b0cc-073f6431ccb6 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=78a85fac-d281-494d-90da-a47ddc8255e5 HTTP/1.1" status: 200  len: 945 time: 0.1084251
May 25 17:43:50.598437 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-ff90da39-1f12-4138-ac0b-5354c93db44c req-6d23fc78-c227-4bc9-9e7a-fc1d996ab9d5 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0742178
May 25 17:43:50.634665 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54ec1e38-d17d-4198-a9e8-eca6c7965e41 req-64ae16df-85d4-492f-9d6b-608a0f269841 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:50.636215 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-54ec1e38-d17d-4198-a9e8-eca6c7965e41 req-64ae16df-85d4-492f-9d6b-608a0f269841 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.125 "GET /v2.0/networks?id=45b850af-d423-458a-855a-d7f828a11fff HTTP/1.1" status: 200  len: 817 time: 0.2014732
May 25 17:43:50.652186 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-562e1faa-2710-44d9-b879-571ad3f5519f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:50.688805 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-54ec1e38-d17d-4198-a9e8-eca6c7965e41 req-d10bfea5-f2f0-4df3-af45-357a446a5380 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.125 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=cf02997eda314aee8fb322add2fbb921 HTTP/1.1" status: 200  len: 379 time: 0.0452914
May 25 17:43:50.697980 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.v2.base [req-54ec1e38-d17d-4198-a9e8-eca6c7965e41 req-ad7a4723-3d71-40f4-95ec-459fe91b5478 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Request body: {'port': {'device_id': '00d13d2c-33fc-42ec-a80d-4cd8155b6fe1', 'network_id': '45b850af-d423-458a-855a-d7f828a11fff', 'admin_state_up': True, 'tenant_id': 'cf02997eda314aee8fb322add2fbb921', 'security_groups': ['fa654e78-f61f-461b-b301-3690d1826946']}} {{(pid=99026) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:43:50.831394 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1500f82-5434-4969-ab60-6501129871f5 req-2bb14238-2085-45b7-9a8c-ffc525227060 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:50.833519 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-c1500f82-5434-4969-ab60-6501129871f5 req-2bb14238-2085-45b7-9a8c-ffc525227060 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/ports?device_id=ac0d5316-763a-434a-82ea-c3d559ad0984 HTTP/1.1" status: 200  len: 945 time: 0.0872364
May 25 17:43:50.846116 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:50.896413 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-cfcab69f-8f68-4e08-afda-a04af09e3f34 req-a7ec8a9f-8a1a-4c90-8a1b-448e0fbd559a tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.122 "GET /v2.0/ports?device_id=00d13d2c-33fc-42ec-a80d-4cd8155b6fe1 HTTP/1.1" status: 200  len: 210 time: 0.0778635
May 25 17:43:50.928763 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [req-54ec1e38-d17d-4198-a9e8-eca6c7965e41 req-ad7a4723-3d71-40f4-95ec-459fe91b5478 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:43:50.941460 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [req-54ec1e38-d17d-4198-a9e8-eca6c7965e41 req-ad7a4723-3d71-40f4-95ec-459fe91b5478 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:43:50.945463 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-c1500f82-5434-4969-ab60-6501129871f5 req-bf69d607-8817-4219-a27b-db5978987ac6 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/security-groups?id=dda11ec6-545c-479e-bba9-4390fea678fa&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0914519
May 25 17:43:51.017768 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-54ec1e38-d17d-4198-a9e8-eca6c7965e41 req-ad7a4723-3d71-40f4-95ec-459fe91b5478 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Made reservation on behalf of cf02997eda314aee8fb322add2fbb921 for: {'port': 1} {{(pid=99026) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 17:43:51.023754 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [req-54ec1e38-d17d-4198-a9e8-eca6c7965e41 req-ad7a4723-3d71-40f4-95ec-459fe91b5478 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:51.202565 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.db_base_plugin_common [req-54ec1e38-d17d-4198-a9e8-eca6c7965e41 req-ad7a4723-3d71-40f4-95ec-459fe91b5478 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Allocated IP 172.20.0.7 (45b850af-d423-458a-855a-d7f828a11fff/704d0a85-ee4f-4df2-90a3-a525dfe28461/5c96172a-06f4-41ce-b47a-f1bbde47e41c) {{(pid=99026) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 17:43:51.448146 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [req-54ec1e38-d17d-4198-a9e8-eca6c7965e41 req-ad7a4723-3d71-40f4-95ec-459fe91b5478 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify callbacks [] for port, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:51.464304 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.provisioning_blocks [req-54ec1e38-d17d-4198-a9e8-eca6c7965e41 req-ad7a4723-3d71-40f4-95ec-459fe91b5478 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Transition to ACTIVE for port object 5c96172a-06f4-41ce-b47a-f1bbde47e41c will not be triggered until provisioned by entity DHCP. {{(pid=99026) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 17:43:51.559930 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [req-54ec1e38-d17d-4198-a9e8-eca6c7965e41 req-ad7a4723-3d71-40f4-95ec-459fe91b5478 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781840788179', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15476536'] for port, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:51.565885 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-618f3614-e19a-4cf0-9fe6-ee789335b2b0 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:43:51.633548 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad7a4723-3d71-40f4-95ec-459fe91b5478 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Pushing event updated for resources: {'Port': ['ID=5c96172a-06f4-41ce-b47a-f1bbde47e41c,revision_number=1']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:43:51.636296 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-ad7a4723-3d71-40f4-95ec-459fe91b5478 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:43:51.675581 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-54ec1e38-d17d-4198-a9e8-eca6c7965e41 req-ad7a4723-3d71-40f4-95ec-459fe91b5478 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Network 45b850af-d423-458a-855a-d7f828a11fff is already hosted by enough agents. {{(pid=99026) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 17:43:51.678646 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.scheduler.base_scheduler [req-54ec1e38-d17d-4198-a9e8-eca6c7965e41 req-ad7a4723-3d71-40f4-95ec-459fe91b5478 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Resources bound (agent type, host, resource id):  {{(pid=99026) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 17:43:51.679520 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.l3_dvrscheduler_db [req-54ec1e38-d17d-4198-a9e8-eca6c7965e41 req-ad7a4723-3d71-40f4-95ec-459fe91b5478 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Received port after_create {{(pid=99026) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 17:43:51.752148 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54ec1e38-d17d-4198-a9e8-eca6c7965e41 req-ad7a4723-3d71-40f4-95ec-459fe91b5478 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:51.752808 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [req-54ec1e38-d17d-4198-a9e8-eca6c7965e41 req-ad7a4723-3d71-40f4-95ec-459fe91b5478 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-239387', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for port, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:51.754336 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-7e261f94-b84f-443e-be49-3bc1ac903b55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:51.763806 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.agents_db [None req-14fae233-15dc-4576-836b-621c5f95b584 None None] Agent healthcheck: found 6 active agents {{(pid=99029) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 17:43:51.869508 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-54ec1e38-d17d-4198-a9e8-eca6c7965e41 req-ad7a4723-3d71-40f4-95ec-459fe91b5478 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.125 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.1770217
May 25 17:43:51.971421 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-081efa1f-2ea1-40e7-a12b-e1ca88e29c5c None None] Provisioning for port 5c96172a-06f4-41ce-b47a-f1bbde47e41c completed by entity DHCP. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 17:43:51.977693 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-081efa1f-2ea1-40e7-a12b-e1ca88e29c5c None None] Provisioning complete for port 5c96172a-06f4-41ce-b47a-f1bbde47e41c triggered by entity DHCP. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 17:43:51.978175 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-081efa1f-2ea1-40e7-a12b-e1ca88e29c5c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:52.045540 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.plugin [None req-081efa1f-2ea1-40e7-a12b-e1ca88e29c5c None None] Port 5c96172a-06f4-41ce-b47a-f1bbde47e41c cannot update to ACTIVE because it is not bound. {{(pid=99028) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 25 17:43:52.139342 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ca2efef-fdc6-4772-b6dc-90ba9c703fb3 req-316f682f-7890-4c11-8c78-21dce254ad8a tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:52.140947 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-1ca2efef-fdc6-4772-b6dc-90ba9c703fb3 req-316f682f-7890-4c11-8c78-21dce254ad8a tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=78a85fac-d281-494d-90da-a47ddc8255e5 HTTP/1.1" status: 200  len: 945 time: 0.0810938
May 25 17:43:52.185464 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-1ca2efef-fdc6-4772-b6dc-90ba9c703fb3 req-e99b4536-becc-484b-a20d-feaa54dece5c tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0387385
May 25 17:43:52.360368 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1bc6b5f-ee48-40e3-bbc6-e6f9fb355158 req-6acb7c89-6ea4-418e-8658-855b7d9b6ac5 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:52.361049 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [req-f1bc6b5f-ee48-40e3-bbc6-e6f9fb355158 req-6acb7c89-6ea4-418e-8658-855b7d9b6ac5 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Synchronizing usage tracker for tenant:cf02997eda314aee8fb322add2fbb921 on resource:port {{(pid=99026) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 17:43:52.450728 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [req-f1bc6b5f-ee48-40e3-bbc6-e6f9fb355158 req-6acb7c89-6ea4-418e-8658-855b7d9b6ac5 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Unset dirty status for tenant:cf02997eda314aee8fb322add2fbb921 on resource:port {{(pid=99026) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 17:43:52.451932 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-f1bc6b5f-ee48-40e3-bbc6-e6f9fb355158 req-6acb7c89-6ea4-418e-8658-855b7d9b6ac5 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.122 "GET /v2.0/ports?device_id=00d13d2c-33fc-42ec-a80d-4cd8155b6fe1 HTTP/1.1" status: 200  len: 931 time: 0.1735318
May 25 17:43:52.498523 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-f1bc6b5f-ee48-40e3-bbc6-e6f9fb355158 req-0540bbb2-a72f-4e6a-9eab-68cfb3c014f7 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.122 "GET /v2.0/security-groups?id=fa654e78-f61f-461b-b301-3690d1826946&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0406904
May 25 17:43:53.245945 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-6df2b2a7-a54e-4d57-9be3-033078b9d5b3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:53.372528 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef774e09-8bfa-4a54-a71d-ec4001e214a2 req-0b9324db-d71f-42d1-a7d6-6a7b03325f8e tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:53.374025 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-ef774e09-8bfa-4a54-a71d-ec4001e214a2 req-0b9324db-d71f-42d1-a7d6-6a7b03325f8e tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=78a85fac-d281-494d-90da-a47ddc8255e5 HTTP/1.1" status: 200  len: 945 time: 0.0806339
May 25 17:43:53.418463 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-ef774e09-8bfa-4a54-a71d-ec4001e214a2 req-a67f208e-c52a-45d0-bac9-aa4dadede0ec tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0385630
May 25 17:43:53.488257 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.v2.base [req-54ec1e38-d17d-4198-a9e8-eca6c7965e41 req-1698d07d-e63b-4b1b-90f3-e9630bbfdbe3 service neutron] Request body: {'port': {'device_id': '00d13d2c-33fc-42ec-a80d-4cd8155b6fe1', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78956'}} {{(pid=99026) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:43:53.753852 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [req-54ec1e38-d17d-4198-a9e8-eca6c7965e41 req-1698d07d-e63b-4b1b-90f3-e9630bbfdbe3 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:53.820493 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de2cfa38-8d06-4ce4-b8b2-eb5d12c8c8cb req-9242618d-6e3a-4671-b516-51b6045a6522 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:53.822120 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-de2cfa38-8d06-4ce4-b8b2-eb5d12c8c8cb req-9242618d-6e3a-4671-b516-51b6045a6522 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.122 "GET /v2.0/ports?device_id=00d13d2c-33fc-42ec-a80d-4cd8155b6fe1 HTTP/1.1" status: 200  len: 931 time: 0.1979043
May 25 17:43:53.939140 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-de2cfa38-8d06-4ce4-b8b2-eb5d12c8c8cb req-0a569109-f301-4260-abaa-936767355af2 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.122 "GET /v2.0/security-groups?id=fa654e78-f61f-461b-b301-3690d1826946&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1097791
May 25 17:43:54.150641 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.notifiers.nova [req-54ec1e38-d17d-4198-a9e8-eca6c7965e41 req-1698d07d-e63b-4b1b-90f3-e9630bbfdbe3 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 5c96172a-06f4-41ce-b47a-f1bbde47e41c {{(pid=99026) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 25 17:43:54.157770 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [req-54ec1e38-d17d-4198-a9e8-eca6c7965e41 req-1698d07d-e63b-4b1b-90f3-e9630bbfdbe3 service neutron] Notify callbacks [] for port, precommit_update {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:54.172180 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.provisioning_blocks [req-54ec1e38-d17d-4198-a9e8-eca6c7965e41 req-1698d07d-e63b-4b1b-90f3-e9630bbfdbe3 service neutron] Transition to ACTIVE for port object 5c96172a-06f4-41ce-b47a-f1bbde47e41c will not be triggered until provisioned by entity L2. {{(pid=99026) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 17:43:54.234553 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [req-54ec1e38-d17d-4198-a9e8-eca6c7965e41 req-1698d07d-e63b-4b1b-90f3-e9630bbfdbe3 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15476529'] for port, after_update {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:54.240303 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:43:54.468871 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1698d07d-e63b-4b1b-90f3-e9630bbfdbe3 service neutron] Pushing event updated for resources: {'Port': ['ID=5c96172a-06f4-41ce-b47a-f1bbde47e41c,revision_number=2']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:43:54.479461 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-1698d07d-e63b-4b1b-90f3-e9630bbfdbe3 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.239s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:43:54.520469 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.managers [req-54ec1e38-d17d-4198-a9e8-eca6c7965e41 req-1698d07d-e63b-4b1b-90f3-e9630bbfdbe3 service neutron] Attempting to bind port 5c96172a-06f4-41ce-b47a-f1bbde47e41c on host hv-cinder-78956 for vnic_type normal with profile  {{(pid=99026) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 17:43:54.521150 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.managers [req-54ec1e38-d17d-4198-a9e8-eca6c7965e41 req-1698d07d-e63b-4b1b-90f3-e9630bbfdbe3 service neutron] Attempting to bind port 5c96172a-06f4-41ce-b47a-f1bbde47e41c by drivers openvswitch,hyperv on host hv-cinder-78956 at level 0 using segments [{'id': 'e9a4953c-bd2f-4412-9030-8eb2cd20f5c5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1318, 'network_id': '45b850af-d423-458a-855a-d7f828a11fff'}] {{(pid=99026) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 17:43:54.522418 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-54ec1e38-d17d-4198-a9e8-eca6c7965e41 req-1698d07d-e63b-4b1b-90f3-e9630bbfdbe3 service neutron] Attempting to bind port 5c96172a-06f4-41ce-b47a-f1bbde47e41c on network 45b850af-d423-458a-855a-d7f828a11fff {{(pid=99026) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 17:43:54.528778 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-54ec1e38-d17d-4198-a9e8-eca6c7965e41 req-1698d07d-e63b-4b1b-90f3-e9630bbfdbe3 service neutron] Port 5c96172a-06f4-41ce-b47a-f1bbde47e41c on network 45b850af-d423-458a-855a-d7f828a11fff not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78956 {{(pid=99026) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 25 17:43:54.529456 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-54ec1e38-d17d-4198-a9e8-eca6c7965e41 req-1698d07d-e63b-4b1b-90f3-e9630bbfdbe3 service neutron] Attempting to bind port 5c96172a-06f4-41ce-b47a-f1bbde47e41c on network 45b850af-d423-458a-855a-d7f828a11fff {{(pid=99026) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 17:43:54.535687 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-54ec1e38-d17d-4198-a9e8-eca6c7965e41 req-1698d07d-e63b-4b1b-90f3-e9630bbfdbe3 service neutron] Checking agent: {'id': '4d02a528-6a0e-4977-985f-4bcff1ca6cb7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78956', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 17, 40, 41), 'started_at': datetime.datetime(2021, 5, 25, 17, 40, 41), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 17, 43, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=99026) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 17:43:54.536265 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-54ec1e38-d17d-4198-a9e8-eca6c7965e41 req-1698d07d-e63b-4b1b-90f3-e9630bbfdbe3 service neutron] Checking segment: {'id': 'e9a4953c-bd2f-4412-9030-8eb2cd20f5c5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1318, 'network_id': '45b850af-d423-458a-855a-d7f828a11fff'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=99026) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 17:43:54.537440 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-54ec1e38-d17d-4198-a9e8-eca6c7965e41 req-1698d07d-e63b-4b1b-90f3-e9630bbfdbe3 service neutron] Bound using segment: {'id': 'e9a4953c-bd2f-4412-9030-8eb2cd20f5c5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1318, 'network_id': '45b850af-d423-458a-855a-d7f828a11fff'} {{(pid=99026) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 17:43:54.538036 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.managers [req-54ec1e38-d17d-4198-a9e8-eca6c7965e41 req-1698d07d-e63b-4b1b-90f3-e9630bbfdbe3 service neutron] Bound port: 5c96172a-06f4-41ce-b47a-f1bbde47e41c, host: hv-cinder-78956, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'e9a4953c-bd2f-4412-9030-8eb2cd20f5c5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1318, 'network_id': '45b850af-d423-458a-855a-d7f828a11fff'}}] {{(pid=99026) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 17:43:54.538550 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [req-54ec1e38-d17d-4198-a9e8-eca6c7965e41 req-1698d07d-e63b-4b1b-90f3-e9630bbfdbe3 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:54.638831 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.db [req-54ec1e38-d17d-4198-a9e8-eca6c7965e41 req-1698d07d-e63b-4b1b-90f3-e9630bbfdbe3 service neutron] For port 5c96172a-06f4-41ce-b47a-f1bbde47e41c, host hv-cinder-78956, cleared binding levels {{(pid=99026) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 17:43:54.639061 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aeaf2842-c976-42a1-9506-88ab65ff8553 req-3363d538-0636-4eae-887d-661eaa6f621a tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:54.640664 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-aeaf2842-c976-42a1-9506-88ab65ff8553 req-3363d538-0636-4eae-887d-661eaa6f621a tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=78a85fac-d281-494d-90da-a47ddc8255e5 HTTP/1.1" status: 200  len: 945 time: 0.0954196
May 25 17:43:54.641839 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.db [req-54ec1e38-d17d-4198-a9e8-eca6c7965e41 req-1698d07d-e63b-4b1b-90f3-e9630bbfdbe3 service neutron] For port 5c96172a-06f4-41ce-b47a-f1bbde47e41c, host hv-cinder-78956, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=5c96172a-06f4-41ce-b47a-f1bbde47e41c,segment=NetworkSegment(e9a4953c-bd2f-4412-9030-8eb2cd20f5c5),segment_id=e9a4953c-bd2f-4412-9030-8eb2cd20f5c5)] {{(pid=99026) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 17:43:54.686891 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-aeaf2842-c976-42a1-9506-88ab65ff8553 req-189d32a0-7555-455b-bd7c-2877e6beb6e7 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0399914
May 25 17:43:54.703815 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [req-54ec1e38-d17d-4198-a9e8-eca6c7965e41 req-1698d07d-e63b-4b1b-90f3-e9630bbfdbe3 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15476529'] for port, after_update {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:54.716198 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-3a3ee8af-1471-47e1-9a8a-5341514849c7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:43:54.765884 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54ec1e38-d17d-4198-a9e8-eca6c7965e41 req-1698d07d-e63b-4b1b-90f3-e9630bbfdbe3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:54.766488 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [req-54ec1e38-d17d-4198-a9e8-eca6c7965e41 req-1698d07d-e63b-4b1b-90f3-e9630bbfdbe3 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-239387', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for port, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:43:54.767853 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-54ec1e38-d17d-4198-a9e8-eca6c7965e41 req-1698d07d-e63b-4b1b-90f3-e9630bbfdbe3 service neutron] 10.222.0.125 "PUT /v2.0/ports/5c96172a-06f4-41ce-b47a-f1bbde47e41c HTTP/1.1" status: 200  len: 1093 time: 1.2839899
May 25 17:43:54.768328 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '00d13d2c-33fc-42ec-a80d-4cd8155b6fe1', 'tag': '5c96172a-06f4-41ce-b47a-f1bbde47e41c'}] {{(pid=99026) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 17:43:54.801862 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1698d07d-e63b-4b1b-90f3-e9630bbfdbe3 service neutron] Pushing event updated for resources: {'Port': ['ID=5c96172a-06f4-41ce-b47a-f1bbde47e41c,revision_number=3']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:43:54.816517 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-1698d07d-e63b-4b1b-90f3-e9630bbfdbe3 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.098s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:43:54.822757 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '00d13d2c-33fc-42ec-a80d-4cd8155b6fe1', 'tag': '5c96172a-06f4-41ce-b47a-f1bbde47e41c', 'status': 'completed', 'code': 200}
May 25 17:43:55.134439 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afde81e6-5a34-4232-98dc-6423d8219660 req-0435ea73-e15b-48c4-afe8-40e6b18e8b06 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:55.135934 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-afde81e6-5a34-4232-98dc-6423d8219660 req-0435ea73-e15b-48c4-afe8-40e6b18e8b06 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.122 "GET /v2.0/ports?device_id=00d13d2c-33fc-42ec-a80d-4cd8155b6fe1 HTTP/1.1" status: 200  len: 943 time: 0.0856156
May 25 17:43:55.183247 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-afde81e6-5a34-4232-98dc-6423d8219660 req-89212fdc-c602-4523-b86b-9ce2bd9c0d99 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Synchronizing usage tracker for tenant:cf02997eda314aee8fb322add2fbb921 on resource:security_group {{(pid=99027) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 17:43:55.195529 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-afde81e6-5a34-4232-98dc-6423d8219660 req-89212fdc-c602-4523-b86b-9ce2bd9c0d99 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Unset dirty status for tenant:cf02997eda314aee8fb322add2fbb921 on resource:security_group {{(pid=99027) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 17:43:55.196634 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-afde81e6-5a34-4232-98dc-6423d8219660 req-89212fdc-c602-4523-b86b-9ce2bd9c0d99 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.122 "GET /v2.0/security-groups?id=fa654e78-f61f-461b-b301-3690d1826946&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0550313
May 25 17:43:55.876204 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5360a2c7-f3d3-47cc-ba9f-95399835590c req-d0a175c5-47ce-4dce-b7d7-f0f3cafa2142 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:55.877711 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-5360a2c7-f3d3-47cc-ba9f-95399835590c req-d0a175c5-47ce-4dce-b7d7-f0f3cafa2142 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=78a85fac-d281-494d-90da-a47ddc8255e5 HTTP/1.1" status: 200  len: 945 time: 0.0841787
May 25 17:43:55.936428 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-5360a2c7-f3d3-47cc-ba9f-95399835590c req-124a4e7c-9e4e-4c80-8589-53396917a500 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0486002
May 25 17:43:56.387703 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc3ff423-5444-4588-9939-3dfd8d41b632 req-82a064ce-e3e3-4490-9fa5-726af79be355 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:56.389241 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-fc3ff423-5444-4588-9939-3dfd8d41b632 req-82a064ce-e3e3-4490-9fa5-726af79be355 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.122 "GET /v2.0/ports?device_id=00d13d2c-33fc-42ec-a80d-4cd8155b6fe1 HTTP/1.1" status: 200  len: 943 time: 0.0818224
May 25 17:43:56.433948 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-fc3ff423-5444-4588-9939-3dfd8d41b632 req-4a1d46c0-19f6-47f5-bc79-3518dbb60020 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.122 "GET /v2.0/security-groups?id=fa654e78-f61f-461b-b301-3690d1826946&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0390930
May 25 17:43:56.933883 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-476f2bf6-fbf6-492a-9f3f-f898b08e5284 req-6576b473-6dba-4354-bbc5-0c31afc5aee2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:56.935171 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-476f2bf6-fbf6-492a-9f3f-f898b08e5284 req-6576b473-6dba-4354-bbc5-0c31afc5aee2 service neutron] 10.222.0.125 "GET /v2.0/ports?tenant_id=cf02997eda314aee8fb322add2fbb921&device_id=00d13d2c-33fc-42ec-a80d-4cd8155b6fe1 HTTP/1.1" status: 200  len: 1096 time: 0.0756121
May 25 17:43:57.088966 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-476f2bf6-fbf6-492a-9f3f-f898b08e5284 req-49e7d7e0-2345-4dbf-ba28-233f79e2b226 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:57.090676 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-476f2bf6-fbf6-492a-9f3f-f898b08e5284 req-49e7d7e0-2345-4dbf-ba28-233f79e2b226 service neutron] 10.222.0.125 "GET /v2.0/networks?tenant_id=cf02997eda314aee8fb322add2fbb921&shared=False HTTP/1.1" status: 200  len: 919 time: 0.1482036
May 25 17:43:57.136312 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a2de94a-3455-4008-a43e-6fe974dece7d req-d98f6cb9-49fc-4c7f-b0b4-4a34de6569c0 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:57.137798 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-1a2de94a-3455-4008-a43e-6fe974dece7d req-d98f6cb9-49fc-4c7f-b0b4-4a34de6569c0 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=78a85fac-d281-494d-90da-a47ddc8255e5 HTTP/1.1" status: 200  len: 945 time: 0.0884790
May 25 17:43:57.196017 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-1a2de94a-3455-4008-a43e-6fe974dece7d req-1bb95c84-7cf7-4f40-8ba1-89bbbd845256 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0460303
May 25 17:43:57.229507 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-476f2bf6-fbf6-492a-9f3f-f898b08e5284 req-ac5fa73b-3eb1-42be-bb05-80af0cbff328 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:57.230936 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-476f2bf6-fbf6-492a-9f3f-f898b08e5284 req-ac5fa73b-3eb1-42be-bb05-80af0cbff328 service neutron] 10.222.0.125 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 871 time: 0.1356151
May 25 17:43:57.339775 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54ec1e38-d17d-4198-a9e8-eca6c7965e41 req-bfb7312b-935f-4500-ae97-464766aa8e11 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:57.341419 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-54ec1e38-d17d-4198-a9e8-eca6c7965e41 req-bfb7312b-935f-4500-ae97-464766aa8e11 service neutron] 10.222.0.125 "GET /v2.0/ports?tenant_id=cf02997eda314aee8fb322add2fbb921&device_id=00d13d2c-33fc-42ec-a80d-4cd8155b6fe1 HTTP/1.1" status: 200  len: 1096 time: 0.0714247
May 25 17:43:57.627910 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03ee8246-d9cc-48a8-ab1e-37ffbbc89f1b req-c9e112f7-a96a-4e5c-9e31-fb5fd67142f8 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:57.629397 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-03ee8246-d9cc-48a8-ab1e-37ffbbc89f1b req-c9e112f7-a96a-4e5c-9e31-fb5fd67142f8 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.122 "GET /v2.0/ports?device_id=00d13d2c-33fc-42ec-a80d-4cd8155b6fe1 HTTP/1.1" status: 200  len: 943 time: 0.0830724
May 25 17:43:57.676662 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-03ee8246-d9cc-48a8-ab1e-37ffbbc89f1b req-8f9e6010-9f6f-42de-a422-dbb433f671ec tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.122 "GET /v2.0/security-groups?id=fa654e78-f61f-461b-b301-3690d1826946&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0413558
May 25 17:43:58.372381 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-523353fe-9128-4c0a-817a-7acea4c00e99 req-efeecd07-f594-4b82-bc77-850e7c4091a1 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:58.373860 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-523353fe-9128-4c0a-817a-7acea4c00e99 req-efeecd07-f594-4b82-bc77-850e7c4091a1 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=78a85fac-d281-494d-90da-a47ddc8255e5 HTTP/1.1" status: 200  len: 945 time: 0.0805528
May 25 17:43:58.418526 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-523353fe-9128-4c0a-817a-7acea4c00e99 req-115c7b17-96a8-4681-9bfa-62128f8c058c tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0390079
May 25 17:43:58.923854 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-54ec1e38-d17d-4198-a9e8-eca6c7965e41 req-3c220730-4d7b-480a-a0e4-a4eee4458626 service neutron] 10.222.0.125 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=5c96172a-06f4-41ce-b47a-f1bbde47e41c HTTP/1.1" status: 200  len: 217 time: 0.1686492
May 25 17:43:58.966480 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f8ddfe9-e86d-4602-afd9-d350ab5cfe8f req-fd034498-c9ba-44dd-9fa4-c454283272d8 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:58.967828 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-7f8ddfe9-e86d-4602-afd9-d350ab5cfe8f req-fd034498-c9ba-44dd-9fa4-c454283272d8 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.122 "GET /v2.0/ports?device_id=00d13d2c-33fc-42ec-a80d-4cd8155b6fe1 HTTP/1.1" status: 200  len: 943 time: 0.0902841
May 25 17:43:59.014475 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-7f8ddfe9-e86d-4602-afd9-d350ab5cfe8f req-e9706f67-9ade-4383-be93-f4698b2d402e tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.122 "GET /v2.0/security-groups?id=fa654e78-f61f-461b-b301-3690d1826946&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0410428
May 25 17:43:59.660523 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be43bc48-f4c5-4e5c-8904-ae017f09deb4 req-5ac2aa1e-56bb-47c6-be72-343fceda728f tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:59.662752 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-be43bc48-f4c5-4e5c-8904-ae017f09deb4 req-5ac2aa1e-56bb-47c6-be72-343fceda728f tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=78a85fac-d281-494d-90da-a47ddc8255e5 HTTP/1.1" status: 200  len: 945 time: 0.1398070
May 25 17:43:59.684093 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54ec1e38-d17d-4198-a9e8-eca6c7965e41 req-418bc838-db88-40ea-aba2-e3bde8a56fb8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:59.685764 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-54ec1e38-d17d-4198-a9e8-eca6c7965e41 req-418bc838-db88-40ea-aba2-e3bde8a56fb8 service neutron] 10.222.0.125 "GET /v2.0/subnets?id=704d0a85-ee4f-4df2-90a3-a525dfe28461 HTTP/1.1" status: 200  len: 856 time: 0.0957165
May 25 17:43:59.756335 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-be43bc48-f4c5-4e5c-8904-ae017f09deb4 req-3148b72a-d34a-4598-90b9-39299790ad34 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0866523
May 25 17:43:59.779785 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54ec1e38-d17d-4198-a9e8-eca6c7965e41 req-a7758e91-87bc-4aba-a703-9aff1e52b62b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:43:59.781280 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-54ec1e38-d17d-4198-a9e8-eca6c7965e41 req-a7758e91-87bc-4aba-a703-9aff1e52b62b service neutron] 10.222.0.125 "GET /v2.0/ports?network_id=45b850af-d423-458a-855a-d7f828a11fff&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0902805
May 25 17:43:59.913857 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-54ec1e38-d17d-4198-a9e8-eca6c7965e41 req-bb599e77-0fe4-4797-999e-acfb4e4a7c66 service neutron] 10.222.0.125 "GET /v2.0/networks/45b850af-d423-458a-855a-d7f828a11fff?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1261821
May 25 17:44:00.048899 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-54ec1e38-d17d-4198-a9e8-eca6c7965e41 req-5381574f-0024-4d91-a70f-3e689edf1028 service neutron] 10.222.0.125 "GET /v2.0/networks/45b850af-d423-458a-855a-d7f828a11fff?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1296198
May 25 17:44:00.209786 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-459e5ad1-0a6f-4dd8-b63d-758451d0ac26 req-9dc80cfe-6f4a-4b07-864b-e49707c3bc0d tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:00.211254 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-459e5ad1-0a6f-4dd8-b63d-758451d0ac26 req-9dc80cfe-6f4a-4b07-864b-e49707c3bc0d tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.122 "GET /v2.0/ports?device_id=00d13d2c-33fc-42ec-a80d-4cd8155b6fe1 HTTP/1.1" status: 200  len: 943 time: 0.0793686
May 25 17:44:00.258002 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-459e5ad1-0a6f-4dd8-b63d-758451d0ac26 req-5e2b6db6-1b97-4e04-8b31-bca23939d422 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.122 "GET /v2.0/security-groups?id=fa654e78-f61f-461b-b301-3690d1826946&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0402789
May 25 17:44:00.948506 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d603b827-7bd5-4861-b44a-48d4bc1da68d req-27b3f4e4-0dc6-4af5-b3f3-b73de3996917 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:00.950024 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-d603b827-7bd5-4861-b44a-48d4bc1da68d req-27b3f4e4-0dc6-4af5-b3f3-b73de3996917 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=78a85fac-d281-494d-90da-a47ddc8255e5 HTTP/1.1" status: 200  len: 945 time: 0.0872302
May 25 17:44:00.997623 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-d603b827-7bd5-4861-b44a-48d4bc1da68d req-4316498b-2774-4ad1-b592-40a5617413d8 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0406229
May 25 17:44:01.444274 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9a35434-da95-41da-83f7-539c97b04ed5 req-e8d95162-cdfc-4029-a013-df9ae3e1fb9a tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:01.445790 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-e9a35434-da95-41da-83f7-539c97b04ed5 req-e8d95162-cdfc-4029-a013-df9ae3e1fb9a tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.122 "GET /v2.0/ports?device_id=00d13d2c-33fc-42ec-a80d-4cd8155b6fe1 HTTP/1.1" status: 200  len: 943 time: 0.0795627
May 25 17:44:01.495625 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-e9a35434-da95-41da-83f7-539c97b04ed5 req-c65348f0-6abe-4ffc-a3e4-e74a66bbdac6 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.122 "GET /v2.0/security-groups?id=fa654e78-f61f-461b-b301-3690d1826946&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0421925
May 25 17:44:02.229565 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c63387b-2132-4d33-ab4f-c12e9f439fda req-7daf29ae-84dd-4044-acd8-9d07af56dfdd tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:02.230961 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-0c63387b-2132-4d33-ab4f-c12e9f439fda req-7daf29ae-84dd-4044-acd8-9d07af56dfdd tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=78a85fac-d281-494d-90da-a47ddc8255e5 HTTP/1.1" status: 200  len: 945 time: 0.1258326
May 25 17:44:02.277276 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-0c63387b-2132-4d33-ab4f-c12e9f439fda req-b98a28ee-036f-4e5e-8070-b8f295fa0988 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0407028
May 25 17:44:02.686264 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64740dbb-336b-4a81-a5d3-588b3307cb51 req-72f1390a-14a9-446d-a4e7-f6c7309b3ef6 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:02.687733 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-64740dbb-336b-4a81-a5d3-588b3307cb51 req-72f1390a-14a9-446d-a4e7-f6c7309b3ef6 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.122 "GET /v2.0/ports?device_id=00d13d2c-33fc-42ec-a80d-4cd8155b6fe1 HTTP/1.1" status: 200  len: 943 time: 0.0827169
May 25 17:44:02.732659 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-64740dbb-336b-4a81-a5d3-588b3307cb51 req-faaf4bfe-e0c6-48a5-80c9-8cff4fb4d580 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.122 "GET /v2.0/security-groups?id=fa654e78-f61f-461b-b301-3690d1826946&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0386887
May 25 17:44:03.473986 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5113a3e-4522-4509-a4f1-4e7c650e9385 req-0520a774-a608-434a-bad7-f25c34d4eb6c tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:03.475613 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-d5113a3e-4522-4509-a4f1-4e7c650e9385 req-0520a774-a608-434a-bad7-f25c34d4eb6c tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=78a85fac-d281-494d-90da-a47ddc8255e5 HTTP/1.1" status: 200  len: 945 time: 0.0900364
May 25 17:44:03.525724 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-d5113a3e-4522-4509-a4f1-4e7c650e9385 req-dda03285-9c56-4863-8324-1af944c99ada tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0438573
May 25 17:44:03.926997 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc6a6554-6d9c-44f3-809b-ab14009e6fa4 req-736d824d-6f50-4bec-b239-453dfb352873 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:03.929439 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-bc6a6554-6d9c-44f3-809b-ab14009e6fa4 req-736d824d-6f50-4bec-b239-453dfb352873 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.122 "GET /v2.0/ports?device_id=00d13d2c-33fc-42ec-a80d-4cd8155b6fe1 HTTP/1.1" status: 200  len: 943 time: 0.0852947
May 25 17:44:03.974808 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-bc6a6554-6d9c-44f3-809b-ab14009e6fa4 req-c19bb444-6a54-469e-bdd6-a3aea2b4e5bb tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.122 "GET /v2.0/security-groups?id=fa654e78-f61f-461b-b301-3690d1826946&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0395069
May 25 17:44:04.615108 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff47e483-5b7f-4416-82eb-6e94c3688d20 req-e3fc6cba-7574-4c52-99f8-3e8261363b89 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:04.616736 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-ff47e483-5b7f-4416-82eb-6e94c3688d20 req-e3fc6cba-7574-4c52-99f8-3e8261363b89 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/networks?id=6c7eca3b-72f3-4ba8-9e95-614d64496512 HTTP/1.1" status: 200  len: 814 time: 0.1620984
May 25 17:44:04.638797 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-ff47e483-5b7f-4416-82eb-6e94c3688d20 req-c91773d4-7983-444d-9b0b-8a04ae5fe9ac tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/quotas/5ae575cfd07c4a88aa626c15e6bccfd9 HTTP/1.1" status: 200  len: 375 time: 0.0097349
May 25 17:44:04.750533 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-ff47e483-5b7f-4416-82eb-6e94c3688d20 req-d9a8c11c-8b69-4eaa-8d89-2e225e3ab56d tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/ports?tenant_id=5ae575cfd07c4a88aa626c15e6bccfd9&fields=id HTTP/1.1" status: 200  len: 302 time: 0.1124284
May 25 17:44:04.779216 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c073a50a-7b39-41ec-8026-b08257631824 req-1fd5c8fc-5259-48f5-b988-4ad7ba52ad8d tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:04.788970 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-c073a50a-7b39-41ec-8026-b08257631824 req-1fd5c8fc-5259-48f5-b988-4ad7ba52ad8d tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=78a85fac-d281-494d-90da-a47ddc8255e5 HTTP/1.1" status: 200  len: 945 time: 0.1301739
May 25 17:44:04.851158 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-c073a50a-7b39-41ec-8026-b08257631824 req-567462ae-507f-4351-b220-bff95da65625 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0608590
May 25 17:44:05.028597 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-ff47e483-5b7f-4416-82eb-6e94c3688d20 req-bddf6768-2e16-4ac9-a14d-a090cf72b68c service neutron] 10.222.0.122 "GET /v2.0/networks/6c7eca3b-72f3-4ba8-9e95-614d64496512?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2774801
May 25 17:44:05.040046 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2eae4b9-9e2e-4c8e-ac30-6281fee5ab23 req-96026a0d-9756-4aa6-ac93-b2e0e6b61917 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:05.042432 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-b2eae4b9-9e2e-4c8e-ac30-6281fee5ab23 req-96026a0d-9756-4aa6-ac93-b2e0e6b61917 service neutron] 10.222.0.125 "GET /v2.0/ports?device_id=78a85fac-d281-494d-90da-a47ddc8255e5 HTTP/1.1" status: 200  len: 1098 time: 0.1366365
May 25 17:44:05.099500 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-b2eae4b9-9e2e-4c8e-ac30-6281fee5ab23 req-aaa380b1-e8d0-486a-bba4-878458a7b1bb service neutron] 10.222.0.125 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0499015
May 25 17:44:05.188990 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-ff47e483-5b7f-4416-82eb-6e94c3688d20 req-6da54e8e-50aa-4e25-a562-2d691087fdd6 service neutron] 10.222.0.122 "GET /v2.0/networks/6c7eca3b-72f3-4ba8-9e95-614d64496512?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1525934
May 25 17:44:05.222776 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a04c38c-02dd-4bcf-89f7-6b2515ca8462 req-45a982b5-df4b-40d7-bf02-bfee39b5c5a0 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:05.239360 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-3a04c38c-02dd-4bcf-89f7-6b2515ca8462 req-45a982b5-df4b-40d7-bf02-bfee39b5c5a0 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.122 "GET /v2.0/ports?device_id=00d13d2c-33fc-42ec-a80d-4cd8155b6fe1 HTTP/1.1" status: 200  len: 943 time: 0.0990183
May 25 17:44:05.292241 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-3a04c38c-02dd-4bcf-89f7-6b2515ca8462 req-f93dbefe-d0dd-4fc3-9612-e7e3050850f1 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.122 "GET /v2.0/security-groups?id=fa654e78-f61f-461b-b301-3690d1826946&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0599544
May 25 17:44:05.518059 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-fa646a1a-11c6-4299-bc7d-92b854cfa6e9 req-83ab2ab7-7667-41ef-9369-5789fb670c27 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/ports?device_id=292a3490-b43c-4640-bb5e-75df7d772b03 HTTP/1.1" status: 200  len: 210 time: 0.0452576
May 25 17:44:05.580582 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 43058) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:44:05.709808 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-92aa0bc3-1a23-4832-8ed7-25ad4b99d539 admin admin] Notify callbacks [] for security_group, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:05.726585 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-92aa0bc3-1a23-4832-8ed7-25ad4b99d539 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:44:05.732700 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-92aa0bc3-1a23-4832-8ed7-25ad4b99d539 admin admin] Usage tracker for resource:security_group_rule and tenant:770d526af6fe4356874fd63ed9bc6f55 is out of sync, need to count used quota {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:44:05.736564 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-92aa0bc3-1a23-4832-8ed7-25ad4b99d539 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:44:05.744621 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-92aa0bc3-1a23-4832-8ed7-25ad4b99d539 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:44:05.826483 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-92aa0bc3-1a23-4832-8ed7-25ad4b99d539 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:05.885435 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-92aa0bc3-1a23-4832-8ed7-25ad4b99d539 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:05.894964 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:44:05.945745 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-92aa0bc3-1a23-4832-8ed7-25ad4b99d539 admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=770d526af6fe4356874fd63ed9bc6f55&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3578522
May 25 17:44:05.945745 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92aa0bc3-1a23-4832-8ed7-25ad4b99d539 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4df7c83b-a1cf-4381-b7dc-dfffd29fa3cd,revision_number=1']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:44:05.945745 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 43070) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:44:05.992947 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-92aa0bc3-1a23-4832-8ed7-25ad4b99d539 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.098s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:44:06.018566 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Device 5c96172a-06f4-41ce-b47a-f1bbde47e41c details requested by agent hyperv_hv-cinder-78956 with host hv-cinder-78956 {{(pid=99028) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 25 17:44:06.025644 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-1db69526-beb4-4583-b426-7e936505ce3c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:06.080470 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-1db69526-beb4-4583-b426-7e936505ce3c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:06.214905 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fed83c3-f19d-4f9c-b5a2-30f1d315ba4d req-c6e2a135-34c2-4c27-ba6d-2649db9e542a tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:06.216652 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-8fed83c3-f19d-4f9c-b5a2-30f1d315ba4d req-c6e2a135-34c2-4c27-ba6d-2649db9e542a tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=78a85fac-d281-494d-90da-a47ddc8255e5 HTTP/1.1" status: 200  len: 945 time: 0.2470577
May 25 17:44:06.252299 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] For port 5c96172a-06f4-41ce-b47a-f1bbde47e41c, host hv-cinder-78956, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=5c96172a-06f4-41ce-b47a-f1bbde47e41c,segment=NetworkSegment(e9a4953c-bd2f-4412-9030-8eb2cd20f5c5),segment_id=e9a4953c-bd2f-4412-9030-8eb2cd20f5c5)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:44:06.256964 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-1db69526-beb4-4583-b426-7e936505ce3c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:06.260673 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-64a436ed-5b64-426e-8449-fdfb20edc6d3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:44:06.271463 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1db69526-beb4-4583-b426-7e936505ce3c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4df7c83b-a1cf-4381-b7dc-dfffd29fa3cd,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:44:06.274815 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-1db69526-beb4-4583-b426-7e936505ce3c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.014s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:44:06.279614 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-1db69526-beb4-4583-b426-7e936505ce3c admin admin] Notify callbacks [] for security_group, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:06.280715 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-1db69526-beb4-4583-b426-7e936505ce3c admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/4df7c83b-a1cf-4381-b7dc-dfffd29fa3cd HTTP/1.1" status: 204  len: 168 time: 0.3368413
May 25 17:44:06.283314 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Returning: {'device': '5c96172a-06f4-41ce-b47a-f1bbde47e41c', 'network_id': '45b850af-d423-458a-855a-d7f828a11fff', 'port_id': '5c96172a-06f4-41ce-b47a-f1bbde47e41c', 'mac_address': 'fa:16:3e:70:94:8e', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1318, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '704d0a85-ee4f-4df2-90a3-a525dfe28461', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=99028) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 25 17:44:06.296271 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-8fed83c3-f19d-4f9c-b5a2-30f1d315ba4d req-986a0935-943e-4274-85bd-86469408a55d tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0735214
May 25 17:44:06.377007 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:06.396733 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.notifiers.nova [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 5c96172a-06f4-41ce-b47a-f1bbde47e41c {{(pid=99028) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 25 17:44:06.419511 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] For port 5c96172a-06f4-41ce-b47a-f1bbde47e41c, host hv-cinder-78956, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=5c96172a-06f4-41ce-b47a-f1bbde47e41c,segment=NetworkSegment(e9a4953c-bd2f-4412-9030-8eb2cd20f5c5),segment_id=e9a4953c-bd2f-4412-9030-8eb2cd20f5c5)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:44:06.471672 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:06.473446 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:44:06.524777 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b2828bf-5b1e-40e8-be8f-96941d59e62a req-d4e2fe2f-b27a-4fba-bc8a-81ea84e349cd tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:06.526644 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-8b2828bf-5b1e-40e8-be8f-96941d59e62a req-d4e2fe2f-b27a-4fba-bc8a-81ea84e349cd tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.122 "GET /v2.0/ports?device_id=00d13d2c-33fc-42ec-a80d-4cd8155b6fe1 HTTP/1.1" status: 200  len: 944 time: 0.0846961
May 25 17:44:06.574979 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Pushing event updated for resources: {'Port': ['ID=5c96172a-06f4-41ce-b47a-f1bbde47e41c,revision_number=4']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:44:06.581895 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.105s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:44:06.589187 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-8b2828bf-5b1e-40e8-be8f-96941d59e62a req-80050c9a-94ed-4214-bc7b-fc6b613c9804 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.122 "GET /v2.0/security-groups?id=fa654e78-f61f-461b-b301-3690d1826946&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0550573
May 25 17:44:06.691850 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-939dd39a-ba4e-4f74-be5b-4d037982d0f2 req-85b8f452-e037-45aa-8f6f-732d99cd56ac tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/ports?device_id=292a3490-b43c-4640-bb5e-75df7d772b03 HTTP/1.1" status: 200  len: 210 time: 0.0451405
May 25 17:44:06.784281 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] get_ports_and_sgs() called for port_ids ['5c96172a-06f4-41ce-b47a-f1bbde47e41c'] {{(pid=99028) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 25 17:44:07.533054 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5aa3974d-4e3f-40b4-af8e-560a2f48bf6f req-b7a2001d-e95f-45fe-81a1-fc8e67b5af92 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:07.535060 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-5aa3974d-4e3f-40b4-af8e-560a2f48bf6f req-b7a2001d-e95f-45fe-81a1-fc8e67b5af92 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=78a85fac-d281-494d-90da-a47ddc8255e5 HTTP/1.1" status: 200  len: 945 time: 0.0957558
May 25 17:44:07.595529 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-5aa3974d-4e3f-40b4-af8e-560a2f48bf6f req-428fedec-d853-4e46-85f6-813e14d13c2b tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0519567
May 25 17:44:07.646333 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 43134) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:44:07.825660 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-f4e73b4e-7a12-4522-b416-9750c9cf01b5 admin admin] Notify callbacks [] for security_group, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:07.843306 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8255d7f9-c5bb-4fea-9c30-24a384c6324b req-396276e6-a9a4-4f31-98e6-19139780cc3d tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:07.845148 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-8255d7f9-c5bb-4fea-9c30-24a384c6324b req-396276e6-a9a4-4f31-98e6-19139780cc3d tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=432d7a94-0218-4907-bc7c-650f24a5b1e1 HTTP/1.1" status: 200  len: 945 time: 0.1170771
May 25 17:44:07.851998 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-f4e73b4e-7a12-4522-b416-9750c9cf01b5 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:44:07.875804 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-f4e73b4e-7a12-4522-b416-9750c9cf01b5 admin admin] Usage tracker for resource:security_group_rule and tenant:49c9ff0a77484223b3ec851283219c24 is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:44:07.879969 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-f4e73b4e-7a12-4522-b416-9750c9cf01b5 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:44:07.893009 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-f4e73b4e-7a12-4522-b416-9750c9cf01b5 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:44:07.943253 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7fb6e744-6e0c-45c7-8110-ea29ba486d2b req-bba6bf94-8931-4a62-94fa-e3b757b9561c tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:07.950585 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-7fb6e744-6e0c-45c7-8110-ea29ba486d2b req-bba6bf94-8931-4a62-94fa-e3b757b9561c tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.122 "GET /v2.0/ports?device_id=00d13d2c-33fc-42ec-a80d-4cd8155b6fe1 HTTP/1.1" status: 200  len: 944 time: 0.2023356
May 25 17:44:08.034101 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-7fb6e744-6e0c-45c7-8110-ea29ba486d2b req-52e26085-8a29-4866-8917-036a9b34da4d tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.122 "GET /v2.0/security-groups?id=fa654e78-f61f-461b-b301-3690d1826946&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0783565
May 25 17:44:08.034429 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Device 5c96172a-06f4-41ce-b47a-f1bbde47e41c up at agent hyperv_hv-cinder-78956 {{(pid=99028) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 17:44:08.117503 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-8255d7f9-c5bb-4fea-9c30-24a384c6324b req-cd2ae5fc-32f6-4d22-bc79-3f25c6226aa4 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2650251
May 25 17:44:08.160675 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-f4e73b4e-7a12-4522-b416-9750c9cf01b5 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:08.196442 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff47e483-5b7f-4416-82eb-6e94c3688d20 req-c33e9dc6-f4c5-44c9-8402-0a2c17043a5d tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:08.198002 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-ff47e483-5b7f-4416-82eb-6e94c3688d20 req-c33e9dc6-f4c5-44c9-8402-0a2c17043a5d tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.125 "GET /v2.0/networks?id=6c7eca3b-72f3-4ba8-9e95-614d64496512 HTTP/1.1" status: 200  len: 814 time: 0.3266511
May 25 17:44:08.210929 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.v2.base [req-ff47e483-5b7f-4416-82eb-6e94c3688d20 req-d3114731-2418-4131-86c3-d050ff11c3bb tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Request body: {'port': {'device_id': '292a3490-b43c-4640-bb5e-75df7d772b03', 'network_id': '6c7eca3b-72f3-4ba8-9e95-614d64496512', 'admin_state_up': True, 'tenant_id': '5ae575cfd07c4a88aa626c15e6bccfd9'}} {{(pid=99026) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:44:08.227555 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-f4e73b4e-7a12-4522-b416-9750c9cf01b5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:08.242755 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-6eba753c-d73e-4f1b-a0f8-376e2e776da7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:44:08.257802 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-41d97fa3-78ab-477e-ad7c-34b529416b10 req-12cd0c2a-7c17-4795-938a-4acb81402da1 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/ports?device_id=292a3490-b43c-4640-bb5e-75df7d772b03 HTTP/1.1" status: 200  len: 210 time: 0.0687933
May 25 17:44:08.285777 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Provisioning for port 5c96172a-06f4-41ce-b47a-f1bbde47e41c completed by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 17:44:08.291846 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Provisioning complete for port 5c96172a-06f4-41ce-b47a-f1bbde47e41c triggered by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 17:44:08.293608 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:08.311825 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-f4e73b4e-7a12-4522-b416-9750c9cf01b5 admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=49c9ff0a77484223b3ec851283219c24&name=default HTTP/1.1" status: 200  len: 2979 time: 0.6643231
May 25 17:44:08.312604 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 43150) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:44:08.365619 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4e73b4e-7a12-4522-b416-9750c9cf01b5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=471c4679-fb6b-48b3-8b79-d43992f6bdca,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:44:08.372830 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-f4e73b4e-7a12-4522-b416-9750c9cf01b5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.130s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:44:08.466455 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [req-ff47e483-5b7f-4416-82eb-6e94c3688d20 req-d3114731-2418-4131-86c3-d050ff11c3bb tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:44:08.483695 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [req-ff47e483-5b7f-4416-82eb-6e94c3688d20 req-d3114731-2418-4131-86c3-d050ff11c3bb tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:44:08.495561 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-a57f519c-3996-475b-93f8-133e651d9db7 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:08.530923 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-a57f519c-3996-475b-93f8-133e651d9db7 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:08.545519 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:08.571939 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-ff47e483-5b7f-4416-82eb-6e94c3688d20 req-d3114731-2418-4131-86c3-d050ff11c3bb tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Made reservation on behalf of 5ae575cfd07c4a88aa626c15e6bccfd9 for: {'port': 1} {{(pid=99026) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 17:44:08.575566 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '00d13d2c-33fc-42ec-a80d-4cd8155b6fe1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5c96172a-06f4-41ce-b47a-f1bbde47e41c'}] {{(pid=99028) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 17:44:08.576430 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [req-ff47e483-5b7f-4416-82eb-6e94c3688d20 req-d3114731-2418-4131-86c3-d050ff11c3bb tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:08.586215 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] For port 5c96172a-06f4-41ce-b47a-f1bbde47e41c, host hv-cinder-78956, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=5c96172a-06f4-41ce-b47a-f1bbde47e41c,segment=NetworkSegment(e9a4953c-bd2f-4412-9030-8eb2cd20f5c5),segment_id=e9a4953c-bd2f-4412-9030-8eb2cd20f5c5)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:44:08.623682 dv-cinder-789564-2-iscsi neutron-server[99028]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '00d13d2c-33fc-42ec-a80d-4cd8155b6fe1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5c96172a-06f4-41ce-b47a-f1bbde47e41c', 'code': 200}
May 25 17:44:08.645596 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-a57f519c-3996-475b-93f8-133e651d9db7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:08.646204 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:08.648832 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:44:08.652182 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-2af4c851-e702-4a5c-a090-06cd9da857c4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:44:08.668514 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a57f519c-3996-475b-93f8-133e651d9db7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=471c4679-fb6b-48b3-8b79-d43992f6bdca,revision_number=None']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:44:08.678081 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-a57f519c-3996-475b-93f8-133e651d9db7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:44:08.681308 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-a57f519c-3996-475b-93f8-133e651d9db7 admin admin] Notify callbacks [] for security_group, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:08.684885 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-a57f519c-3996-475b-93f8-133e651d9db7 admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/471c4679-fb6b-48b3-8b79-d43992f6bdca HTTP/1.1" status: 204  len: 168 time: 0.3552346
May 25 17:44:08.749743 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Pushing event updated for resources: {'Port': ['ID=5c96172a-06f4-41ce-b47a-f1bbde47e41c,revision_number=5']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:44:08.753256 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.104s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:44:08.772287 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.db_base_plugin_common [req-ff47e483-5b7f-4416-82eb-6e94c3688d20 req-d3114731-2418-4131-86c3-d050ff11c3bb tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Allocated IP 172.20.0.8 (6c7eca3b-72f3-4ba8-9e95-614d64496512/279772c8-d366-4fc6-9c34-e6ddf99b5e08/db138deb-607b-422a-8726-ecea43965047) {{(pid=99026) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 17:44:09.014562 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [req-ff47e483-5b7f-4416-82eb-6e94c3688d20 req-d3114731-2418-4131-86c3-d050ff11c3bb tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Notify callbacks [] for port, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:09.103572 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [req-ff47e483-5b7f-4416-82eb-6e94c3688d20 req-d3114731-2418-4131-86c3-d050ff11c3bb tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781840788179', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15476536'] for port, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:09.109171 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-b77e4b1c-86cc-4a74-80f7-6be7e53762d1 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:44:09.180182 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-ff47e483-5b7f-4416-82eb-6e94c3688d20 req-d3114731-2418-4131-86c3-d050ff11c3bb tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Network 6c7eca3b-72f3-4ba8-9e95-614d64496512 is already hosted by enough agents. {{(pid=99026) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 17:44:09.182715 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.scheduler.base_scheduler [req-ff47e483-5b7f-4416-82eb-6e94c3688d20 req-d3114731-2418-4131-86c3-d050ff11c3bb tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Resources bound (agent type, host, resource id):  {{(pid=99026) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 17:44:09.186692 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.l3_dvrscheduler_db [req-ff47e483-5b7f-4416-82eb-6e94c3688d20 req-d3114731-2418-4131-86c3-d050ff11c3bb tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Received port after_create {{(pid=99026) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 17:44:09.221773 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3114731-2418-4131-86c3-d050ff11c3bb tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Pushing event updated for resources: {'Port': ['ID=db138deb-607b-422a-8726-ecea43965047,revision_number=1']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:44:09.226822 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-d3114731-2418-4131-86c3-d050ff11c3bb tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.118s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:44:09.254468 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff47e483-5b7f-4416-82eb-6e94c3688d20 req-d3114731-2418-4131-86c3-d050ff11c3bb tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:09.255218 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [req-ff47e483-5b7f-4416-82eb-6e94c3688d20 req-d3114731-2418-4131-86c3-d050ff11c3bb tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-239387', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for port, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:09.256961 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6bda5daa-0fbe-458b-9679-b2abc963fa41 req-edb20477-af95-406b-a870-16db71407743 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:09.259087 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-6bda5daa-0fbe-458b-9679-b2abc963fa41 req-edb20477-af95-406b-a870-16db71407743 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.122 "GET /v2.0/ports?device_id=00d13d2c-33fc-42ec-a80d-4cd8155b6fe1 HTTP/1.1" status: 200  len: 945 time: 0.0942137
May 25 17:44:09.292668 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 43174) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:44:09.306302 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-6bda5daa-0fbe-458b-9679-b2abc963fa41 req-729a9611-2d8a-4332-8101-3380b6cf8789 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.122 "GET /v2.0/security-groups?id=fa654e78-f61f-461b-b301-3690d1826946&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0409169
May 25 17:44:09.312488 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-f3e5d526-dbd9-429d-84b8-8f5bad712577 admin admin] Notify callbacks [] for security_group, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:09.325873 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-f3e5d526-dbd9-429d-84b8-8f5bad712577 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:44:09.329596 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-f3e5d526-dbd9-429d-84b8-8f5bad712577 admin admin] Usage tracker for resource:security_group_rule and tenant:bb39e39e72a74a40a8d8df323be632e8 is out of sync, need to count used quota {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:44:09.332743 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-f3e5d526-dbd9-429d-84b8-8f5bad712577 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:44:09.339608 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-f3e5d526-dbd9-429d-84b8-8f5bad712577 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:44:09.363549 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-ff47e483-5b7f-4416-82eb-6e94c3688d20 req-d3114731-2418-4131-86c3-d050ff11c3bb tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.125 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.1578374
May 25 17:44:09.444442 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-f3e5d526-dbd9-429d-84b8-8f5bad712577 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:09.491498 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-141b2444-7ef8-4090-980d-bb8779283583 req-e2babfe8-a339-4887-95bd-8c3fb2278c48 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:09.492929 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-141b2444-7ef8-4090-980d-bb8779283583 req-e2babfe8-a339-4887-95bd-8c3fb2278c48 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/ports?device_id=292a3490-b43c-4640-bb5e-75df7d772b03 HTTP/1.1" status: 200  len: 931 time: 0.0791659
May 25 17:44:09.514430 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-f3e5d526-dbd9-429d-84b8-8f5bad712577 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:09.524529 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:44:09.539052 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-141b2444-7ef8-4090-980d-bb8779283583 req-37c7e958-5e10-4231-b707-f62992557607 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/security-groups?id=dda11ec6-545c-479e-bba9-4390fea678fa&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0402453
May 25 17:44:09.580253 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-f3e5d526-dbd9-429d-84b8-8f5bad712577 admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=bb39e39e72a74a40a8d8df323be632e8&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2862217
May 25 17:44:09.581201 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3e5d526-dbd9-429d-84b8-8f5bad712577 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0ee12e03-3472-43b1-a2d9-715d1cb8381c,revision_number=1']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:44:09.582977 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 43180) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:44:09.584309 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-f3e5d526-dbd9-429d-84b8-8f5bad712577 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.060s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:44:09.644254 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-d0c7e7a2-5e03-42ba-abbc-702df09c7632 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:09.670806 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-d0c7e7a2-5e03-42ba-abbc-702df09c7632 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:09.798827 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-d0c7e7a2-5e03-42ba-abbc-702df09c7632 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:09.804773 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-d9e62ef8-202c-4c2c-8106-4aa04c9760b2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:44:09.816427 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0c7e7a2-5e03-42ba-abbc-702df09c7632 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0ee12e03-3472-43b1-a2d9-715d1cb8381c,revision_number=None']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:44:09.819434 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-d0c7e7a2-5e03-42ba-abbc-702df09c7632 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:44:09.821547 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-d0c7e7a2-5e03-42ba-abbc-702df09c7632 admin admin] Notify callbacks [] for security_group, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:09.826602 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-d0c7e7a2-5e03-42ba-abbc-702df09c7632 admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/0ee12e03-3472-43b1-a2d9-715d1cb8381c HTTP/1.1" status: 204  len: 168 time: 0.2385070
May 25 17:44:10.398655 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] get_ports_and_sgs() called for port_ids ['4698ed19-7e41-4457-a1fd-16d5f606084a', 'cd9e7667-ca15-4541-9b3a-687f6f585523'] {{(pid=99028) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 25 17:44:10.431234 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.v2.base [req-ff47e483-5b7f-4416-82eb-6e94c3688d20 req-10f4a4fe-3f29-45f5-a579-2b6360486995 service neutron] Request body: {'port': {'device_id': '292a3490-b43c-4640-bb5e-75df7d772b03', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78956'}} {{(pid=99026) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:44:10.530912 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-444ed570-2872-4ebd-8c74-f46d38d5c06e req-693e9656-0aac-4073-b8db-34d358e237a3 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:10.532551 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-444ed570-2872-4ebd-8c74-f46d38d5c06e req-693e9656-0aac-4073-b8db-34d358e237a3 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.122 "GET /v2.0/ports?device_id=00d13d2c-33fc-42ec-a80d-4cd8155b6fe1 HTTP/1.1" status: 200  len: 945 time: 0.1138656
May 25 17:44:10.592773 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [req-ff47e483-5b7f-4416-82eb-6e94c3688d20 req-10f4a4fe-3f29-45f5-a579-2b6360486995 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:10.613563 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-444ed570-2872-4ebd-8c74-f46d38d5c06e req-5eadad65-ba4c-42af-bc92-f9e403aed5ec tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.122 "GET /v2.0/security-groups?id=fa654e78-f61f-461b-b301-3690d1826946&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0696802
May 25 17:44:10.873645 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d02dbc78-f892-475a-8fa5-f3db10f68f97 req-177c4223-bd62-4e00-b1ee-e714db130a7c tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:10.874493 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [req-d02dbc78-f892-475a-8fa5-f3db10f68f97 req-177c4223-bd62-4e00-b1ee-e714db130a7c tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Synchronizing usage tracker for tenant:5ae575cfd07c4a88aa626c15e6bccfd9 on resource:port {{(pid=99026) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 17:44:10.981796 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f05f8b4a-479a-40bd-8211-5ea6bcc459e0 req-bd55f8ad-d0bb-43ea-9301-59cf29cfa39e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:10.981796 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-f05f8b4a-479a-40bd-8211-5ea6bcc459e0 req-bd55f8ad-d0bb-43ea-9301-59cf29cfa39e service neutron] 10.222.0.125 "GET /v2.0/ports?device_id=00d13d2c-33fc-42ec-a80d-4cd8155b6fe1 HTTP/1.1" status: 200  len: 1098 time: 0.1417854
May 25 17:44:11.004486 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [req-d02dbc78-f892-475a-8fa5-f3db10f68f97 req-177c4223-bd62-4e00-b1ee-e714db130a7c tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Unset dirty status for tenant:5ae575cfd07c4a88aa626c15e6bccfd9 on resource:port {{(pid=99026) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 17:44:11.005890 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-d02dbc78-f892-475a-8fa5-f3db10f68f97 req-177c4223-bd62-4e00-b1ee-e714db130a7c tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/ports?device_id=292a3490-b43c-4640-bb5e-75df7d772b03 HTTP/1.1" status: 200  len: 931 time: 0.3165894
May 25 17:44:11.028693 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-f05f8b4a-479a-40bd-8211-5ea6bcc459e0 req-6c7b6bc0-3611-43b0-ade6-33a0595d8858 service neutron] 10.222.0.125 "GET /v2.0/security-groups?id=fa654e78-f61f-461b-b301-3690d1826946&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0400372
May 25 17:44:11.092254 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-d02dbc78-f892-475a-8fa5-f3db10f68f97 req-d77de99c-9c54-4a44-ab64-43bf154a6645 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/security-groups?id=dda11ec6-545c-479e-bba9-4390fea678fa&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0637453
May 25 17:44:11.193132 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.notifiers.nova [req-ff47e483-5b7f-4416-82eb-6e94c3688d20 req-10f4a4fe-3f29-45f5-a579-2b6360486995 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id db138deb-607b-422a-8726-ecea43965047 {{(pid=99026) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 25 17:44:11.202948 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [req-ff47e483-5b7f-4416-82eb-6e94c3688d20 req-10f4a4fe-3f29-45f5-a579-2b6360486995 service neutron] Notify callbacks [] for port, precommit_update {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:11.222547 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.provisioning_blocks [req-ff47e483-5b7f-4416-82eb-6e94c3688d20 req-10f4a4fe-3f29-45f5-a579-2b6360486995 service neutron] Transition to ACTIVE for port object db138deb-607b-422a-8726-ecea43965047 will not be triggered until provisioned by entity L2. {{(pid=99026) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 17:44:11.308594 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [req-ff47e483-5b7f-4416-82eb-6e94c3688d20 req-10f4a4fe-3f29-45f5-a579-2b6360486995 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15476529'] for port, after_update {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:11.315064 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:44:11.480451 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10f4a4fe-3f29-45f5-a579-2b6360486995 service neutron] Pushing event updated for resources: {'Port': ['ID=db138deb-607b-422a-8726-ecea43965047,revision_number=2']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:44:11.484960 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:11.495804 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-10f4a4fe-3f29-45f5-a579-2b6360486995 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.181s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:44:11.581608 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.managers [req-ff47e483-5b7f-4416-82eb-6e94c3688d20 req-10f4a4fe-3f29-45f5-a579-2b6360486995 service neutron] Attempting to bind port db138deb-607b-422a-8726-ecea43965047 on host hv-cinder-78956 for vnic_type normal with profile  {{(pid=99026) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 17:44:11.581943 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.managers [req-ff47e483-5b7f-4416-82eb-6e94c3688d20 req-10f4a4fe-3f29-45f5-a579-2b6360486995 service neutron] Attempting to bind port db138deb-607b-422a-8726-ecea43965047 by drivers openvswitch,hyperv on host hv-cinder-78956 at level 0 using segments [{'id': '87df170f-54cc-461b-a7ac-79e125fc526b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1304, 'network_id': '6c7eca3b-72f3-4ba8-9e95-614d64496512'}] {{(pid=99026) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 17:44:11.582298 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ff47e483-5b7f-4416-82eb-6e94c3688d20 req-10f4a4fe-3f29-45f5-a579-2b6360486995 service neutron] Attempting to bind port db138deb-607b-422a-8726-ecea43965047 on network 6c7eca3b-72f3-4ba8-9e95-614d64496512 {{(pid=99026) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 17:44:11.587740 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ff47e483-5b7f-4416-82eb-6e94c3688d20 req-10f4a4fe-3f29-45f5-a579-2b6360486995 service neutron] Port db138deb-607b-422a-8726-ecea43965047 on network 6c7eca3b-72f3-4ba8-9e95-614d64496512 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78956 {{(pid=99026) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 25 17:44:11.588053 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ff47e483-5b7f-4416-82eb-6e94c3688d20 req-10f4a4fe-3f29-45f5-a579-2b6360486995 service neutron] Attempting to bind port db138deb-607b-422a-8726-ecea43965047 on network 6c7eca3b-72f3-4ba8-9e95-614d64496512 {{(pid=99026) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 17:44:11.593615 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ff47e483-5b7f-4416-82eb-6e94c3688d20 req-10f4a4fe-3f29-45f5-a579-2b6360486995 service neutron] Checking agent: {'id': '4d02a528-6a0e-4977-985f-4bcff1ca6cb7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78956', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 17, 40, 41), 'started_at': datetime.datetime(2021, 5, 25, 17, 40, 41), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 17, 44, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=99026) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 17:44:11.593950 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ff47e483-5b7f-4416-82eb-6e94c3688d20 req-10f4a4fe-3f29-45f5-a579-2b6360486995 service neutron] Checking segment: {'id': '87df170f-54cc-461b-a7ac-79e125fc526b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1304, 'network_id': '6c7eca3b-72f3-4ba8-9e95-614d64496512'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=99026) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 17:44:11.594325 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ff47e483-5b7f-4416-82eb-6e94c3688d20 req-10f4a4fe-3f29-45f5-a579-2b6360486995 service neutron] Bound using segment: {'id': '87df170f-54cc-461b-a7ac-79e125fc526b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1304, 'network_id': '6c7eca3b-72f3-4ba8-9e95-614d64496512'} {{(pid=99026) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 17:44:11.594747 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.managers [req-ff47e483-5b7f-4416-82eb-6e94c3688d20 req-10f4a4fe-3f29-45f5-a579-2b6360486995 service neutron] Bound port: db138deb-607b-422a-8726-ecea43965047, host: hv-cinder-78956, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '87df170f-54cc-461b-a7ac-79e125fc526b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1304, 'network_id': '6c7eca3b-72f3-4ba8-9e95-614d64496512'}}] {{(pid=99026) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 17:44:11.595089 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [req-ff47e483-5b7f-4416-82eb-6e94c3688d20 req-10f4a4fe-3f29-45f5-a579-2b6360486995 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:11.874323 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.db [req-ff47e483-5b7f-4416-82eb-6e94c3688d20 req-10f4a4fe-3f29-45f5-a579-2b6360486995 service neutron] For port db138deb-607b-422a-8726-ecea43965047, host hv-cinder-78956, cleared binding levels {{(pid=99026) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 17:44:11.883573 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d48bc319-0d50-4cb4-a7ec-ab97cfaeaf35 req-238912f7-80be-4124-8b14-9ffdadfcfb03 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:11.885412 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-d48bc319-0d50-4cb4-a7ec-ab97cfaeaf35 req-238912f7-80be-4124-8b14-9ffdadfcfb03 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.122 "GET /v2.0/ports?device_id=00d13d2c-33fc-42ec-a80d-4cd8155b6fe1 HTTP/1.1" status: 200  len: 945 time: 0.1535287
May 25 17:44:11.887496 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.db [req-ff47e483-5b7f-4416-82eb-6e94c3688d20 req-10f4a4fe-3f29-45f5-a579-2b6360486995 service neutron] For port db138deb-607b-422a-8726-ecea43965047, host hv-cinder-78956, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=db138deb-607b-422a-8726-ecea43965047,segment=NetworkSegment(87df170f-54cc-461b-a7ac-79e125fc526b),segment_id=87df170f-54cc-461b-a7ac-79e125fc526b)] {{(pid=99026) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 17:44:11.938781 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-d48bc319-0d50-4cb4-a7ec-ab97cfaeaf35 req-18da5803-c5cb-4b41-8c67-0d9cf2b1ed07 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.122 "GET /v2.0/security-groups?id=fa654e78-f61f-461b-b301-3690d1826946&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0466518
May 25 17:44:11.990986 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [req-ff47e483-5b7f-4416-82eb-6e94c3688d20 req-10f4a4fe-3f29-45f5-a579-2b6360486995 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15476529'] for port, after_update {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:12.001764 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-b611e140-088e-47fd-bbe8-b23e0caa8988 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:44:12.041536 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff47e483-5b7f-4416-82eb-6e94c3688d20 req-10f4a4fe-3f29-45f5-a579-2b6360486995 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:12.042149 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [req-ff47e483-5b7f-4416-82eb-6e94c3688d20 req-10f4a4fe-3f29-45f5-a579-2b6360486995 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-239387', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for port, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:12.043501 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-ff47e483-5b7f-4416-82eb-6e94c3688d20 req-10f4a4fe-3f29-45f5-a579-2b6360486995 service neutron] 10.222.0.125 "PUT /v2.0/ports/db138deb-607b-422a-8726-ecea43965047 HTTP/1.1" status: 200  len: 1093 time: 1.6240714
May 25 17:44:12.043983 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '292a3490-b43c-4640-bb5e-75df7d772b03', 'tag': 'db138deb-607b-422a-8726-ecea43965047'}] {{(pid=99026) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 17:44:12.072146 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b47088d-a339-4bdb-b836-f6179fd9919e req-124ffc05-0aec-455c-98ac-f50ce500e3db tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:12.074093 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-9b47088d-a339-4bdb-b836-f6179fd9919e req-124ffc05-0aec-455c-98ac-f50ce500e3db tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=432d7a94-0218-4907-bc7c-650f24a5b1e1 HTTP/1.1" status: 200  len: 945 time: 0.1581714
May 25 17:44:12.134210 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10f4a4fe-3f29-45f5-a579-2b6360486995 service neutron] Pushing event updated for resources: {'Port': ['ID=db138deb-607b-422a-8726-ecea43965047,revision_number=3']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:44:12.136505 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d85b019b-2647-4e2b-ae59-f10dcc4ca649 req-3af6f88b-246f-45de-ba72-a03093decde8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:12.138938 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-d85b019b-2647-4e2b-ae59-f10dcc4ca649 req-3af6f88b-246f-45de-ba72-a03093decde8 service neutron] 10.222.0.125 "GET /v2.0/ports?tenant_id=5b2f6ca8c5b94c2f8894c04f297b5f8b&device_id=432d7a94-0218-4907-bc7c-650f24a5b1e1 HTTP/1.1" status: 200  len: 1098 time: 0.2642891
May 25 17:44:12.141666 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-10f4a4fe-3f29-45f5-a579-2b6360486995 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.140s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:44:12.188971 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-9b47088d-a339-4bdb-b836-f6179fd9919e req-e036918c-04ee-40b8-ad9f-0ad4ed3c41cb tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1065118
May 25 17:44:12.273735 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '292a3490-b43c-4640-bb5e-75df7d772b03', 'tag': 'db138deb-607b-422a-8726-ecea43965047', 'status': 'completed', 'code': 200}
May 25 17:44:12.386504 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff47e483-5b7f-4416-82eb-6e94c3688d20 req-ae36948c-de9d-4720-8c4d-33d1176bbb06 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:12.388130 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-ff47e483-5b7f-4416-82eb-6e94c3688d20 req-ae36948c-de9d-4720-8c4d-33d1176bbb06 service neutron] 10.222.0.125 "GET /v2.0/ports?tenant_id=5ae575cfd07c4a88aa626c15e6bccfd9&device_id=292a3490-b43c-4640-bb5e-75df7d772b03 HTTP/1.1" status: 200  len: 1096 time: 0.2219572
May 25 17:44:12.469108 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-ff47e483-5b7f-4416-82eb-6e94c3688d20 req-863c950e-a99b-479e-9265-fa225ec61bb2 service neutron] 10.222.0.125 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=db138deb-607b-422a-8726-ecea43965047 HTTP/1.1" status: 200  len: 217 time: 0.0748858
May 25 17:44:12.488228 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d85b019b-2647-4e2b-ae59-f10dcc4ca649 req-a3038942-307d-44c4-8f4d-7660dc979a98 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:12.490562 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-d85b019b-2647-4e2b-ae59-f10dcc4ca649 req-a3038942-307d-44c4-8f4d-7660dc979a98 service neutron] 10.222.0.125 "GET /v2.0/networks?id=2abe381d-082b-4294-8193-c6556a56adb4 HTTP/1.1" status: 200  len: 920 time: 0.3459806
May 25 17:44:12.551716 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff47e483-5b7f-4416-82eb-6e94c3688d20 req-6943ce66-a947-4f9d-9138-8daf4dc73e16 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:12.554328 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-ff47e483-5b7f-4416-82eb-6e94c3688d20 req-6943ce66-a947-4f9d-9138-8daf4dc73e16 service neutron] 10.222.0.125 "GET /v2.0/subnets?id=279772c8-d366-4fc6-9c34-e6ddf99b5e08 HTTP/1.1" status: 200  len: 854 time: 0.0766015
May 25 17:44:12.556638 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b61bb18a-462a-484d-81b4-c4381fd76744 req-028cf070-81dd-4171-8810-b0ebedf2840f tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:12.558143 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-b61bb18a-462a-484d-81b4-c4381fd76744 req-028cf070-81dd-4171-8810-b0ebedf2840f tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/ports?device_id=292a3490-b43c-4640-bb5e-75df7d772b03 HTTP/1.1" status: 200  len: 943 time: 0.2014210
May 25 17:44:12.571829 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-d85b019b-2647-4e2b-ae59-f10dcc4ca649 req-1f953279-bed6-4534-ac47-90e46998d511 service neutron] 10.222.0.125 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=ca8c744f-fdc1-456d-ad85-74dff5ed46eb HTTP/1.1" status: 200  len: 217 time: 0.0763559
May 25 17:44:12.611223 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-ff47e483-5b7f-4416-82eb-6e94c3688d20 req-f8e69569-35c7-43e3-b377-49fdeabdc804 service neutron] 10.222.0.125 "GET /v2.0/ports?network_id=6c7eca3b-72f3-4ba8-9e95-614d64496512&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0469186
May 25 17:44:12.660073 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-b61bb18a-462a-484d-81b4-c4381fd76744 req-d3fe163b-0b31-48d3-82ce-3e1ed0f21b56 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/security-groups?id=dda11ec6-545c-479e-bba9-4390fea678fa&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0910227
May 25 17:44:12.666294 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d85b019b-2647-4e2b-ae59-f10dcc4ca649 req-f179749d-01da-416e-b6c0-39de8472c619 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:12.667959 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-d85b019b-2647-4e2b-ae59-f10dcc4ca649 req-f179749d-01da-416e-b6c0-39de8472c619 service neutron] 10.222.0.125 "GET /v2.0/subnets?id=e7ef8006-ae0e-4a18-b5c7-707d13fb7031 HTTP/1.1" status: 200  len: 858 time: 0.0813503
May 25 17:44:12.734968 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-d85b019b-2647-4e2b-ae59-f10dcc4ca649 req-c8f7df4e-0288-470a-a933-e5dada47e1e1 service neutron] 10.222.0.125 "GET /v2.0/ports?network_id=2abe381d-082b-4294-8193-c6556a56adb4&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0568614
May 25 17:44:12.777565 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-ff47e483-5b7f-4416-82eb-6e94c3688d20 req-8cc28ec1-ef8b-4409-8f40-529139080e05 service neutron] 10.222.0.125 "GET /v2.0/networks/6c7eca3b-72f3-4ba8-9e95-614d64496512?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1593499
May 25 17:44:12.875818 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-d85b019b-2647-4e2b-ae59-f10dcc4ca649 req-222d13e2-f137-442b-9e78-52a5d03509b4 service neutron] 10.222.0.125 "GET /v2.0/networks/2abe381d-082b-4294-8193-c6556a56adb4?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1330323
May 25 17:44:12.911043 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-ff47e483-5b7f-4416-82eb-6e94c3688d20 req-8c58e2fe-4ebb-491e-8a45-60d87b75ce24 service neutron] 10.222.0.125 "GET /v2.0/networks/6c7eca3b-72f3-4ba8-9e95-614d64496512?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1282139
May 25 17:44:13.012497 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-d85b019b-2647-4e2b-ae59-f10dcc4ca649 req-f2de2a70-2879-4287-ba2b-509da8385fd5 service neutron] 10.222.0.125 "GET /v2.0/networks/2abe381d-082b-4294-8193-c6556a56adb4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1303546
May 25 17:44:13.170148 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9988570c-51b0-4371-98cb-a017140e85d3 req-4f080a9f-4fd9-4097-be41-ea3cb2f78443 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:13.171763 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-9988570c-51b0-4371-98cb-a017140e85d3 req-4f080a9f-4fd9-4097-be41-ea3cb2f78443 service neutron] 10.222.0.125 "GET /v2.0/ports?tenant_id=5ae575cfd07c4a88aa626c15e6bccfd9&device_id=292a3490-b43c-4640-bb5e-75df7d772b03 HTTP/1.1" status: 200  len: 1096 time: 0.1370575
May 25 17:44:13.180401 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8cac80d3-ac8c-47f5-a050-65ea6c338834 req-d8590fae-85d8-4a2b-a1ae-b8bc1d6abb5c tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:13.181811 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-8cac80d3-ac8c-47f5-a050-65ea6c338834 req-d8590fae-85d8-4a2b-a1ae-b8bc1d6abb5c tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.122 "GET /v2.0/ports?device_id=00d13d2c-33fc-42ec-a80d-4cd8155b6fe1 HTTP/1.1" status: 200  len: 945 time: 0.1080739
May 25 17:44:13.311625 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-8cac80d3-ac8c-47f5-a050-65ea6c338834 req-1b29069f-5a3e-42de-bee6-166939cc643c tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.122 "GET /v2.0/security-groups?id=fa654e78-f61f-461b-b301-3690d1826946&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1079361
May 25 17:44:13.356805 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9988570c-51b0-4371-98cb-a017140e85d3 req-c3accd1c-db95-4ec1-8036-84c101ed9619 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:13.365679 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-9988570c-51b0-4371-98cb-a017140e85d3 req-c3accd1c-db95-4ec1-8036-84c101ed9619 service neutron] 10.222.0.125 "GET /v2.0/networks?id=6c7eca3b-72f3-4ba8-9e95-614d64496512 HTTP/1.1" status: 200  len: 916 time: 0.1757374
May 25 17:44:13.399747 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ee8b6a8-f65b-4ae7-bf49-abaa8ab835fb req-f6518d84-64c2-4d12-8ab2-7834ee43153d tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:13.401330 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-7ee8b6a8-f65b-4ae7-bf49-abaa8ab835fb req-f6518d84-64c2-4d12-8ab2-7834ee43153d tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=432d7a94-0218-4907-bc7c-650f24a5b1e1 HTTP/1.1" status: 200  len: 945 time: 0.1064327
May 25 17:44:13.468501 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-7ee8b6a8-f65b-4ae7-bf49-abaa8ab835fb req-3e05e1c8-c524-42bf-ad0b-f59fa8105ac9 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0605979
May 25 17:44:13.509012 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-9988570c-51b0-4371-98cb-a017140e85d3 req-6bc74d2c-5972-4b6e-972a-f466928fb201 service neutron] 10.222.0.125 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=db138deb-607b-422a-8726-ecea43965047 HTTP/1.1" status: 200  len: 217 time: 0.1449795
May 25 17:44:13.614565 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9988570c-51b0-4371-98cb-a017140e85d3 req-7aef2554-dbfb-4da5-a613-d4da56f61b20 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:13.616522 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-9988570c-51b0-4371-98cb-a017140e85d3 req-7aef2554-dbfb-4da5-a613-d4da56f61b20 service neutron] 10.222.0.125 "GET /v2.0/subnets?id=279772c8-d366-4fc6-9c34-e6ddf99b5e08 HTTP/1.1" status: 200  len: 854 time: 0.0873511
May 25 17:44:13.627827 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bc3a39e-0e25-4672-ab71-216f61def740 req-08d05cdd-2000-4180-9d1e-29d3e211adef tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:13.632628 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-1bc3a39e-0e25-4672-ab71-216f61def740 req-08d05cdd-2000-4180-9d1e-29d3e211adef tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.122 "GET /v2.0/ports?device_id=00d13d2c-33fc-42ec-a80d-4cd8155b6fe1 HTTP/1.1" status: 200  len: 945 time: 0.2020087
May 25 17:44:13.638644 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 43292) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:44:13.643809 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.v2.base [None req-509d7d6a-2b6c-4754-8af8-c1436abf38d7 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Request body: {'floatingip': {'port_id': '5c96172a-06f4-41ce-b47a-f1bbde47e41c'}} {{(pid=99027) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:44:13.820294 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-9988570c-51b0-4371-98cb-a017140e85d3 req-85391232-2195-4735-aeca-9b3ecb14a38d service neutron] 10.222.0.125 "GET /v2.0/ports?network_id=6c7eca3b-72f3-4ba8-9e95-614d64496512&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.1865478
May 25 17:44:13.852499 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-509d7d6a-2b6c-4754-8af8-c1436abf38d7 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify callbacks [] for floatingip, before_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:13.883832 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c00192f-43aa-497a-89c0-a984ac322b98 req-c16c8569-9611-4ade-9e5a-468e1d9809d6 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:13.885307 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-8c00192f-43aa-497a-89c0-a984ac322b98 req-c16c8569-9611-4ade-9e5a-468e1d9809d6 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/ports?device_id=292a3490-b43c-4640-bb5e-75df7d772b03 HTTP/1.1" status: 200  len: 943 time: 0.1029546
May 25 17:44:13.940445 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-8c00192f-43aa-497a-89c0-a984ac322b98 req-1b8bbcbb-40c8-43a2-b285-5b7817f988a7 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/security-groups?id=dda11ec6-545c-479e-bba9-4390fea678fa&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0488038
May 25 17:44:13.992691 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 43302) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:44:14.132415 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-9a071e6f-302b-481a-91b3-4019e0411465 admin admin] Notify callbacks [] for security_group, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:14.142610 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-9988570c-51b0-4371-98cb-a017140e85d3 req-48b157a8-2b32-4005-bf22-edf5d5808038 service neutron] 10.222.0.125 "GET /v2.0/networks/6c7eca3b-72f3-4ba8-9e95-614d64496512?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3150961
May 25 17:44:14.147343 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-9a071e6f-302b-481a-91b3-4019e0411465 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:44:14.151362 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-9a071e6f-302b-481a-91b3-4019e0411465 admin admin] Usage tracker for resource:security_group_rule and tenant:4d40c9b8fcc64efba3328480640bdc56 is out of sync, need to count used quota {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:44:14.155852 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-9a071e6f-302b-481a-91b3-4019e0411465 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:44:14.162408 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-9a071e6f-302b-481a-91b3-4019e0411465 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:44:14.250758 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-9a071e6f-302b-481a-91b3-4019e0411465 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:14.360012 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-9a071e6f-302b-481a-91b3-4019e0411465 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:14.371480 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-ac51b8cd-6001-4ddb-8608-d02600c04fb6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:44:14.413626 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-9a071e6f-302b-481a-91b3-4019e0411465 admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=4d40c9b8fcc64efba3328480640bdc56&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4196446
May 25 17:44:14.415242 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a071e6f-302b-481a-91b3-4019e0411465 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f8893750-87d6-4f73-a488-9e72ecaf23cb,revision_number=1']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:44:14.418368 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-9a071e6f-302b-481a-91b3-4019e0411465 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:44:14.419045 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 43310) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:44:14.479467 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-af42f433-e478-45db-9b61-db771975eb52 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:14.508191 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-af42f433-e478-45db-9b61-db771975eb52 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:14.516812 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-9988570c-51b0-4371-98cb-a017140e85d3 req-c6d450be-4fa5-4923-9561-f7c50b2ff087 service neutron] 10.222.0.125 "GET /v2.0/networks/6c7eca3b-72f3-4ba8-9e95-614d64496512?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3075495
May 25 17:44:14.680065 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-af42f433-e478-45db-9b61-db771975eb52 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:14.685754 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-c83249f1-1865-4339-b2aa-89c023213850 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:44:14.700944 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af42f433-e478-45db-9b61-db771975eb52 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f8893750-87d6-4f73-a488-9e72ecaf23cb,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:44:14.703978 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-af42f433-e478-45db-9b61-db771975eb52 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:44:14.708260 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-af42f433-e478-45db-9b61-db771975eb52 admin admin] Notify callbacks [] for security_group, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:14.711690 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-af42f433-e478-45db-9b61-db771975eb52 admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/f8893750-87d6-4f73-a488-9e72ecaf23cb HTTP/1.1" status: 204  len: 168 time: 0.2894216
May 25 17:44:14.904726 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-743ef14d-91a4-4163-9e6a-d2ad3257fc39 req-97fcc46f-457d-4dec-a8a3-0cf33b3902bb tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:14.906246 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-743ef14d-91a4-4163-9e6a-d2ad3257fc39 req-97fcc46f-457d-4dec-a8a3-0cf33b3902bb tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=432d7a94-0218-4907-bc7c-650f24a5b1e1 HTTP/1.1" status: 200  len: 945 time: 0.2344456
May 25 17:44:15.044864 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-509d7d6a-2b6c-4754-8af8-c1436abf38d7 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify callbacks [] for floatingip, precommit_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:15.058628 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-743ef14d-91a4-4163-9e6a-d2ad3257fc39 req-f2f20fea-43d2-45a3-a618-aa4b6278101a tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1440878
May 25 17:44:15.205983 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-509d7d6a-2b6c-4754-8af8-c1436abf38d7 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-419865'] for floatingip, after_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:15.210786 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d690a70-ebdf-4784-9d59-ece1fc2a36c6 req-3c04fb1d-8270-4233-8239-4f55f8739af0 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:15.214911 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-4d690a70-ebdf-4784-9d59-ece1fc2a36c6 req-3c04fb1d-8270-4233-8239-4f55f8739af0 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/ports?device_id=292a3490-b43c-4640-bb5e-75df7d772b03 HTTP/1.1" status: 200  len: 943 time: 0.0941191
May 25 17:44:15.293780 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-4d690a70-ebdf-4784-9d59-ece1fc2a36c6 req-fb19e841-8c06-4356-8201-eff9681df908 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/security-groups?id=dda11ec6-545c-479e-bba9-4390fea678fa&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0568702
May 25 17:44:15.409723 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.db.l3_db [None req-509d7d6a-2b6c-4754-8af8-c1436abf38d7 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Floating IP 2ae45669-5f60-40fd-ab29-1b1d8f4ca2b9 associated. External IP: 172.27.3.6, port: 5c96172a-06f4-41ce-b47a-f1bbde47e41c.
May 25 17:44:15.815974 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-509d7d6a-2b6c-4754-8af8-c1436abf38d7 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Router 3ca50ec5-218d-44ad-8ffc-4318f54d7350 has already been hosted by L3 agent eaeb6875-c4ed-43b6-8658-aa4e52324fdf {{(pid=99027) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 25 17:44:16.000237 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-509d7d6a-2b6c-4754-8af8-c1436abf38d7 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify agent at l3_agent.dv-cinder-789564-2-iscsi the message routers_updated {{(pid=99027) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 25 17:44:16.008160 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-509d7d6a-2b6c-4754-8af8-c1436abf38d7 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-239387'] for floatingip, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:16.016208 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f328cfb7-40c1-4f5f-81e8-3fb5fdef2c10 None None] Sync routers for ids ['3ca50ec5-218d-44ad-8ffc-4318f54d7350'] in dv-cinder-789564-2-iscsi {{(pid=99029) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 25 17:44:16.029484 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f328cfb7-40c1-4f5f-81e8-3fb5fdef2c10 None None] Routers {'3ca50ec5-218d-44ad-8ffc-4318f54d7350'} bound to L3 agent in host dv-cinder-789564-2-iscsi {{(pid=99029) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 17:44:16.030287 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_hamode_db [None req-f328cfb7-40c1-4f5f-81e8-3fb5fdef2c10 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcae718aee0>, 'dv-cinder-789564-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-25T17:34:21Z,description=<?>,heartbeat_timestamp=2021-05-25T17:43:51Z,host='dv-cinder-789564-2-iscsi',id=eaeb6875-c4ed-43b6-8658-aa4e52324fdf,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T17:34:21Z,topic='l3_agent')) {'router_ids': ['3ca50ec5-218d-44ad-8ffc-4318f54d7350'], 'active': True} {{(pid=99029) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:44:16.083931 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-509d7d6a-2b6c-4754-8af8-c1436abf38d7 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.122 "PUT /v2.0/floatingips/2ae45669-5f60-40fd-ab29-1b1d8f4ca2b9 HTTP/1.1" status: 200  len: 989 time: 2.4415832
May 25 17:44:16.084654 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '00d13d2c-33fc-42ec-a80d-4cd8155b6fe1', 'tag': '5c96172a-06f4-41ce-b47a-f1bbde47e41c'}] {{(pid=99027) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 17:44:16.225992 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_dvr_db [None req-f328cfb7-40c1-4f5f-81e8-3fb5fdef2c10 None None] Set router 3ca50ec5-218d-44ad-8ffc-4318f54d7350 gateway port host: dv-cinder-789564-2-iscsi {{(pid=99029) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 17:44:16.277640 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa2cb873-ad31-435e-b028-ed5eac5afa1a req-f50aefe8-6f2a-4fe7-9e88-d49c492e5963 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:16.279186 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-aa2cb873-ad31-435e-b028-ed5eac5afa1a req-f50aefe8-6f2a-4fe7-9e88-d49c492e5963 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=432d7a94-0218-4907-bc7c-650f24a5b1e1 HTTP/1.1" status: 200  len: 945 time: 0.0925245
May 25 17:44:16.331961 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-aa2cb873-ad31-435e-b028-ed5eac5afa1a req-327fb5c6-f1a2-4e4b-86e8-765f2cfe77a7 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0467198
May 25 17:44:16.604208 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Device db138deb-607b-422a-8726-ecea43965047 details requested by agent hyperv_hv-cinder-78956 with host hv-cinder-78956 {{(pid=99028) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 25 17:44:16.620459 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_hamode_db [None req-f328cfb7-40c1-4f5f-81e8-3fb5fdef2c10 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcae718aee0>, [{'id': '3ca50ec5-218d-44ad-8ffc-4318f54d7350', 'name': 'tempest-AttachVolumeShelveTestJSON-2113890446-router', 'tenant_id': 'cf02997eda314aee8fb322add2fbb921', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.226'}], 'enable_snat': True}, 'gw_port_id': '1e97124a-073a-4947-a6f2-359fb12ffe5e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:43:31Z', 'updated_at': '2021-05-25T17:43:37Z', 'revision_number': 4, 'project_id': 'cf02997eda314aee8fb322add2fbb921', 'gw_port': {'id': '1e97124a-073a-4947-a6f2-359fb12ffe5e', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:c8:ed:c5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3ca50ec5-218d-44ad-8ffc-4318f54d7350', 'device_owner': 'network:router_gateway', 'standard_attr_id': 244, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.226', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:43:33Z', 'updated_at': '2021-05-25T17:43:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi', '_floatingips': [{'id': '2ae45669-5f60-40fd-ab29-1b1d8f4ca2b9', 'tenant_id': 'cf02997eda314aee8fb322add2fbb921', 'floating_ip_address': '172.27.3.6', 'floating_network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'router_id': '3ca50ec5-218d-44ad-8ffc-4318f54d7350', 'port_id': '5c96172a-06f4-41ce-b47a-f1bbde47e41c', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 277, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '45b850af-d423-458a-855a-d7f828a11fff', 'mac_address': 'fa:16:3e:70:94:8e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '00d13d2c-33fc-42ec-a80d-4cd8155b6fe1', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T17:43:44Z', 'updated_at': '2021-05-25T17:44:14Z', 'revision_number': 1, 'project_id': 'cf02997eda314aee8fb322add2fbb921', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'ada7bf8b-4ba6-4629-8693-a2574922e458', 'name': '', 'network_id': '45b850af-d423-458a-855a-d7f828a11fff', 'tenant_id': 'cf02997eda314aee8fb322add2fbb921', 'mac_address': 'fa:16:3e:59:34:b7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3ca50ec5-218d-44ad-8ffc-4318f54d7350', 'device_owner': 'network:router_interface', 'standard_attr_id': 255, 'fixed_ips': [{'subnet_id': '704d0a85-ee4f-4df2-90a3-a525dfe28461', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:43:37Z', 'updated_at': '2021-05-25T17:43:45Z', 'revision_number': 5, 'project_id': 'cf02997eda314aee8fb322add2fbb921', 'subnets': [{'id': '704d0a85-ee4f-4df2-90a3-a525dfe28461', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-789564-2-iscsi', False) {} {{(pid=99029) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:44:16.624846 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f328cfb7-40c1-4f5f-81e8-3fb5fdef2c10 None None] Checking router: 3ca50ec5-218d-44ad-8ffc-4318f54d7350 for host: dv-cinder-789564-2-iscsi {{(pid=99029) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 25 17:44:16.634296 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f328cfb7-40c1-4f5f-81e8-3fb5fdef2c10 None None] Routers {'3ca50ec5-218d-44ad-8ffc-4318f54d7350'} bound to L3 agent in host dv-cinder-789564-2-iscsi {{(pid=99029) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 17:44:16.634918 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_hamode_db [None req-f328cfb7-40c1-4f5f-81e8-3fb5fdef2c10 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcae718aee0>, 'dv-cinder-789564-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-25T17:34:21Z,description=<?>,heartbeat_timestamp=2021-05-25T17:43:51Z,host='dv-cinder-789564-2-iscsi',id=eaeb6875-c4ed-43b6-8658-aa4e52324fdf,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T17:34:21Z,topic='l3_agent')) {'router_ids': ['3ca50ec5-218d-44ad-8ffc-4318f54d7350'], 'active': True} {{(pid=99029) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:44:16.754451 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] For port db138deb-607b-422a-8726-ecea43965047, host hv-cinder-78956, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=db138deb-607b-422a-8726-ecea43965047,segment=NetworkSegment(87df170f-54cc-461b-a7ac-79e125fc526b),segment_id=87df170f-54cc-461b-a7ac-79e125fc526b)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:44:16.769118 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Returning: {'device': 'db138deb-607b-422a-8726-ecea43965047', 'network_id': '6c7eca3b-72f3-4ba8-9e95-614d64496512', 'port_id': 'db138deb-607b-422a-8726-ecea43965047', 'mac_address': 'fa:16:3e:52:b8:78', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1304, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '279772c8-d366-4fc6-9c34-e6ddf99b5e08', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=99028) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 25 17:44:16.834629 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:16.852318 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.notifiers.nova [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id db138deb-607b-422a-8726-ecea43965047 {{(pid=99028) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 25 17:44:16.861976 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_dvr_db [None req-f328cfb7-40c1-4f5f-81e8-3fb5fdef2c10 None None] Set router 3ca50ec5-218d-44ad-8ffc-4318f54d7350 gateway port host: dv-cinder-789564-2-iscsi {{(pid=99029) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 17:44:16.869695 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] For port db138deb-607b-422a-8726-ecea43965047, host hv-cinder-78956, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=db138deb-607b-422a-8726-ecea43965047,segment=NetworkSegment(87df170f-54cc-461b-a7ac-79e125fc526b),segment_id=87df170f-54cc-461b-a7ac-79e125fc526b)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:44:16.948519 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:16.950256 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:44:17.016674 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Pushing event updated for resources: {'Port': ['ID=db138deb-607b-422a-8726-ecea43965047,revision_number=4']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:44:17.019884 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:44:17.245204 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_hamode_db [None req-f328cfb7-40c1-4f5f-81e8-3fb5fdef2c10 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcae718aee0>, [{'id': '3ca50ec5-218d-44ad-8ffc-4318f54d7350', 'name': 'tempest-AttachVolumeShelveTestJSON-2113890446-router', 'tenant_id': 'cf02997eda314aee8fb322add2fbb921', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.226'}], 'enable_snat': True}, 'gw_port_id': '1e97124a-073a-4947-a6f2-359fb12ffe5e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:43:31Z', 'updated_at': '2021-05-25T17:43:37Z', 'revision_number': 4, 'project_id': 'cf02997eda314aee8fb322add2fbb921', 'gw_port': {'id': '1e97124a-073a-4947-a6f2-359fb12ffe5e', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:c8:ed:c5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3ca50ec5-218d-44ad-8ffc-4318f54d7350', 'device_owner': 'network:router_gateway', 'standard_attr_id': 244, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.226', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:43:33Z', 'updated_at': '2021-05-25T17:43:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi', '_floatingips': [{'id': '2ae45669-5f60-40fd-ab29-1b1d8f4ca2b9', 'tenant_id': 'cf02997eda314aee8fb322add2fbb921', 'floating_ip_address': '172.27.3.6', 'floating_network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'router_id': '3ca50ec5-218d-44ad-8ffc-4318f54d7350', 'port_id': '5c96172a-06f4-41ce-b47a-f1bbde47e41c', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 277, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '45b850af-d423-458a-855a-d7f828a11fff', 'mac_address': 'fa:16:3e:70:94:8e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '00d13d2c-33fc-42ec-a80d-4cd8155b6fe1', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T17:43:44Z', 'updated_at': '2021-05-25T17:44:14Z', 'revision_number': 1, 'project_id': 'cf02997eda314aee8fb322add2fbb921', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'ada7bf8b-4ba6-4629-8693-a2574922e458', 'name': '', 'network_id': '45b850af-d423-458a-855a-d7f828a11fff', 'tenant_id': 'cf02997eda314aee8fb322add2fbb921', 'mac_address': 'fa:16:3e:59:34:b7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3ca50ec5-218d-44ad-8ffc-4318f54d7350', 'device_owner': 'network:router_interface', 'standard_attr_id': 255, 'fixed_ips': [{'subnet_id': '704d0a85-ee4f-4df2-90a3-a525dfe28461', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:43:37Z', 'updated_at': '2021-05-25T17:43:45Z', 'revision_number': 5, 'project_id': 'cf02997eda314aee8fb322add2fbb921', 'subnets': [{'id': '704d0a85-ee4f-4df2-90a3-a525dfe28461', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-789564-2-iscsi', False) {} {{(pid=99029) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:44:17.249292 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f328cfb7-40c1-4f5f-81e8-3fb5fdef2c10 None None] The sync data for ids ['3ca50ec5-218d-44ad-8ffc-4318f54d7350'] in dv-cinder-789564-2-iscsi is: [{'id': '3ca50ec5-218d-44ad-8ffc-4318f54d7350', 'name': 'tempest-AttachVolumeShelveTestJSON-2113890446-router', 'tenant_id': 'cf02997eda314aee8fb322add2fbb921', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.226'}], 'enable_snat': True}, 'gw_port_id': '1e97124a-073a-4947-a6f2-359fb12ffe5e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:43:31Z', 'updated_at': '2021-05-25T17:43:37Z', 'revision_number': 4, 'project_id': 'cf02997eda314aee8fb322add2fbb921', 'gw_port': {'id': '1e97124a-073a-4947-a6f2-359fb12ffe5e', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:c8:ed:c5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3ca50ec5-218d-44ad-8ffc-4318f54d7350', 'device_owner': 'network:router_gateway', 'standard_attr_id': 244, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.226', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:43:33Z', 'updated_at': '2021-05-25T17:43:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi', '_floatingips': [{'id': '2ae45669-5f60-40fd-ab29-1b1d8f4ca2b9', 'tenant_id': 'cf02997eda314aee8fb322add2fbb921', 'floating_ip_address': '172.27.3.6', 'floating_network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'router_id': '3ca50ec5-218d-44ad-8ffc-4318f54d7350', 'port_id': '5c96172a-06f4-41ce-b47a-f1bbde47e41c', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 277, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '45b850af-d423-458a-855a-d7f828a11fff', 'mac_address': 'fa:16:3e:70:94:8e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '00d13d2c-33fc-42ec-a80d-4cd8155b6fe1', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T17:43:44Z', 'updated_at': '2021-05-25T17:44:14Z', 'revision_number': 1, 'project_id': 'cf02997eda314aee8fb322add2fbb921', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'ada7bf8b-4ba6-4629-8693-a2574922e458', 'name': '', 'network_id': '45b850af-d423-458a-855a-d7f828a11fff', 'tenant_id': 'cf02997eda314aee8fb322add2fbb921', 'mac_address': 'fa:16:3e:59:34:b7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3ca50ec5-218d-44ad-8ffc-4318f54d7350', 'device_owner': 'network:router_interface', 'standard_attr_id': 255, 'fixed_ips': [{'subnet_id': '704d0a85-ee4f-4df2-90a3-a525dfe28461', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:43:37Z', 'updated_at': '2021-05-25T17:43:45Z', 'revision_number': 5, 'project_id': 'cf02997eda314aee8fb322add2fbb921', 'subnets': [{'id': '704d0a85-ee4f-4df2-90a3-a525dfe28461', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=99029) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 25 17:44:17.447768 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e21706ab-371e-455d-94b7-09ee7df8da2e None None] New status for floating IP 2ae45669-5f60-40fd-ab29-1b1d8f4ca2b9: ACTIVE {{(pid=99028) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 25 17:44:18.127825 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '00d13d2c-33fc-42ec-a80d-4cd8155b6fe1', 'tag': '5c96172a-06f4-41ce-b47a-f1bbde47e41c', 'status': 'completed', 'code': 200}
May 25 17:44:18.146587 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-9659cc1b-403b-4a03-8c69-ad7a0f118e5b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:18.347533 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b78da6a2-1a8b-4595-8a11-b481f015e0fe req-90d0cd77-c146-4a0c-9d77-0605591b71d0 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:18.349057 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-b78da6a2-1a8b-4595-8a11-b481f015e0fe req-90d0cd77-c146-4a0c-9d77-0605591b71d0 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/ports?device_id=292a3490-b43c-4640-bb5e-75df7d772b03 HTTP/1.1" status: 200  len: 944 time: 0.1136525
May 25 17:44:18.356430 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4a8c6ba-ed04-48cf-81bf-95af946a307c req-9a9f9edd-9cf4-4ac6-b89d-94913977cc61 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:18.358079 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-d4a8c6ba-ed04-48cf-81bf-95af946a307c req-9a9f9edd-9cf4-4ac6-b89d-94913977cc61 service neutron] 10.222.0.125 "GET /v2.0/ports?tenant_id=cf02997eda314aee8fb322add2fbb921&device_id=00d13d2c-33fc-42ec-a80d-4cd8155b6fe1 HTTP/1.1" status: 200  len: 1098 time: 0.1924109
May 25 17:44:18.407267 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-b78da6a2-1a8b-4595-8a11-b481f015e0fe req-e71bf7bc-1728-4c07-accc-8da0a21288a3 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/security-groups?id=dda11ec6-545c-479e-bba9-4390fea678fa&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0516214
May 25 17:44:18.515678 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] get_ports_and_sgs() called for port_ids ['db138deb-607b-422a-8726-ecea43965047'] {{(pid=99028) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 25 17:44:18.524338 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6800fbe-0611-4338-a6b5-1326995c186a req-96a68078-7c12-4e68-803a-4dfe43ccb7af tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:18.526141 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-f6800fbe-0611-4338-a6b5-1326995c186a req-96a68078-7c12-4e68-803a-4dfe43ccb7af tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=432d7a94-0218-4907-bc7c-650f24a5b1e1 HTTP/1.1" status: 200  len: 945 time: 0.2733963
May 25 17:44:18.635285 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-f6800fbe-0611-4338-a6b5-1326995c186a req-c758a1ec-81fb-422f-a502-84bab8ad4992 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0937293
May 25 17:44:18.643186 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4a8c6ba-ed04-48cf-81bf-95af946a307c req-cde26c7e-d4b1-4f02-8068-dd840ddc276a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:18.644882 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-d4a8c6ba-ed04-48cf-81bf-95af946a307c req-cde26c7e-d4b1-4f02-8068-dd840ddc276a service neutron] 10.222.0.125 "GET /v2.0/networks?id=45b850af-d423-458a-855a-d7f828a11fff HTTP/1.1" status: 200  len: 919 time: 0.2773957
May 25 17:44:18.760069 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 43460) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:44:18.788755 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-d4a8c6ba-ed04-48cf-81bf-95af946a307c req-995228e3-6280-4aa7-bd5d-93b663dcfd6e service neutron] 10.222.0.125 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=5c96172a-06f4-41ce-b47a-f1bbde47e41c HTTP/1.1" status: 200  len: 999 time: 0.1374915
May 25 17:44:18.869214 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4a8c6ba-ed04-48cf-81bf-95af946a307c req-65b625a2-6f2f-400f-9062-adf822a59f1f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:18.870692 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-d4a8c6ba-ed04-48cf-81bf-95af946a307c req-65b625a2-6f2f-400f-9062-adf822a59f1f service neutron] 10.222.0.125 "GET /v2.0/subnets?id=704d0a85-ee4f-4df2-90a3-a525dfe28461 HTTP/1.1" status: 200  len: 856 time: 0.0764792
May 25 17:44:18.901909 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-5b0d741e-6b2b-4c9e-81ee-8794e4730620 admin admin] Notify callbacks [] for security_group, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:18.917075 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-5b0d741e-6b2b-4c9e-81ee-8794e4730620 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:44:18.921376 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-5b0d741e-6b2b-4c9e-81ee-8794e4730620 admin admin] Usage tracker for resource:security_group_rule and tenant:59b1e42712c3464b977faa56e9b779fd is out of sync, need to count used quota {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:44:18.924406 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-5b0d741e-6b2b-4c9e-81ee-8794e4730620 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:44:18.931619 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-5b0d741e-6b2b-4c9e-81ee-8794e4730620 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:44:18.998592 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4a8c6ba-ed04-48cf-81bf-95af946a307c req-88aa4c04-2b8c-4b67-890c-d1c634a39255 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:19.005555 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-d4a8c6ba-ed04-48cf-81bf-95af946a307c req-88aa4c04-2b8c-4b67-890c-d1c634a39255 service neutron] 10.222.0.125 "GET /v2.0/ports?network_id=45b850af-d423-458a-855a-d7f828a11fff&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1259153
May 25 17:44:19.033449 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-5b0d741e-6b2b-4c9e-81ee-8794e4730620 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:19.128021 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-5b0d741e-6b2b-4c9e-81ee-8794e4730620 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:19.197144 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-3b492d6a-f5c1-47a9-96d5-5ed9d458e10e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:44:19.228640 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-5b0d741e-6b2b-4c9e-81ee-8794e4730620 admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=59b1e42712c3464b977faa56e9b779fd&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4675500
May 25 17:44:19.233165 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 43474) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:44:19.254364 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b0d741e-6b2b-4c9e-81ee-8794e4730620 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d890403f-65a7-426d-b706-832b478ede2e,revision_number=1']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:44:19.260237 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-5b0d741e-6b2b-4c9e-81ee-8794e4730620 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.063s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:44:19.314259 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-d4a8c6ba-ed04-48cf-81bf-95af946a307c req-c0cb40b0-b528-46be-a103-b6f1a8051390 service neutron] 10.222.0.125 "GET /v2.0/networks/45b850af-d423-458a-855a-d7f828a11fff?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2990253
May 25 17:44:19.317861 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-0bcafef7-ea2f-42e7-a98a-b24efb681e8e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:19.345389 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-0bcafef7-ea2f-42e7-a98a-b24efb681e8e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:19.446089 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-0bcafef7-ea2f-42e7-a98a-b24efb681e8e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:19.452794 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-b3a3e16e-acca-4c51-96ed-8037a45effc3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:44:19.476362 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0bcafef7-ea2f-42e7-a98a-b24efb681e8e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d890403f-65a7-426d-b706-832b478ede2e,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:44:19.481374 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-0bcafef7-ea2f-42e7-a98a-b24efb681e8e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:44:19.486140 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-0bcafef7-ea2f-42e7-a98a-b24efb681e8e admin admin] Notify callbacks [] for security_group, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:19.489791 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-0bcafef7-ea2f-42e7-a98a-b24efb681e8e admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/d890403f-65a7-426d-b706-832b478ede2e HTTP/1.1" status: 204  len: 168 time: 0.2548518
May 25 17:44:19.590909 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-d4a8c6ba-ed04-48cf-81bf-95af946a307c req-7b630ca3-a4dc-4809-8231-0379af4eff74 service neutron] 10.222.0.125 "GET /v2.0/networks/45b850af-d423-458a-855a-d7f828a11fff?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2702410
May 25 17:44:19.768791 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7548c7ea-47c2-4fbd-8df8-80ed75abeb42 req-a23b2194-fa39-428e-973c-e71e39f2ddf2 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:19.770906 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-7548c7ea-47c2-4fbd-8df8-80ed75abeb42 req-a23b2194-fa39-428e-973c-e71e39f2ddf2 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/ports?device_id=292a3490-b43c-4640-bb5e-75df7d772b03 HTTP/1.1" status: 200  len: 944 time: 0.1733849
May 25 17:44:19.842998 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-7548c7ea-47c2-4fbd-8df8-80ed75abeb42 req-aaabc0ac-1066-4a95-ab91-1522fb13dc7a tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/security-groups?id=dda11ec6-545c-479e-bba9-4390fea678fa&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0661004
May 25 17:44:19.946433 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db461a29-f35c-4035-b13f-c1de9ee149b2 req-59c17998-5eb7-478c-b018-3d99cbf5b89f tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:19.948846 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-db461a29-f35c-4035-b13f-c1de9ee149b2 req-59c17998-5eb7-478c-b018-3d99cbf5b89f tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=432d7a94-0218-4907-bc7c-650f24a5b1e1 HTTP/1.1" status: 200  len: 945 time: 0.1166461
May 25 17:44:20.019632 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-db461a29-f35c-4035-b13f-c1de9ee149b2 req-d328bb96-7d0d-4db8-99e8-e83133ba3908 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0647352
May 25 17:44:20.434017 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Device db138deb-607b-422a-8726-ecea43965047 up at agent hyperv_hv-cinder-78956 {{(pid=99028) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 17:44:20.583489 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Provisioning for port db138deb-607b-422a-8726-ecea43965047 completed by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 17:44:20.599671 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Provisioning complete for port db138deb-607b-422a-8726-ecea43965047 triggered by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 17:44:20.600081 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:20.699658 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-e2616252-56a8-42e3-a4a5-92bcb0c05192 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:20.740909 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:20.780463 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '292a3490-b43c-4640-bb5e-75df7d772b03', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'db138deb-607b-422a-8726-ecea43965047'}] {{(pid=99028) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 17:44:20.790366 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] For port db138deb-607b-422a-8726-ecea43965047, host hv-cinder-78956, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=db138deb-607b-422a-8726-ecea43965047,segment=NetworkSegment(87df170f-54cc-461b-a7ac-79e125fc526b),segment_id=87df170f-54cc-461b-a7ac-79e125fc526b)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:44:20.830060 dv-cinder-789564-2-iscsi neutron-server[99028]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '292a3490-b43c-4640-bb5e-75df7d772b03', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'db138deb-607b-422a-8726-ecea43965047', 'code': 200}
May 25 17:44:20.868530 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:20.897993 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:20.900830 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:44:20.982918 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Pushing event updated for resources: {'Port': ['ID=db138deb-607b-422a-8726-ecea43965047,revision_number=5']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:44:20.987571 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:44:21.042231 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb45dad8-2b77-4534-932a-c24e18efc467 req-7d448f6c-5a06-46c7-8b61-25803f42b1b4 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:21.043741 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-fb45dad8-2b77-4534-932a-c24e18efc467 req-7d448f6c-5a06-46c7-8b61-25803f42b1b4 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/ports?device_id=292a3490-b43c-4640-bb5e-75df7d772b03 HTTP/1.1" status: 200  len: 945 time: 0.0843477
May 25 17:44:21.097356 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-fb45dad8-2b77-4534-932a-c24e18efc467 req-fd18aaeb-e8b3-48e6-be4d-da703d84ae02 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/security-groups?id=dda11ec6-545c-479e-bba9-4390fea678fa&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0448804
May 25 17:44:21.218870 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b592b94-6a96-471a-9f08-d571712ddc30 req-3e9328d6-a8ba-4a4c-bf8f-3bafe3171887 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:21.220403 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-1b592b94-6a96-471a-9f08-d571712ddc30 req-3e9328d6-a8ba-4a4c-bf8f-3bafe3171887 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=432d7a94-0218-4907-bc7c-650f24a5b1e1 HTTP/1.1" status: 200  len: 945 time: 0.0844033
May 25 17:44:21.270073 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-1b592b94-6a96-471a-9f08-d571712ddc30 req-411e9b9b-21c8-4f39-9ac4-6d7029b183af tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0436668
May 25 17:44:21.702845 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-7e261f94-b84f-443e-be49-3bc1ac903b55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:23.291303 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-6df2b2a7-a54e-4d57-9be3-033078b9d5b3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:23.691416 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24145335-acdc-477c-89d1-4304350d61e8 req-a4b470f4-f117-42d3-afa6-4faf7bc0622d tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:23.693579 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-24145335-acdc-477c-89d1-4304350d61e8 req-a4b470f4-f117-42d3-afa6-4faf7bc0622d tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/ports?device_id=292a3490-b43c-4640-bb5e-75df7d772b03 HTTP/1.1" status: 200  len: 945 time: 0.0973623
May 25 17:44:23.715856 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83878763-d2da-44c9-bd26-e9a632c8d60c req-7fa2d070-4566-4f02-8384-ca88a5d11b4d tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:23.717144 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-83878763-d2da-44c9-bd26-e9a632c8d60c req-7fa2d070-4566-4f02-8384-ca88a5d11b4d tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=432d7a94-0218-4907-bc7c-650f24a5b1e1 HTTP/1.1" status: 200  len: 945 time: 0.0911767
May 25 17:44:23.748087 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-24145335-acdc-477c-89d1-4304350d61e8 req-4517723f-95b1-46f6-ab69-046c6b292b81 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/security-groups?id=dda11ec6-545c-479e-bba9-4390fea678fa&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0470090
May 25 17:44:23.772800 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-83878763-d2da-44c9-bd26-e9a632c8d60c req-8081d75b-7e57-4156-8055-a93ae4d8706a tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0476809
May 25 17:44:23.854280 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3adba426-cc41-47d0-83fd-bf574f406deb req-d04d257b-f643-4548-b442-4f1b6027b651 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:23.855762 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-3adba426-cc41-47d0-83fd-bf574f406deb req-d04d257b-f643-4548-b442-4f1b6027b651 service neutron] 10.222.0.125 "GET /v2.0/ports?device_id=292a3490-b43c-4640-bb5e-75df7d772b03 HTTP/1.1" status: 200  len: 1098 time: 0.0734854
May 25 17:44:23.899825 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-3adba426-cc41-47d0-83fd-bf574f406deb req-405bfde8-ecde-4487-8140-fcb4628ad06a service neutron] 10.222.0.125 "GET /v2.0/security-groups?id=dda11ec6-545c-479e-bba9-4390fea678fa&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0387127
May 25 17:44:24.983341 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-183bc3eb-6191-472b-a744-8baa2b130219 req-67feed87-bfef-4e5f-b6f4-8e822dd9cdd9 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:24.987106 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-183bc3eb-6191-472b-a744-8baa2b130219 req-67feed87-bfef-4e5f-b6f4-8e822dd9cdd9 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/ports?device_id=292a3490-b43c-4640-bb5e-75df7d772b03 HTTP/1.1" status: 200  len: 945 time: 0.0955217
May 25 17:44:24.988741 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-295146e0-a15a-4dde-ace6-f4058afb5044 req-ef769343-8e86-496c-bb98-03af2d0afcba tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:24.993140 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-295146e0-a15a-4dde-ace6-f4058afb5044 req-ef769343-8e86-496c-bb98-03af2d0afcba tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=432d7a94-0218-4907-bc7c-650f24a5b1e1 HTTP/1.1" status: 200  len: 945 time: 0.1022763
May 25 17:44:25.050280 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-295146e0-a15a-4dde-ace6-f4058afb5044 req-1504c2b2-3f59-4a40-b929-8384d6b7df5b tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0504365
May 25 17:44:25.050562 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-183bc3eb-6191-472b-a744-8baa2b130219 req-8b772173-7fd9-417c-8c06-b1ae6d346f7d tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/security-groups?id=dda11ec6-545c-479e-bba9-4390fea678fa&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0508058
May 25 17:44:26.268628 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70cea6c1-8f48-4291-8b77-f88382f175a7 req-23590d91-063f-4c7f-8a3e-dd8232330dcf tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:26.270395 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-70cea6c1-8f48-4291-8b77-f88382f175a7 req-23590d91-063f-4c7f-8a3e-dd8232330dcf tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=432d7a94-0218-4907-bc7c-650f24a5b1e1 HTTP/1.1" status: 200  len: 945 time: 0.0942743
May 25 17:44:26.328946 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-70cea6c1-8f48-4291-8b77-f88382f175a7 req-ac17991e-77be-45be-bbf5-db4063b7afb8 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0502548
May 25 17:44:27.340506 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 43624) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:44:27.463737 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-1da02044-4d49-4bb0-81ac-5ba4c2b4a59e admin admin] Notify callbacks [] for security_group, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:27.478637 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-1da02044-4d49-4bb0-81ac-5ba4c2b4a59e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:44:27.483522 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-1da02044-4d49-4bb0-81ac-5ba4c2b4a59e admin admin] Usage tracker for resource:security_group_rule and tenant:e1c81d4e4f864231af2944214fdfe064 is out of sync, need to count used quota {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:44:27.486418 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-1da02044-4d49-4bb0-81ac-5ba4c2b4a59e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:44:27.492791 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-1da02044-4d49-4bb0-81ac-5ba4c2b4a59e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:44:27.528832 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c14b520f-399a-426b-ba7c-73bb2d00d4dd req-93f7e805-4bda-4b47-a2cd-e2707273b6b9 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:27.530328 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-c14b520f-399a-426b-ba7c-73bb2d00d4dd req-93f7e805-4bda-4b47-a2cd-e2707273b6b9 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=432d7a94-0218-4907-bc7c-650f24a5b1e1 HTTP/1.1" status: 200  len: 945 time: 0.0841718
May 25 17:44:27.578902 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-c14b520f-399a-426b-ba7c-73bb2d00d4dd req-856d9f5b-82fe-4951-962b-f222fff06146 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0427170
May 25 17:44:27.588795 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-1da02044-4d49-4bb0-81ac-5ba4c2b4a59e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:27.668835 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-1da02044-4d49-4bb0-81ac-5ba4c2b4a59e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:27.677569 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-54c7d7ba-b062-4214-a879-719e2d5b802b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:44:27.718910 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1da02044-4d49-4bb0-81ac-5ba4c2b4a59e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ac79d009-6ce0-4d24-ad10-e298217de954,revision_number=1']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:44:27.722936 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-1da02044-4d49-4bb0-81ac-5ba4c2b4a59e admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=e1c81d4e4f864231af2944214fdfe064&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3813505
May 25 17:44:27.727105 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 43632) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:44:27.730226 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1da02044-4d49-4bb0-81ac-5ba4c2b4a59e admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:44:27.730616 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1da02044-4d49-4bb0-81ac-5ba4c2b4a59e admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:44:27.730987 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1da02044-4d49-4bb0-81ac-5ba4c2b4a59e admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:44:27.731356 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1da02044-4d49-4bb0-81ac-5ba4c2b4a59e admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:44:27.732061 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1da02044-4d49-4bb0-81ac-5ba4c2b4a59e admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:44:27.732061 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1da02044-4d49-4bb0-81ac-5ba4c2b4a59e admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:44:27.732481 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1da02044-4d49-4bb0-81ac-5ba4c2b4a59e admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:44:27.732824 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1da02044-4d49-4bb0-81ac-5ba4c2b4a59e admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:44:27.733160 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1da02044-4d49-4bb0-81ac-5ba4c2b4a59e admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:44:27.733553 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1da02044-4d49-4bb0-81ac-5ba4c2b4a59e admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:44:27.733901 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1da02044-4d49-4bb0-81ac-5ba4c2b4a59e admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:44:27.734258 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1da02044-4d49-4bb0-81ac-5ba4c2b4a59e admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:44:27.738486 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-1da02044-4d49-4bb0-81ac-5ba4c2b4a59e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.061s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:44:27.807963 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-28e7690d-adbc-4bfa-982d-a1f183d46565 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:27.834540 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-28e7690d-adbc-4bfa-982d-a1f183d46565 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:27.965615 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-28e7690d-adbc-4bfa-982d-a1f183d46565 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:27.971018 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-a61f25df-84a2-440b-822d-639601627753 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:44:27.984613 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28e7690d-adbc-4bfa-982d-a1f183d46565 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ac79d009-6ce0-4d24-ad10-e298217de954,revision_number=None']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:44:27.993565 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-28e7690d-adbc-4bfa-982d-a1f183d46565 admin admin] Notify callbacks [] for security_group, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:27.994672 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-28e7690d-adbc-4bfa-982d-a1f183d46565 admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/ac79d009-6ce0-4d24-ad10-e298217de954 HTTP/1.1" status: 204  len: 168 time: 0.2665236
May 25 17:44:27.995951 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28e7690d-adbc-4bfa-982d-a1f183d46565 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:44:27.996303 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28e7690d-adbc-4bfa-982d-a1f183d46565 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:44:27.996649 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28e7690d-adbc-4bfa-982d-a1f183d46565 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:44:28.001235 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28e7690d-adbc-4bfa-982d-a1f183d46565 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:44:28.001235 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28e7690d-adbc-4bfa-982d-a1f183d46565 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:44:28.001235 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28e7690d-adbc-4bfa-982d-a1f183d46565 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:44:28.001235 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28e7690d-adbc-4bfa-982d-a1f183d46565 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:44:28.001235 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28e7690d-adbc-4bfa-982d-a1f183d46565 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:44:28.001235 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28e7690d-adbc-4bfa-982d-a1f183d46565 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:44:28.001235 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28e7690d-adbc-4bfa-982d-a1f183d46565 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:44:28.001235 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28e7690d-adbc-4bfa-982d-a1f183d46565 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:44:28.001235 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28e7690d-adbc-4bfa-982d-a1f183d46565 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:44:28.003076 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-28e7690d-adbc-4bfa-982d-a1f183d46565 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.032s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:44:28.762692 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.agents_db [None req-14fae233-15dc-4576-836b-621c5f95b584 None None] Agent healthcheck: found 6 active agents {{(pid=99029) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 17:44:31.086710 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcf28395-1416-48d0-bd80-c213bd5e1863 req-fb08d169-4524-4735-8cc6-f523113ee27e tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:31.088247 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-bcf28395-1416-48d0-bd80-c213bd5e1863 req-fb08d169-4524-4735-8cc6-f523113ee27e tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=432d7a94-0218-4907-bc7c-650f24a5b1e1 HTTP/1.1" status: 200  len: 945 time: 0.1024978
May 25 17:44:31.142237 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-bcf28395-1416-48d0-bd80-c213bd5e1863 req-aff08ca1-7ae9-42bf-962b-09d5b007b168 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0465851
May 25 17:44:31.553769 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-7dbc73cc-9d33-439c-bd46-403f2dad1686 req-6e14a78a-d36c-4604-b3c2-26195ce9ccf7 tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] 10.222.0.122 "GET /v2.0/networks?tenant_id=9028482ca1824f25a204f6a680c95a63&shared=False HTTP/1.1" status: 200  len: 213 time: 0.0299196
May 25 17:44:31.718990 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7dbc73cc-9d33-439c-bd46-403f2dad1686 req-93496b8b-34b6-49a1-a594-c7e21669ea2d tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:31.720444 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-7dbc73cc-9d33-439c-bd46-403f2dad1686 req-93496b8b-34b6-49a1-a594-c7e21669ea2d tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] 10.222.0.122 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 769 time: 0.1614685
May 25 17:44:31.736353 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-7dbc73cc-9d33-439c-bd46-403f2dad1686 req-3cf596a5-69f6-4f40-9210-99e108cfb850 tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] 10.222.0.122 "GET /v2.0/quotas/9028482ca1824f25a204f6a680c95a63 HTTP/1.1" status: 200  len: 375 time: 0.0089629
May 25 17:44:31.784916 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-7dbc73cc-9d33-439c-bd46-403f2dad1686 req-5890918c-0d1e-4a13-afc6-2ad6e9cd6e77 tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] 10.222.0.122 "GET /v2.0/ports?tenant_id=9028482ca1824f25a204f6a680c95a63&fields=id HTTP/1.1" status: 200  len: 210 time: 0.0427566
May 25 17:44:32.205570 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-324ef010-7210-4006-99a5-383365d0cf0b req-46369d51-b65e-4f88-bffb-17eb449011af tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] 10.222.0.122 "GET /v2.0/ports?device_id=5dd77d13-488f-4888-88ca-871972724044 HTTP/1.1" status: 200  len: 210 time: 0.0900786
May 25 17:44:32.375632 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3515e91-18b5-402d-89f4-75df4bbb7c4a req-6d034d6e-eff8-4884-887a-8b766eb8697d tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:32.377468 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-c3515e91-18b5-402d-89f4-75df4bbb7c4a req-6d034d6e-eff8-4884-887a-8b766eb8697d tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=432d7a94-0218-4907-bc7c-650f24a5b1e1 HTTP/1.1" status: 200  len: 945 time: 0.0983751
May 25 17:44:32.427994 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-c3515e91-18b5-402d-89f4-75df4bbb7c4a req-e3b8c414-57d2-41b0-8001-e75d373e4041 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0433724
May 25 17:44:33.308152 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-7b5334df-aadd-4512-b958-c381ee0b787d req-4e242881-375a-4844-932a-73ceba775642 tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] 10.222.0.122 "GET /v2.0/ports?device_id=5dd77d13-488f-4888-88ca-871972724044 HTTP/1.1" status: 200  len: 210 time: 0.0429878
May 25 17:44:33.635382 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b65f80d-a68b-4f58-be76-349ec5bfe6d8 req-8903bacc-ad39-4ba1-a7dc-50b6f3410db2 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:33.642452 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-2b65f80d-a68b-4f58-be76-349ec5bfe6d8 req-8903bacc-ad39-4ba1-a7dc-50b6f3410db2 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=432d7a94-0218-4907-bc7c-650f24a5b1e1 HTTP/1.1" status: 200  len: 945 time: 0.0982437
May 25 17:44:33.684215 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-2b65f80d-a68b-4f58-be76-349ec5bfe6d8 req-0a1dac18-5586-4c03-8755-87dbded5928f tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0408423
May 25 17:44:34.469004 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-50e6e759-e84e-4e63-8c7d-e01653baf5b6 req-af5b4eae-e1d6-424a-9cf0-0e8db37f5d22 tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] 10.222.0.122 "GET /v2.0/ports?device_id=5dd77d13-488f-4888-88ca-871972724044 HTTP/1.1" status: 200  len: 210 time: 0.0429158
May 25 17:44:34.518875 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-7dbc73cc-9d33-439c-bd46-403f2dad1686 req-73aed7c3-0eef-478d-957c-e3e1ae455ef0 tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] 10.222.0.125 "GET /v2.0/networks?tenant_id=9028482ca1824f25a204f6a680c95a63&shared=False HTTP/1.1" status: 200  len: 213 time: 0.0266819
May 25 17:44:34.676376 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7dbc73cc-9d33-439c-bd46-403f2dad1686 req-64b01cd8-e527-429b-b9b7-e4ea1d72662f tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:34.677775 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-7dbc73cc-9d33-439c-bd46-403f2dad1686 req-64b01cd8-e527-429b-b9b7-e4ea1d72662f tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] 10.222.0.125 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 769 time: 0.1533029
May 25 17:44:34.975417 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5626a78-eb25-4f69-b33f-9dd5d37defdf req-efaa6680-c76c-4177-8430-28b0d1581f92 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:34.976884 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-d5626a78-eb25-4f69-b33f-9dd5d37defdf req-efaa6680-c76c-4177-8430-28b0d1581f92 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=432d7a94-0218-4907-bc7c-650f24a5b1e1 HTTP/1.1" status: 200  len: 945 time: 0.1622903
May 25 17:44:35.023623 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-d5626a78-eb25-4f69-b33f-9dd5d37defdf req-11a1a738-7e99-4b2c-af62-cf2b6daddd2e tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0405045
May 25 17:44:39.424264 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.v2.base [req-7dbc73cc-9d33-439c-bd46-403f2dad1686 req-59e6551a-fa2d-4cc0-a817-9ccf8ec28ec3 tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] Request body: {'port': {'device_id': '5dd77d13-488f-4888-88ca-871972724044', 'network_id': '0c8c34da-ff66-41c1-a56f-de3f6145b223', 'admin_state_up': True, 'tenant_id': '9028482ca1824f25a204f6a680c95a63'}} {{(pid=99027) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:44:39.602557 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-63515bed-5ec8-44e3-9f43-50de5df51928 req-1d5a3190-0380-44ec-ac1e-4e1d4c259f6f tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] 10.222.0.122 "GET /v2.0/ports?device_id=5dd77d13-488f-4888-88ca-871972724044 HTTP/1.1" status: 200  len: 210 time: 0.0502017
May 25 17:44:39.642892 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [req-7dbc73cc-9d33-439c-bd46-403f2dad1686 req-59e6551a-fa2d-4cc0-a817-9ccf8ec28ec3 tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:44:39.648665 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-7dbc73cc-9d33-439c-bd46-403f2dad1686 req-59e6551a-fa2d-4cc0-a817-9ccf8ec28ec3 tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] Usage tracker for resource:port and tenant:9028482ca1824f25a204f6a680c95a63 is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:44:39.652116 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-7dbc73cc-9d33-439c-bd46-403f2dad1686 req-59e6551a-fa2d-4cc0-a817-9ccf8ec28ec3 tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] Quota usage for port was recalculated. Used quota:0. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:44:39.659633 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [req-7dbc73cc-9d33-439c-bd46-403f2dad1686 req-59e6551a-fa2d-4cc0-a817-9ccf8ec28ec3 tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:44:39.678786 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e83a66a8-d917-4156-aec3-126bcd08e695 req-30d1ad80-b796-4e26-bc11-291590b26195 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:39.680189 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-e83a66a8-d917-4156-aec3-126bcd08e695 req-30d1ad80-b796-4e26-bc11-291590b26195 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=432d7a94-0218-4907-bc7c-650f24a5b1e1 HTTP/1.1" status: 200  len: 945 time: 0.1177673
May 25 17:44:39.728467 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-e83a66a8-d917-4156-aec3-126bcd08e695 req-eb4d3664-5ca9-468e-a545-bcc4e36ccc97 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0421960
May 25 17:44:39.736152 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-7dbc73cc-9d33-439c-bd46-403f2dad1686 req-59e6551a-fa2d-4cc0-a817-9ccf8ec28ec3 tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] Made reservation on behalf of 9028482ca1824f25a204f6a680c95a63 for: {'port': 1} {{(pid=99027) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 17:44:39.739862 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-7dbc73cc-9d33-439c-bd46-403f2dad1686 req-59e6551a-fa2d-4cc0-a817-9ccf8ec28ec3 tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:39.755522 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-7dbc73cc-9d33-439c-bd46-403f2dad1686 req-59e6551a-fa2d-4cc0-a817-9ccf8ec28ec3 tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] Notify callbacks [] for security_group, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:39.771824 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [req-7dbc73cc-9d33-439c-bd46-403f2dad1686 req-59e6551a-fa2d-4cc0-a817-9ccf8ec28ec3 tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:44:39.775681 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-7dbc73cc-9d33-439c-bd46-403f2dad1686 req-59e6551a-fa2d-4cc0-a817-9ccf8ec28ec3 tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] Usage tracker for resource:security_group_rule and tenant:9028482ca1824f25a204f6a680c95a63 is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:44:39.778512 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-7dbc73cc-9d33-439c-bd46-403f2dad1686 req-59e6551a-fa2d-4cc0-a817-9ccf8ec28ec3 tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:44:39.785038 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [req-7dbc73cc-9d33-439c-bd46-403f2dad1686 req-59e6551a-fa2d-4cc0-a817-9ccf8ec28ec3 tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:44:39.871070 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-7dbc73cc-9d33-439c-bd46-403f2dad1686 req-59e6551a-fa2d-4cc0-a817-9ccf8ec28ec3 tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] Notify callbacks [] for security_group, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:39.953694 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-7dbc73cc-9d33-439c-bd46-403f2dad1686 req-59e6551a-fa2d-4cc0-a817-9ccf8ec28ec3 tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:39.956604 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:44:39.961747 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc76d397-66b0-4ced-a695-685d76decfca req-c3e315dd-73c2-40d0-80f4-66db09f6dcea service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:39.963222 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-fc76d397-66b0-4ced-a695-685d76decfca req-c3e315dd-73c2-40d0-80f4-66db09f6dcea service neutron] 10.222.0.125 "GET /v2.0/ports?tenant_id=5b2f6ca8c5b94c2f8894c04f297b5f8b&device_id=432d7a94-0218-4907-bc7c-650f24a5b1e1 HTTP/1.1" status: 200  len: 1098 time: 0.0743039
May 25 17:44:40.041775 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59e6551a-fa2d-4cc0-a817-9ccf8ec28ec3 tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] Pushing event updated for resources: {'SecurityGroup': ['ID=bbd044e3-418c-425e-a277-d3ef2e6c73a3,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:44:40.048630 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-59e6551a-fa2d-4cc0-a817-9ccf8ec28ec3 tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:44:40.121247 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc76d397-66b0-4ced-a695-685d76decfca req-2869fb51-5cd6-4a77-a4d5-7b48c8e0a88c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:40.122738 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-fc76d397-66b0-4ced-a695-685d76decfca req-2869fb51-5cd6-4a77-a4d5-7b48c8e0a88c service neutron] 10.222.0.125 "GET /v2.0/networks?id=2abe381d-082b-4294-8193-c6556a56adb4 HTTP/1.1" status: 200  len: 920 time: 0.1358476
May 25 17:44:40.133322 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.db_base_plugin_common [req-7dbc73cc-9d33-439c-bd46-403f2dad1686 req-59e6551a-fa2d-4cc0-a817-9ccf8ec28ec3 tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] Allocated IP 192.168.233.229 (0c8c34da-ff66-41c1-a56f-de3f6145b223/6ae88d72-5303-4d56-a3cc-8079ba99cfd9/8066cba1-4128-4b8c-a5a5-eb7aae2f80cc) {{(pid=99027) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 17:44:40.347370 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-7dbc73cc-9d33-439c-bd46-403f2dad1686 req-59e6551a-fa2d-4cc0-a817-9ccf8ec28ec3 tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] Notify callbacks [] for port, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:40.364479 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.provisioning_blocks [req-7dbc73cc-9d33-439c-bd46-403f2dad1686 req-59e6551a-fa2d-4cc0-a817-9ccf8ec28ec3 tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] Transition to ACTIVE for port object 8066cba1-4128-4b8c-a5a5-eb7aae2f80cc will not be triggered until provisioned by entity DHCP. {{(pid=99027) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 17:44:40.427377 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-fc76d397-66b0-4ced-a695-685d76decfca req-8f87476f-c094-4d33-9c28-de2b2c77d837 service neutron] 10.222.0.125 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=ca8c744f-fdc1-456d-ad85-74dff5ed46eb HTTP/1.1" status: 200  len: 217 time: 0.0730932
May 25 17:44:40.462509 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-7dbc73cc-9d33-439c-bd46-403f2dad1686 req-59e6551a-fa2d-4cc0-a817-9ccf8ec28ec3 tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781840788179', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15468986'] for port, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:40.477227 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:44:40.513405 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc76d397-66b0-4ced-a695-685d76decfca req-9b8e0607-0e62-4f55-82e4-cc2a8ef9d12c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:40.516464 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-fc76d397-66b0-4ced-a695-685d76decfca req-9b8e0607-0e62-4f55-82e4-cc2a8ef9d12c service neutron] 10.222.0.125 "GET /v2.0/subnets?id=e7ef8006-ae0e-4a18-b5c7-707d13fb7031 HTTP/1.1" status: 200  len: 858 time: 0.0826037
May 25 17:44:40.554373 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-7dbc73cc-9d33-439c-bd46-403f2dad1686 req-59e6551a-fa2d-4cc0-a817-9ccf8ec28ec3 tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] Network 0c8c34da-ff66-41c1-a56f-de3f6145b223 is already hosted by enough agents. {{(pid=99027) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 17:44:40.557886 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.base_scheduler [req-7dbc73cc-9d33-439c-bd46-403f2dad1686 req-59e6551a-fa2d-4cc0-a817-9ccf8ec28ec3 tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] Resources bound (agent type, host, resource id):  {{(pid=99027) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 17:44:40.562032 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.l3_dvrscheduler_db [req-7dbc73cc-9d33-439c-bd46-403f2dad1686 req-59e6551a-fa2d-4cc0-a817-9ccf8ec28ec3 tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] Received port after_create {{(pid=99027) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 17:44:40.607271 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59e6551a-fa2d-4cc0-a817-9ccf8ec28ec3 tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] Pushing event updated for resources: {'Port': ['ID=8066cba1-4128-4b8c-a5a5-eb7aae2f80cc,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:44:40.613707 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-fc76d397-66b0-4ced-a695-685d76decfca req-8a48cc1b-0431-43ab-8de9-be42d0b9631a service neutron] 10.222.0.125 "GET /v2.0/ports?network_id=2abe381d-082b-4294-8193-c6556a56adb4&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0817127
May 25 17:44:40.614388 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-59e6551a-fa2d-4cc0-a817-9ccf8ec28ec3 tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.135s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:44:40.653062 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7dbc73cc-9d33-439c-bd46-403f2dad1686 req-59e6551a-fa2d-4cc0-a817-9ccf8ec28ec3 tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:40.653724 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-7dbc73cc-9d33-439c-bd46-403f2dad1686 req-59e6551a-fa2d-4cc0-a817-9ccf8ec28ec3 tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-239387'] for port, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:40.801572 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-7dbc73cc-9d33-439c-bd46-403f2dad1686 req-59e6551a-fa2d-4cc0-a817-9ccf8ec28ec3 tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] 10.222.0.125 "POST /v2.0/ports HTTP/1.1" status: 201  len: 938 time: 1.3834848
May 25 17:44:40.820427 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.v2.base [req-7dbc73cc-9d33-439c-bd46-403f2dad1686 req-5bde7c25-5ae1-489b-9a7d-86209365f2f2 service neutron] Request body: {'port': {'device_id': '5dd77d13-488f-4888-88ca-871972724044', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78956'}} {{(pid=99027) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:44:40.837656 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-fc76d397-66b0-4ced-a695-685d76decfca req-e6389125-c69c-4f45-b765-add9855785cb service neutron] 10.222.0.125 "GET /v2.0/networks/2abe381d-082b-4294-8193-c6556a56adb4?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2267020
May 25 17:44:40.951523 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1d37917-e701-4ba4-9351-66672fa26fdf req-eb7be831-0915-4f0c-a231-00f368b2d56f tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:40.952995 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-c1d37917-e701-4ba4-9351-66672fa26fdf req-eb7be831-0915-4f0c-a231-00f368b2d56f tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] 10.222.0.122 "GET /v2.0/ports?device_id=5dd77d13-488f-4888-88ca-871972724044 HTTP/1.1" status: 200  len: 936 time: 0.2100630
May 25 17:44:40.965362 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-646836ab-7a46-4a21-b704-a44f74b792cc None None] Provisioning for port 8066cba1-4128-4b8c-a5a5-eb7aae2f80cc completed by entity DHCP. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 17:44:40.973498 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-646836ab-7a46-4a21-b704-a44f74b792cc None None] Provisioning complete for port 8066cba1-4128-4b8c-a5a5-eb7aae2f80cc triggered by entity DHCP. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 17:44:40.974762 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-646836ab-7a46-4a21-b704-a44f74b792cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:41.007345 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-7dbc73cc-9d33-439c-bd46-403f2dad1686 req-5bde7c25-5ae1-489b-9a7d-86209365f2f2 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:41.013568 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-c1d37917-e701-4ba4-9351-66672fa26fdf req-7dc76df5-1dce-47bb-b445-1101481281d3 tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] 10.222.0.122 "GET /v2.0/security-groups?id=bbd044e3-418c-425e-a277-d3ef2e6c73a3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0451841
May 25 17:44:41.042122 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-fc76d397-66b0-4ced-a695-685d76decfca req-415060ef-a3ef-42db-a21c-d732fb3ebdbf service neutron] 10.222.0.125 "GET /v2.0/networks/2abe381d-082b-4294-8193-c6556a56adb4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1979289
May 25 17:44:41.049389 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.plugin [None req-646836ab-7a46-4a21-b704-a44f74b792cc None None] Port 8066cba1-4128-4b8c-a5a5-eb7aae2f80cc cannot update to ACTIVE because it is not bound. {{(pid=99028) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 25 17:44:41.080178 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc26c455-91f4-4771-89b6-3b1d61b281fa req-cc90cb39-2f59-480f-a0f8-2059d952789d tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:41.081693 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-fc26c455-91f4-4771-89b6-3b1d61b281fa req-cc90cb39-2f59-480f-a0f8-2059d952789d tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=432d7a94-0218-4907-bc7c-650f24a5b1e1 HTTP/1.1" status: 200  len: 945 time: 0.2111657
May 25 17:44:41.196516 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-fc26c455-91f4-4771-89b6-3b1d61b281fa req-3eaf7983-93d4-4122-a3ea-2b13981f458b tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1076446
May 25 17:44:41.423377 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.notifiers.nova [req-7dbc73cc-9d33-439c-bd46-403f2dad1686 req-5bde7c25-5ae1-489b-9a7d-86209365f2f2 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 8066cba1-4128-4b8c-a5a5-eb7aae2f80cc {{(pid=99027) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 25 17:44:41.432049 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-7dbc73cc-9d33-439c-bd46-403f2dad1686 req-5bde7c25-5ae1-489b-9a7d-86209365f2f2 service neutron] Notify callbacks [] for port, precommit_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:41.449249 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.provisioning_blocks [req-7dbc73cc-9d33-439c-bd46-403f2dad1686 req-5bde7c25-5ae1-489b-9a7d-86209365f2f2 service neutron] Transition to ACTIVE for port object 8066cba1-4128-4b8c-a5a5-eb7aae2f80cc will not be triggered until provisioned by entity L2. {{(pid=99027) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 17:44:41.536905 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:41.537294 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-7dbc73cc-9d33-439c-bd46-403f2dad1686 req-5bde7c25-5ae1-489b-9a7d-86209365f2f2 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15468979'] for port, after_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:41.543171 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-68cc1310-b1dd-450f-aaf6-f6a3464f6496 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:44:41.758458 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8264dea8-2dbd-48f2-b9d8-f34da679dd26 req-c0cc0c17-1e09-44a2-89cf-eef5014789e4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:41.762508 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-8264dea8-2dbd-48f2-b9d8-f34da679dd26 req-c0cc0c17-1e09-44a2-89cf-eef5014789e4 service neutron] 10.222.0.125 "GET /v2.0/ports?device_id=432d7a94-0218-4907-bc7c-650f24a5b1e1 HTTP/1.1" status: 200  len: 1098 time: 0.1303735
May 25 17:44:41.851940 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-8264dea8-2dbd-48f2-b9d8-f34da679dd26 req-ddd23e4d-8e2f-4419-9f4e-22d7cede9a58 service neutron] 10.222.0.125 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0817080
May 25 17:44:41.875213 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5bde7c25-5ae1-489b-9a7d-86209365f2f2 service neutron] Pushing event updated for resources: {'Port': ['ID=8066cba1-4128-4b8c-a5a5-eb7aae2f80cc,revision_number=2']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:44:41.903473 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-5bde7c25-5ae1-489b-9a7d-86209365f2f2 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.360s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:44:41.969046 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.managers [req-7dbc73cc-9d33-439c-bd46-403f2dad1686 req-5bde7c25-5ae1-489b-9a7d-86209365f2f2 service neutron] Attempting to bind port 8066cba1-4128-4b8c-a5a5-eb7aae2f80cc on host hv-cinder-78956 for vnic_type normal with profile  {{(pid=99027) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 17:44:41.969730 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.managers [req-7dbc73cc-9d33-439c-bd46-403f2dad1686 req-5bde7c25-5ae1-489b-9a7d-86209365f2f2 service neutron] Attempting to bind port 8066cba1-4128-4b8c-a5a5-eb7aae2f80cc by drivers openvswitch,hyperv on host hv-cinder-78956 at level 0 using segments [{'id': 'b22125c1-5fbd-40a2-a6a7-0f8662838c08', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1348, 'network_id': '0c8c34da-ff66-41c1-a56f-de3f6145b223'}] {{(pid=99027) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 17:44:41.969980 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7dbc73cc-9d33-439c-bd46-403f2dad1686 req-5bde7c25-5ae1-489b-9a7d-86209365f2f2 service neutron] Attempting to bind port 8066cba1-4128-4b8c-a5a5-eb7aae2f80cc on network 0c8c34da-ff66-41c1-a56f-de3f6145b223 {{(pid=99027) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 17:44:41.975505 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7dbc73cc-9d33-439c-bd46-403f2dad1686 req-5bde7c25-5ae1-489b-9a7d-86209365f2f2 service neutron] Port 8066cba1-4128-4b8c-a5a5-eb7aae2f80cc on network 0c8c34da-ff66-41c1-a56f-de3f6145b223 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78956 {{(pid=99027) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 25 17:44:41.975855 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7dbc73cc-9d33-439c-bd46-403f2dad1686 req-5bde7c25-5ae1-489b-9a7d-86209365f2f2 service neutron] Attempting to bind port 8066cba1-4128-4b8c-a5a5-eb7aae2f80cc on network 0c8c34da-ff66-41c1-a56f-de3f6145b223 {{(pid=99027) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 17:44:41.984415 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7dbc73cc-9d33-439c-bd46-403f2dad1686 req-5bde7c25-5ae1-489b-9a7d-86209365f2f2 service neutron] Checking agent: {'id': '4d02a528-6a0e-4977-985f-4bcff1ca6cb7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78956', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 17, 40, 41), 'started_at': datetime.datetime(2021, 5, 25, 17, 40, 41), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 17, 44, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=99027) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 17:44:41.984912 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7dbc73cc-9d33-439c-bd46-403f2dad1686 req-5bde7c25-5ae1-489b-9a7d-86209365f2f2 service neutron] Checking segment: {'id': 'b22125c1-5fbd-40a2-a6a7-0f8662838c08', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1348, 'network_id': '0c8c34da-ff66-41c1-a56f-de3f6145b223'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=99027) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 17:44:41.985381 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7dbc73cc-9d33-439c-bd46-403f2dad1686 req-5bde7c25-5ae1-489b-9a7d-86209365f2f2 service neutron] Bound using segment: {'id': 'b22125c1-5fbd-40a2-a6a7-0f8662838c08', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1348, 'network_id': '0c8c34da-ff66-41c1-a56f-de3f6145b223'} {{(pid=99027) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 17:44:41.985812 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.managers [req-7dbc73cc-9d33-439c-bd46-403f2dad1686 req-5bde7c25-5ae1-489b-9a7d-86209365f2f2 service neutron] Bound port: 8066cba1-4128-4b8c-a5a5-eb7aae2f80cc, host: hv-cinder-78956, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'b22125c1-5fbd-40a2-a6a7-0f8662838c08', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1348, 'network_id': '0c8c34da-ff66-41c1-a56f-de3f6145b223'}}] {{(pid=99027) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 17:44:41.986252 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-7dbc73cc-9d33-439c-bd46-403f2dad1686 req-5bde7c25-5ae1-489b-9a7d-86209365f2f2 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:42.122007 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.db [req-7dbc73cc-9d33-439c-bd46-403f2dad1686 req-5bde7c25-5ae1-489b-9a7d-86209365f2f2 service neutron] For port 8066cba1-4128-4b8c-a5a5-eb7aae2f80cc, host hv-cinder-78956, cleared binding levels {{(pid=99027) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 17:44:42.126138 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.db [req-7dbc73cc-9d33-439c-bd46-403f2dad1686 req-5bde7c25-5ae1-489b-9a7d-86209365f2f2 service neutron] For port 8066cba1-4128-4b8c-a5a5-eb7aae2f80cc, host hv-cinder-78956, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=8066cba1-4128-4b8c-a5a5-eb7aae2f80cc,segment=NetworkSegment(b22125c1-5fbd-40a2-a6a7-0f8662838c08),segment_id=b22125c1-5fbd-40a2-a6a7-0f8662838c08)] {{(pid=99027) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 17:44:42.222962 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-7dbc73cc-9d33-439c-bd46-403f2dad1686 req-5bde7c25-5ae1-489b-9a7d-86209365f2f2 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15468979'] for port, after_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:42.228203 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-59e6551a-fa2d-4cc0-a817-9ccf8ec28ec3 tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:44:42.272557 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5936c084-0e5a-45d7-9502-0acab207ea40 req-29fd356b-aa29-4cdd-88a6-2f5c8daa3632 tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:42.280664 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-5936c084-0e5a-45d7-9502-0acab207ea40 req-29fd356b-aa29-4cdd-88a6-2f5c8daa3632 tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] 10.222.0.122 "GET /v2.0/ports?device_id=5dd77d13-488f-4888-88ca-871972724044 HTTP/1.1" status: 200  len: 948 time: 0.1040471
May 25 17:44:42.311726 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5bde7c25-5ae1-489b-9a7d-86209365f2f2 service neutron] Pushing event updated for resources: {'Port': ['ID=8066cba1-4128-4b8c-a5a5-eb7aae2f80cc,revision_number=3']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:44:42.315179 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-5bde7c25-5ae1-489b-9a7d-86209365f2f2 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:44:42.321405 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7dbc73cc-9d33-439c-bd46-403f2dad1686 req-5bde7c25-5ae1-489b-9a7d-86209365f2f2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:42.321985 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-7dbc73cc-9d33-439c-bd46-403f2dad1686 req-5bde7c25-5ae1-489b-9a7d-86209365f2f2 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-239387'] for port, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:42.323666 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-7dbc73cc-9d33-439c-bd46-403f2dad1686 req-5bde7c25-5ae1-489b-9a7d-86209365f2f2 service neutron] 10.222.0.125 "PUT /v2.0/ports/8066cba1-4128-4b8c-a5a5-eb7aae2f80cc HTTP/1.1" status: 200  len: 1098 time: 1.5093715
May 25 17:44:42.324168 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '5dd77d13-488f-4888-88ca-871972724044', 'tag': '8066cba1-4128-4b8c-a5a5-eb7aae2f80cc'}] {{(pid=99027) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 17:44:42.351090 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-5936c084-0e5a-45d7-9502-0acab207ea40 req-4422f21f-0343-4d0a-bd72-11643f0c3dc3 tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] 10.222.0.122 "GET /v2.0/security-groups?id=bbd044e3-418c-425e-a277-d3ef2e6c73a3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0693631
May 25 17:44:42.401318 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '5dd77d13-488f-4888-88ca-871972724044', 'tag': '8066cba1-4128-4b8c-a5a5-eb7aae2f80cc', 'status': 'completed', 'code': 200}
May 25 17:44:42.566038 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c1e1426-6689-4a48-842a-7f23e91284a4 req-5348bb50-9d32-4de6-9fd0-b0548b3fd39f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:42.567735 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-9c1e1426-6689-4a48-842a-7f23e91284a4 req-5348bb50-9d32-4de6-9fd0-b0548b3fd39f service neutron] 10.222.0.125 "GET /v2.0/ports?tenant_id=9028482ca1824f25a204f6a680c95a63&device_id=5dd77d13-488f-4888-88ca-871972724044 HTTP/1.1" status: 200  len: 1101 time: 0.1186748
May 25 17:44:42.586643 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84946650-d1cb-4fab-9bd9-adb1e89881db req-705e3778-259d-45df-84ef-b8f0a1ad45d9 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:42.586643 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-84946650-d1cb-4fab-9bd9-adb1e89881db req-705e3778-259d-45df-84ef-b8f0a1ad45d9 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=432d7a94-0218-4907-bc7c-650f24a5b1e1 HTTP/1.1" status: 200  len: 945 time: 0.1807380
May 25 17:44:42.634461 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-9c1e1426-6689-4a48-842a-7f23e91284a4 req-9eb5f829-8d87-44da-951a-c2a78861ecb6 service neutron] 10.222.0.125 "GET /v2.0/networks?tenant_id=9028482ca1824f25a204f6a680c95a63&shared=False HTTP/1.1" status: 200  len: 213 time: 0.0534246
May 25 17:44:42.747399 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-84946650-d1cb-4fab-9bd9-adb1e89881db req-67d135da-d844-4d0a-8fee-498adcdfde95 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1416993
May 25 17:44:42.816433 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c1e1426-6689-4a48-842a-7f23e91284a4 req-8f96cb9d-a9d7-40a3-934a-234c8fd3f7fd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:42.818093 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-9c1e1426-6689-4a48-842a-7f23e91284a4 req-8f96cb9d-a9d7-40a3-934a-234c8fd3f7fd service neutron] 10.222.0.125 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 871 time: 0.1781654
May 25 17:44:42.952183 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7dbc73cc-9d33-439c-bd46-403f2dad1686 req-f7a9e96f-992f-4704-952b-a457b6802e93 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:42.952183 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-7dbc73cc-9d33-439c-bd46-403f2dad1686 req-f7a9e96f-992f-4704-952b-a457b6802e93 service neutron] 10.222.0.125 "GET /v2.0/ports?tenant_id=9028482ca1824f25a204f6a680c95a63&device_id=5dd77d13-488f-4888-88ca-871972724044 HTTP/1.1" status: 200  len: 1101 time: 0.0812151
May 25 17:44:43.031580 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-7dbc73cc-9d33-439c-bd46-403f2dad1686 req-1314d47a-da52-4e70-92de-d9edfe35281d service neutron] 10.222.0.125 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.229&port_id=8066cba1-4128-4b8c-a5a5-eb7aae2f80cc HTTP/1.1" status: 200  len: 217 time: 0.0739133
May 25 17:44:43.094809 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7dbc73cc-9d33-439c-bd46-403f2dad1686 req-d345ac2d-1784-4d32-8c20-563ac89edec8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:43.096239 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-7dbc73cc-9d33-439c-bd46-403f2dad1686 req-d345ac2d-1784-4d32-8c20-563ac89edec8 service neutron] 10.222.0.125 "GET /v2.0/subnets?id=6ae88d72-5303-4d56-a3cc-8079ba99cfd9 HTTP/1.1" status: 200  len: 843 time: 0.0593355
May 25 17:44:43.183001 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7dbc73cc-9d33-439c-bd46-403f2dad1686 req-6a8ed70d-d8b7-43a4-ac68-4209eb6b9900 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:43.184483 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-7dbc73cc-9d33-439c-bd46-403f2dad1686 req-6a8ed70d-d8b7-43a4-ac68-4209eb6b9900 service neutron] 10.222.0.125 "GET /v2.0/ports?network_id=0c8c34da-ff66-41c1-a56f-de3f6145b223&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1178 time: 0.0827184
May 25 17:44:43.343927 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-7dbc73cc-9d33-439c-bd46-403f2dad1686 req-9c5e9d4e-d2f0-45fe-b830-9ab696245501 service neutron] 10.222.0.125 "GET /v2.0/networks/0c8c34da-ff66-41c1-a56f-de3f6145b223?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1438751
May 25 17:44:43.537579 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-7dbc73cc-9d33-439c-bd46-403f2dad1686 req-2d30cf9e-5f05-4b40-ac6b-fc889c892619 service neutron] 10.222.0.125 "GET /v2.0/networks/0c8c34da-ff66-41c1-a56f-de3f6145b223?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1860611
May 25 17:44:43.585035 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-975fad61-fc6c-483a-8134-f805aa6e39c7 req-d5e99e1d-6b60-4980-a78e-32d030941729 tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:43.585783 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-975fad61-fc6c-483a-8134-f805aa6e39c7 req-d5e99e1d-6b60-4980-a78e-32d030941729 tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] Synchronizing usage tracker for tenant:9028482ca1824f25a204f6a680c95a63 on resource:port {{(pid=99027) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 17:44:43.714173 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-975fad61-fc6c-483a-8134-f805aa6e39c7 req-d5e99e1d-6b60-4980-a78e-32d030941729 tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] Unset dirty status for tenant:9028482ca1824f25a204f6a680c95a63 on resource:port {{(pid=99027) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 17:44:43.715678 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-975fad61-fc6c-483a-8134-f805aa6e39c7 req-d5e99e1d-6b60-4980-a78e-32d030941729 tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] 10.222.0.122 "GET /v2.0/ports?device_id=5dd77d13-488f-4888-88ca-871972724044 HTTP/1.1" status: 200  len: 948 time: 0.2261171
May 25 17:44:43.770292 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-975fad61-fc6c-483a-8134-f805aa6e39c7 req-cac541ce-1d4e-47c2-bcfb-fb39624ac007 tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] Synchronizing usage tracker for tenant:9028482ca1824f25a204f6a680c95a63 on resource:security_group {{(pid=99027) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 17:44:43.851354 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-975fad61-fc6c-483a-8134-f805aa6e39c7 req-cac541ce-1d4e-47c2-bcfb-fb39624ac007 tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] Unset dirty status for tenant:9028482ca1824f25a204f6a680c95a63 on resource:security_group {{(pid=99027) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 17:44:43.866314 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-975fad61-fc6c-483a-8134-f805aa6e39c7 req-cac541ce-1d4e-47c2-bcfb-fb39624ac007 tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] 10.222.0.122 "GET /v2.0/security-groups?id=bbd044e3-418c-425e-a277-d3ef2e6c73a3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1420662
May 25 17:44:44.048674 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4411b667-5c86-4820-9fba-c19946cfb652 req-1d901e92-7990-4571-a13f-a0cf9223cf9c tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:44.050228 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-4411b667-5c86-4820-9fba-c19946cfb652 req-1d901e92-7990-4571-a13f-a0cf9223cf9c tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=432d7a94-0218-4907-bc7c-650f24a5b1e1 HTTP/1.1" status: 200  len: 945 time: 0.1746631
May 25 17:44:44.109752 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-4411b667-5c86-4820-9fba-c19946cfb652 req-5ca9271f-53ad-45a2-8833-2488be585a91 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0535989
May 25 17:44:44.671366 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4089d13-3a5b-41f1-8a52-c47d13af3363 req-7a9821ed-730b-4ead-9044-0c4fd636d715 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:44.672832 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-d4089d13-3a5b-41f1-8a52-c47d13af3363 req-7a9821ed-730b-4ead-9044-0c4fd636d715 service neutron] 10.222.0.125 "GET /v2.0/ports?tenant_id=5b2f6ca8c5b94c2f8894c04f297b5f8b&device_id=432d7a94-0218-4907-bc7c-650f24a5b1e1 HTTP/1.1" status: 200  len: 1098 time: 0.0765359
May 25 17:44:44.687405 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5590004-e69e-4b2c-8521-1a8b7ca48c33 req-74d0aff8-723e-4e69-8480-1c6f51b3eec9 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:44.688877 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-d5590004-e69e-4b2c-8521-1a8b7ca48c33 req-74d0aff8-723e-4e69-8480-1c6f51b3eec9 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=432d7a94-0218-4907-bc7c-650f24a5b1e1 HTTP/1.1" status: 200  len: 945 time: 0.0853107
May 25 17:44:44.733754 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-d5590004-e69e-4b2c-8521-1a8b7ca48c33 req-2c5b515a-f63f-417d-9869-d6da48da8bf2 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0391698
May 25 17:44:44.804434 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4089d13-3a5b-41f1-8a52-c47d13af3363 req-72cbabb2-3c47-4d1e-9680-130d4a393488 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:44.805804 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-d4089d13-3a5b-41f1-8a52-c47d13af3363 req-72cbabb2-3c47-4d1e-9680-130d4a393488 service neutron] 10.222.0.125 "GET /v2.0/networks?id=2abe381d-082b-4294-8193-c6556a56adb4 HTTP/1.1" status: 200  len: 920 time: 0.1283438
May 25 17:44:44.874496 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-d4089d13-3a5b-41f1-8a52-c47d13af3363 req-ea1a3ca8-4e82-459c-a746-7c2d9ee319c3 service neutron] 10.222.0.125 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=ca8c744f-fdc1-456d-ad85-74dff5ed46eb HTTP/1.1" status: 200  len: 217 time: 0.0605254
May 25 17:44:45.059908 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4089d13-3a5b-41f1-8a52-c47d13af3363 req-63e3c96b-1cce-4370-9381-114f890b3637 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:45.061804 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-d4089d13-3a5b-41f1-8a52-c47d13af3363 req-63e3c96b-1cce-4370-9381-114f890b3637 service neutron] 10.222.0.125 "GET /v2.0/subnets?id=e7ef8006-ae0e-4a18-b5c7-707d13fb7031 HTTP/1.1" status: 200  len: 858 time: 0.1816061
May 25 17:44:45.117217 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-d4089d13-3a5b-41f1-8a52-c47d13af3363 req-5eaee018-ddd2-427c-9af5-d1a494cfe9d4 service neutron] 10.222.0.125 "GET /v2.0/ports?network_id=2abe381d-082b-4294-8193-c6556a56adb4&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0472167
May 25 17:44:45.152546 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c66ba13-609b-4e55-9df5-e6d07e29e16a req-fe6ce935-7608-4dc1-96cc-1eba345a2616 tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:45.154080 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-5c66ba13-609b-4e55-9df5-e6d07e29e16a req-fe6ce935-7608-4dc1-96cc-1eba345a2616 tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] 10.222.0.122 "GET /v2.0/ports?device_id=5dd77d13-488f-4888-88ca-871972724044 HTTP/1.1" status: 200  len: 948 time: 0.1623921
May 25 17:44:45.287752 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-5c66ba13-609b-4e55-9df5-e6d07e29e16a req-7869575f-e0c2-48b8-84bd-b52a1685d833 tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] 10.222.0.122 "GET /v2.0/security-groups?id=bbd044e3-418c-425e-a277-d3ef2e6c73a3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0866349
May 25 17:44:45.317847 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-d4089d13-3a5b-41f1-8a52-c47d13af3363 req-1734a9e7-2814-4dd4-97d2-b2a5863afcd2 service neutron] 10.222.0.125 "GET /v2.0/networks/2abe381d-082b-4294-8193-c6556a56adb4?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1928728
May 25 17:44:45.472023 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-d4089d13-3a5b-41f1-8a52-c47d13af3363 req-36c1c0ab-b96b-4273-a33c-ddc8f6fc2caf service neutron] 10.222.0.125 "GET /v2.0/networks/2abe381d-082b-4294-8193-c6556a56adb4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1419141
May 25 17:44:45.928253 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b50e352-1104-4aa5-bcbe-103c4fc1239b req-f0bc2f58-8b48-4d5a-a35f-9bb98bed0e28 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:45.929789 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-6b50e352-1104-4aa5-bcbe-103c4fc1239b req-f0bc2f58-8b48-4d5a-a35f-9bb98bed0e28 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=432d7a94-0218-4907-bc7c-650f24a5b1e1 HTTP/1.1" status: 200  len: 945 time: 0.0834997
May 25 17:44:45.977043 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-6b50e352-1104-4aa5-bcbe-103c4fc1239b req-382c4e62-359f-43a2-891a-d6010d5380d2 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0409429
May 25 17:44:46.506423 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e473f33-ccc6-45d6-9ae9-deabdc7fd5cd req-378e5174-5790-4a37-ae6b-8da95313ef65 tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:46.507903 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-5e473f33-ccc6-45d6-9ae9-deabdc7fd5cd req-378e5174-5790-4a37-ae6b-8da95313ef65 tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] 10.222.0.122 "GET /v2.0/ports?device_id=5dd77d13-488f-4888-88ca-871972724044 HTTP/1.1" status: 200  len: 948 time: 0.0906157
May 25 17:44:46.560375 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-5e473f33-ccc6-45d6-9ae9-deabdc7fd5cd req-b16585ea-f045-4171-a3e5-f44c388e587f tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] 10.222.0.122 "GET /v2.0/security-groups?id=bbd044e3-418c-425e-a277-d3ef2e6c73a3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0468566
May 25 17:44:46.688715 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Device 8066cba1-4128-4b8c-a5a5-eb7aae2f80cc details requested by agent hyperv_hv-cinder-78956 with host hv-cinder-78956 {{(pid=99028) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 25 17:44:46.821638 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] For port 8066cba1-4128-4b8c-a5a5-eb7aae2f80cc, host hv-cinder-78956, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=8066cba1-4128-4b8c-a5a5-eb7aae2f80cc,segment=NetworkSegment(b22125c1-5fbd-40a2-a6a7-0f8662838c08),segment_id=b22125c1-5fbd-40a2-a6a7-0f8662838c08)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:44:46.835212 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Returning: {'device': '8066cba1-4128-4b8c-a5a5-eb7aae2f80cc', 'network_id': '0c8c34da-ff66-41c1-a56f-de3f6145b223', 'port_id': '8066cba1-4128-4b8c-a5a5-eb7aae2f80cc', 'mac_address': 'fa:16:3e:a5:1e:ff', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1348, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '6ae88d72-5303-4d56-a3cc-8079ba99cfd9', 'ip_address': '192.168.233.229'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=99028) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 25 17:44:46.901860 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:46.923864 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.notifiers.nova [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 8066cba1-4128-4b8c-a5a5-eb7aae2f80cc {{(pid=99028) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 25 17:44:46.943678 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] For port 8066cba1-4128-4b8c-a5a5-eb7aae2f80cc, host hv-cinder-78956, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=8066cba1-4128-4b8c-a5a5-eb7aae2f80cc,segment=NetworkSegment(b22125c1-5fbd-40a2-a6a7-0f8662838c08),segment_id=b22125c1-5fbd-40a2-a6a7-0f8662838c08)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:44:47.045453 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:47.048656 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:44:47.119803 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Pushing event updated for resources: {'Port': ['ID=8066cba1-4128-4b8c-a5a5-eb7aae2f80cc,revision_number=4']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:44:47.128289 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:44:47.128629 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:44:47.129143 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:44:47.130825 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:44:47.131191 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:44:47.131530 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:44:47.131859 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:44:47.132198 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:44:47.132533 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:44:47.132859 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:44:47.133241 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:44:47.133519 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:44:47.137525 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:44:47.180780 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6ba9cc4-8020-4fd3-bbda-fe938b51a397 req-0e5aa203-eab8-4871-b326-a62d3528d9f0 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:47.182258 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-f6ba9cc4-8020-4fd3-bbda-fe938b51a397 req-0e5aa203-eab8-4871-b326-a62d3528d9f0 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=432d7a94-0218-4907-bc7c-650f24a5b1e1 HTTP/1.1" status: 200  len: 945 time: 0.0870345
May 25 17:44:47.230131 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-f6ba9cc4-8020-4fd3-bbda-fe938b51a397 req-22ae30ac-39e0-4f3d-a64c-d174338ac27a tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0404885
May 25 17:44:47.503301 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] get_ports_and_sgs() called for port_ids ['8066cba1-4128-4b8c-a5a5-eb7aae2f80cc'] {{(pid=99028) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 25 17:44:47.758159 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0f52860-980a-4cfd-b83e-8a4e39f1b29f req-92437fdc-28d8-49cf-91b0-8a07489ef608 tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:47.759614 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-e0f52860-980a-4cfd-b83e-8a4e39f1b29f req-92437fdc-28d8-49cf-91b0-8a07489ef608 tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] 10.222.0.122 "GET /v2.0/ports?device_id=5dd77d13-488f-4888-88ca-871972724044 HTTP/1.1" status: 200  len: 949 time: 0.0799689
May 25 17:44:47.807445 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-e0f52860-980a-4cfd-b83e-8a4e39f1b29f req-f4795edb-7f95-47d9-97ad-7496198756d2 tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] 10.222.0.122 "GET /v2.0/security-groups?id=bbd044e3-418c-425e-a277-d3ef2e6c73a3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0421069
May 25 17:44:48.125248 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-94614a45-ed38-4f15-beff-bb69957b3102 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:48.429221 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb6b52c6-ec97-443f-bcd1-8e05dec5108f req-a66cd3e8-0ca3-4d59-88eb-53bb2f1b707e tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:48.430927 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-cb6b52c6-ec97-443f-bcd1-8e05dec5108f req-a66cd3e8-0ca3-4d59-88eb-53bb2f1b707e tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=432d7a94-0218-4907-bc7c-650f24a5b1e1 HTTP/1.1" status: 200  len: 945 time: 0.0898328
May 25 17:44:48.479560 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-cb6b52c6-ec97-443f-bcd1-8e05dec5108f req-a12e90be-8d4d-4b5d-9306-4d8d444fa954 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0427363
May 25 17:44:48.698792 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Device 8066cba1-4128-4b8c-a5a5-eb7aae2f80cc up at agent hyperv_hv-cinder-78956 {{(pid=99028) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 17:44:48.851145 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Provisioning for port 8066cba1-4128-4b8c-a5a5-eb7aae2f80cc completed by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 17:44:48.856231 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Provisioning complete for port 8066cba1-4128-4b8c-a5a5-eb7aae2f80cc triggered by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 17:44:48.856607 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:48.986756 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:48.996546 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ff0f1a0-920c-44ed-a8ae-7eb69d3a8039 req-bf6cbe77-108f-4610-a73c-00f3ee11198c tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:48.998017 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-2ff0f1a0-920c-44ed-a8ae-7eb69d3a8039 req-bf6cbe77-108f-4610-a73c-00f3ee11198c tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] 10.222.0.122 "GET /v2.0/ports?device_id=5dd77d13-488f-4888-88ca-871972724044 HTTP/1.1" status: 200  len: 949 time: 0.0790744
May 25 17:44:49.016002 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5dd77d13-488f-4888-88ca-871972724044', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8066cba1-4128-4b8c-a5a5-eb7aae2f80cc'}] {{(pid=99028) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 17:44:49.026890 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] For port 8066cba1-4128-4b8c-a5a5-eb7aae2f80cc, host hv-cinder-78956, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=8066cba1-4128-4b8c-a5a5-eb7aae2f80cc,segment=NetworkSegment(b22125c1-5fbd-40a2-a6a7-0f8662838c08),segment_id=b22125c1-5fbd-40a2-a6a7-0f8662838c08)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:44:49.046696 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-2ff0f1a0-920c-44ed-a8ae-7eb69d3a8039 req-a1d53c8f-ed02-4a9d-af4e-6bad3c04ed61 tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] 10.222.0.122 "GET /v2.0/security-groups?id=bbd044e3-418c-425e-a277-d3ef2e6c73a3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0422010
May 25 17:44:49.063423 dv-cinder-789564-2-iscsi neutron-server[99028]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5dd77d13-488f-4888-88ca-871972724044', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8066cba1-4128-4b8c-a5a5-eb7aae2f80cc', 'code': 200}
May 25 17:44:49.102160 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:49.103948 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:44:49.174485 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Pushing event updated for resources: {'Port': ['ID=8066cba1-4128-4b8c-a5a5-eb7aae2f80cc,revision_number=5']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:44:49.177581 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:44:50.645882 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-3b51ab37-57ec-438a-b2d2-9762d0b4591a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:50.822688 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:51.360867 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d0b1b77-f5e5-4740-b68c-aa0f51ae94bb req-adaeae90-9c75-400e-91b7-3a52823ae816 tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:51.362972 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-4d0b1b77-f5e5-4740-b68c-aa0f51ae94bb req-adaeae90-9c75-400e-91b7-3a52823ae816 tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] 10.222.0.122 "GET /v2.0/ports?device_id=5dd77d13-488f-4888-88ca-871972724044 HTTP/1.1" status: 200  len: 950 time: 0.0835085
May 25 17:44:51.417115 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-4d0b1b77-f5e5-4740-b68c-aa0f51ae94bb req-8433fa48-5ba9-423e-9b92-d17bc9ee4ba7 tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] 10.222.0.122 "GET /v2.0/security-groups?id=bbd044e3-418c-425e-a277-d3ef2e6c73a3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0467870
May 25 17:44:51.545162 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97e192ba-7571-4e16-a3d7-6761511eebf4 req-141df2ba-aae5-4ddb-889b-eadc7a4fb20f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:51.547577 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-97e192ba-7571-4e16-a3d7-6761511eebf4 req-141df2ba-aae5-4ddb-889b-eadc7a4fb20f service neutron] 10.222.0.125 "GET /v2.0/ports?device_id=5dd77d13-488f-4888-88ca-871972724044 HTTP/1.1" status: 200  len: 1103 time: 0.0795617
May 25 17:44:51.592323 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-97e192ba-7571-4e16-a3d7-6761511eebf4 req-4692526a-a7b3-4d90-8e50-1879a1d1bbd9 service neutron] 10.222.0.125 "GET /v2.0/security-groups?id=bbd044e3-418c-425e-a277-d3ef2e6c73a3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0373931
May 25 17:44:51.679779 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-7e261f94-b84f-443e-be49-3bc1ac903b55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:52.629439 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4f9edf7-d9f3-4197-a8e1-f0bb0aba4e78 req-b277b72c-832a-4a52-b8c4-c85dbd6628ae tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:52.631108 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-c4f9edf7-d9f3-4197-a8e1-f0bb0aba4e78 req-b277b72c-832a-4a52-b8c4-c85dbd6628ae tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] 10.222.0.122 "GET /v2.0/ports?device_id=5dd77d13-488f-4888-88ca-871972724044 HTTP/1.1" status: 200  len: 950 time: 0.0962965
May 25 17:44:52.687526 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-c4f9edf7-d9f3-4197-a8e1-f0bb0aba4e78 req-91314816-b94d-4eb8-b6b5-6144a3cbc2c1 tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] 10.222.0.122 "GET /v2.0/security-groups?id=bbd044e3-418c-425e-a277-d3ef2e6c73a3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0501158
May 25 17:44:52.737371 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db036bcf-75f8-4a1b-a9fa-003f5a3b873b req-dc55512d-f4ec-4b77-9b69-2de1c83215f3 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:52.739411 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-db036bcf-75f8-4a1b-a9fa-003f5a3b873b req-dc55512d-f4ec-4b77-9b69-2de1c83215f3 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=432d7a94-0218-4907-bc7c-650f24a5b1e1 HTTP/1.1" status: 200  len: 945 time: 0.0885491
May 25 17:44:52.786927 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-db036bcf-75f8-4a1b-a9fa-003f5a3b873b req-27282133-9183-4d79-a8fa-80fda4d1373a tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0413475
May 25 17:44:53.337518 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-6df2b2a7-a54e-4d57-9be3-033078b9d5b3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:53.895059 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cab66e63-0fbf-405d-b51e-05299da1b6b4 req-12b0e395-116b-42fd-a74d-28a7f3f6bb1f tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:53.896549 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-cab66e63-0fbf-405d-b51e-05299da1b6b4 req-12b0e395-116b-42fd-a74d-28a7f3f6bb1f tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/networks?id=6c7eca3b-72f3-4ba8-9e95-614d64496512 HTTP/1.1" status: 200  len: 814 time: 0.1794617
May 25 17:44:53.912363 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-cab66e63-0fbf-405d-b51e-05299da1b6b4 req-dfeeb77a-347e-4842-b4ec-7edfa2c80daa tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/quotas/5ae575cfd07c4a88aa626c15e6bccfd9 HTTP/1.1" status: 200  len: 375 time: 0.0102029
May 25 17:44:53.914492 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ccd210e-4ee6-4a32-b929-dd7bf74668e5 req-cb4e4738-954e-4fe9-a495-51475cb47f39 tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:53.916065 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-1ccd210e-4ee6-4a32-b929-dd7bf74668e5 req-cb4e4738-954e-4fe9-a495-51475cb47f39 tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] 10.222.0.122 "GET /v2.0/ports?device_id=5dd77d13-488f-4888-88ca-871972724044 HTTP/1.1" status: 200  len: 950 time: 0.0992701
May 25 17:44:53.964341 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-1ccd210e-4ee6-4a32-b929-dd7bf74668e5 req-af4eae38-542a-42f9-985e-4dd9573a667c tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] 10.222.0.122 "GET /v2.0/security-groups?id=bbd044e3-418c-425e-a277-d3ef2e6c73a3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0411055
May 25 17:44:54.008566 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-cab66e63-0fbf-405d-b51e-05299da1b6b4 req-5447013e-2336-4e6f-8b18-ed9d1855f013 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/ports?tenant_id=5ae575cfd07c4a88aa626c15e6bccfd9&fields=id HTTP/1.1" status: 200  len: 348 time: 0.0905232
May 25 17:44:54.163820 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-cab66e63-0fbf-405d-b51e-05299da1b6b4 req-432995f6-b7a6-41e8-a8c1-d796ae5bf51b service neutron] 10.222.0.122 "GET /v2.0/networks/6c7eca3b-72f3-4ba8-9e95-614d64496512?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1476953
May 25 17:44:54.315186 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-cab66e63-0fbf-405d-b51e-05299da1b6b4 req-cb92e55c-9b64-4040-8c55-c16a1947f4e5 service neutron] 10.222.0.122 "GET /v2.0/networks/6c7eca3b-72f3-4ba8-9e95-614d64496512?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1455214
May 25 17:44:54.662317 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-201fa58b-c8ea-4f41-b7a9-00545910f13f req-7e078ba6-5866-4af1-bd2e-2e810acdb814 tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:54.663724 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-201fa58b-c8ea-4f41-b7a9-00545910f13f req-7e078ba6-5866-4af1-bd2e-2e810acdb814 tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] 10.222.0.122 "GET /v2.0/ports?device_id=5dd77d13-488f-4888-88ca-871972724044 HTTP/1.1" status: 200  len: 950 time: 0.1041596
May 25 17:44:54.726193 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-201fa58b-c8ea-4f41-b7a9-00545910f13f req-9ae1f123-898c-4271-a014-4a3ad2fa6d64 tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] 10.222.0.122 "GET /v2.0/security-groups?id=bbd044e3-418c-425e-a277-d3ef2e6c73a3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0512776
May 25 17:44:54.813241 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-21d7b217-b3c1-4731-b3ab-c46e7bd5acc2 req-28c53bd8-7d28-470d-b0aa-c7bb622a4fd7 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/ports?device_id=bae2e9d5-1cac-484c-80c2-34799cc5fb40 HTTP/1.1" status: 200  len: 210 time: 0.0438106
May 25 17:44:56.911844 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-9b254645-f211-45e4-adc8-a92cd8ccd128 req-83e6edd9-7a01-460b-a2fd-e529450d89c6 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/ports?device_id=bae2e9d5-1cac-484c-80c2-34799cc5fb40 HTTP/1.1" status: 200  len: 210 time: 0.0448601
May 25 17:44:56.950043 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de3d674f-4f97-4286-b2d5-a9a3de26e1f1 req-18c1f3e4-9b36-4d54-b880-6f870ade0796 tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:56.951518 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-de3d674f-4f97-4286-b2d5-a9a3de26e1f1 req-18c1f3e4-9b36-4d54-b880-6f870ade0796 tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] 10.222.0.122 "GET /v2.0/ports?device_id=5dd77d13-488f-4888-88ca-871972724044 HTTP/1.1" status: 200  len: 950 time: 0.0839813
May 25 17:44:56.999344 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-de3d674f-4f97-4286-b2d5-a9a3de26e1f1 req-bc0287ca-f240-4c62-8da4-bf85337cdba8 tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] 10.222.0.122 "GET /v2.0/security-groups?id=bbd044e3-418c-425e-a277-d3ef2e6c73a3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0413952
May 25 17:44:58.096148 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cab66e63-0fbf-405d-b51e-05299da1b6b4 req-86104d6c-004b-4559-a0a8-f08a06dfa8d4 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:58.097626 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-cab66e63-0fbf-405d-b51e-05299da1b6b4 req-86104d6c-004b-4559-a0a8-f08a06dfa8d4 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.125 "GET /v2.0/networks?id=6c7eca3b-72f3-4ba8-9e95-614d64496512 HTTP/1.1" status: 200  len: 814 time: 0.1573610
May 25 17:44:58.110711 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.v2.base [req-cab66e63-0fbf-405d-b51e-05299da1b6b4 req-38583416-a71d-4900-9f4f-c20333fc238c tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Request body: {'port': {'device_id': 'bae2e9d5-1cac-484c-80c2-34799cc5fb40', 'network_id': '6c7eca3b-72f3-4ba8-9e95-614d64496512', 'admin_state_up': True, 'tenant_id': '5ae575cfd07c4a88aa626c15e6bccfd9'}} {{(pid=99027) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:44:58.332826 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-7ea7dcaa-4df3-4e50-8206-f63a2519122d req-a64cf7ae-cfb7-4962-a2f9-381eab89b36a tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/ports?device_id=bae2e9d5-1cac-484c-80c2-34799cc5fb40 HTTP/1.1" status: 200  len: 210 time: 0.0636156
May 25 17:44:58.371973 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa3cc86a-0b7e-49e8-95bf-336a32bb972d req-643de4a5-3554-4043-8519-5f92a72930af tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:58.375145 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-aa3cc86a-0b7e-49e8-95bf-336a32bb972d req-643de4a5-3554-4043-8519-5f92a72930af tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] 10.222.0.125 "GET /v2.0/ports?device_id=5dd77d13-488f-4888-88ca-871972724044 HTTP/1.1" status: 200  len: 950 time: 0.1817942
May 25 17:44:58.481434 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [req-cab66e63-0fbf-405d-b51e-05299da1b6b4 req-38583416-a71d-4900-9f4f-c20333fc238c tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:44:58.496191 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [req-cab66e63-0fbf-405d-b51e-05299da1b6b4 req-38583416-a71d-4900-9f4f-c20333fc238c tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:44:58.519544 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b24ee8b-2cb1-4581-8982-e99b417cb068 req-c187a78b-58b3-4df8-b1c2-598422ce1e55 tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:58.521416 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-8b24ee8b-2cb1-4581-8982-e99b417cb068 req-c187a78b-58b3-4df8-b1c2-598422ce1e55 tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] 10.222.0.122 "GET /v2.0/ports?device_id=5dd77d13-488f-4888-88ca-871972724044 HTTP/1.1" status: 200  len: 950 time: 0.2763839
May 25 17:44:58.552623 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.plugin [req-aa3cc86a-0b7e-49e8-95bf-336a32bb972d req-4a013feb-8733-4e80-85ef-1a802f072647 tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] Deleting port 8066cba1-4128-4b8c-a5a5-eb7aae2f80cc {{(pid=99026) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 17:44:58.552623 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [req-aa3cc86a-0b7e-49e8-95bf-336a32bb972d req-4a013feb-8733-4e80-85ef-1a802f072647 tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781841220419'] for port, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:58.570129 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-8b24ee8b-2cb1-4581-8982-e99b417cb068 req-de33d697-b987-4882-89a0-fc45c200b1cc tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] 10.222.0.122 "GET /v2.0/security-groups?id=bbd044e3-418c-425e-a277-d3ef2e6c73a3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0429711
May 25 17:44:58.605865 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-cab66e63-0fbf-405d-b51e-05299da1b6b4 req-38583416-a71d-4900-9f4f-c20333fc238c tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Made reservation on behalf of 5ae575cfd07c4a88aa626c15e6bccfd9 for: {'port': 1} {{(pid=99027) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 17:44:58.610719 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-cab66e63-0fbf-405d-b51e-05299da1b6b4 req-38583416-a71d-4900-9f4f-c20333fc238c tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:58.716944 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.db [req-aa3cc86a-0b7e-49e8-95bf-336a32bb972d req-4a013feb-8733-4e80-85ef-1a802f072647 tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] For port 8066cba1-4128-4b8c-a5a5-eb7aae2f80cc, host hv-cinder-78956, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=8066cba1-4128-4b8c-a5a5-eb7aae2f80cc,segment=NetworkSegment(b22125c1-5fbd-40a2-a6a7-0f8662838c08),segment_id=b22125c1-5fbd-40a2-a6a7-0f8662838c08)] {{(pid=99026) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:44:58.718235 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [req-aa3cc86a-0b7e-49e8-95bf-336a32bb972d req-4a013feb-8733-4e80-85ef-1a802f072647 tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-418810'] for port, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:58.822628 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.db_base_plugin_common [req-cab66e63-0fbf-405d-b51e-05299da1b6b4 req-38583416-a71d-4900-9f4f-c20333fc238c tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Allocated IP 172.20.0.4 (6c7eca3b-72f3-4ba8-9e95-614d64496512/279772c8-d366-4fc6-9c34-e6ddf99b5e08/ea15af4a-963c-46da-9f67-5e7f195ae1b3) {{(pid=99027) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 17:44:58.936538 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.plugin [req-aa3cc86a-0b7e-49e8-95bf-336a32bb972d req-4a013feb-8733-4e80-85ef-1a802f072647 tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] Calling delete_port for 8066cba1-4128-4b8c-a5a5-eb7aae2f80cc owned by compute:nova {{(pid=99026) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 17:44:59.053635 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-cab66e63-0fbf-405d-b51e-05299da1b6b4 req-38583416-a71d-4900-9f4f-c20333fc238c tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Notify callbacks [] for port, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:59.160391 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-cab66e63-0fbf-405d-b51e-05299da1b6b4 req-38583416-a71d-4900-9f4f-c20333fc238c tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781840788179', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15468986'] for port, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:59.176671 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-0f91ea39-ed43-4abc-be70-c85f8ec77b7c service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:44:59.211793 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [req-aa3cc86a-0b7e-49e8-95bf-336a32bb972d req-4a013feb-8733-4e80-85ef-1a802f072647 tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781841222566', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781840788188', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15476536'] for port, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:59.219055 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:44:59.224250 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] get_ports_and_sgs() called for port_ids ['4698ed19-7e41-4457-a1fd-16d5f606084a', 'cd9e7667-ca15-4541-9b3a-687f6f585523', 'db138deb-607b-422a-8726-ecea43965047'] {{(pid=99028) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 25 17:44:59.260868 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-cab66e63-0fbf-405d-b51e-05299da1b6b4 req-38583416-a71d-4900-9f4f-c20333fc238c tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Network 6c7eca3b-72f3-4ba8-9e95-614d64496512 is already hosted by enough agents. {{(pid=99027) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 17:44:59.271244 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.base_scheduler [req-cab66e63-0fbf-405d-b51e-05299da1b6b4 req-38583416-a71d-4900-9f4f-c20333fc238c tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Resources bound (agent type, host, resource id):  {{(pid=99027) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 17:44:59.273392 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38583416-a71d-4900-9f4f-c20333fc238c tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Pushing event updated for resources: {'Port': ['ID=ea15af4a-963c-46da-9f67-5e7f195ae1b3,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:44:59.293345 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.l3_dvrscheduler_db [req-cab66e63-0fbf-405d-b51e-05299da1b6b4 req-38583416-a71d-4900-9f4f-c20333fc238c tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Received port after_create {{(pid=99027) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 17:44:59.294021 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a013feb-8733-4e80-85ef-1a802f072647 tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] Pushing event deleted for resources: {'Port': ['ID=8066cba1-4128-4b8c-a5a5-eb7aae2f80cc,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:44:59.295233 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-4a013feb-8733-4e80-85ef-1a802f072647 tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:44:59.321529 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-38583416-a71d-4900-9f4f-c20333fc238c tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.155s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:44:59.372567 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.l3_dvrscheduler_db [req-aa3cc86a-0b7e-49e8-95bf-336a32bb972d req-4a013feb-8733-4e80-85ef-1a802f072647 tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] No DVR routers for this DVR port 8066cba1-4128-4b8c-a5a5-eb7aae2f80cc on host hv-cinder-78956 {{(pid=99026) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 25 17:44:59.373320 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cab66e63-0fbf-405d-b51e-05299da1b6b4 req-38583416-a71d-4900-9f4f-c20333fc238c tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:59.376685 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [req-aa3cc86a-0b7e-49e8-95bf-336a32bb972d req-4a013feb-8733-4e80-85ef-1a802f072647 tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-239387'] for port, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:59.377526 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-cab66e63-0fbf-405d-b51e-05299da1b6b4 req-38583416-a71d-4900-9f4f-c20333fc238c tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-239387'] for port, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:59.379772 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5dd77d13-488f-4888-88ca-871972724044', 'name': 'network-vif-deleted', 'tag': '8066cba1-4128-4b8c-a5a5-eb7aae2f80cc'}] {{(pid=99026) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 17:44:59.460452 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5dd77d13-488f-4888-88ca-871972724044', 'name': 'network-vif-deleted', 'tag': '8066cba1-4128-4b8c-a5a5-eb7aae2f80cc', 'status': 'completed', 'code': 200}
May 25 17:44:59.520728 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-cab66e63-0fbf-405d-b51e-05299da1b6b4 req-38583416-a71d-4900-9f4f-c20333fc238c tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.125 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.4141676
May 25 17:44:59.539513 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.v2.base [req-cab66e63-0fbf-405d-b51e-05299da1b6b4 req-72f30d11-db2b-4fc0-a58f-ed209d4bab7c service neutron] Request body: {'port': {'device_id': 'bae2e9d5-1cac-484c-80c2-34799cc5fb40', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78956'}} {{(pid=99027) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:44:59.562994 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-aa3cc86a-0b7e-49e8-95bf-336a32bb972d req-4a013feb-8733-4e80-85ef-1a802f072647 tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] 10.222.0.125 "DELETE /v2.0/ports/8066cba1-4128-4b8c-a5a5-eb7aae2f80cc HTTP/1.1" status: 204  len: 173 time: 1.1825154
May 25 17:44:59.596030 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf82221e-47de-4fe3-93c5-a2b68787cd62 req-14e9ef5a-ae81-44be-9fdb-076adae443c6 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:44:59.597839 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-bf82221e-47de-4fe3-93c5-a2b68787cd62 req-14e9ef5a-ae81-44be-9fdb-076adae443c6 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/ports?device_id=bae2e9d5-1cac-484c-80c2-34799cc5fb40 HTTP/1.1" status: 200  len: 931 time: 0.1001303
May 25 17:44:59.669220 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-bf82221e-47de-4fe3-93c5-a2b68787cd62 req-1ced9195-8b75-4158-9e14-3cea9dd170cf tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/security-groups?id=dda11ec6-545c-479e-bba9-4390fea678fa&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0563984
May 25 17:44:59.747977 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-cab66e63-0fbf-405d-b51e-05299da1b6b4 req-72f30d11-db2b-4fc0-a58f-ed209d4bab7c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:44:59.762523 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-bc95c5c6-3418-440f-85fc-54ef7515befd req-d9cb9910-b9ca-4a62-b389-8d371e3add25 tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] 10.222.0.122 "GET /v2.0/ports?device_id=5dd77d13-488f-4888-88ca-871972724044 HTTP/1.1" status: 200  len: 210 time: 0.0669410
May 25 17:45:00.131242 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.notifiers.nova [req-cab66e63-0fbf-405d-b51e-05299da1b6b4 req-72f30d11-db2b-4fc0-a58f-ed209d4bab7c service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id ea15af4a-963c-46da-9f67-5e7f195ae1b3 {{(pid=99027) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 25 17:45:00.138635 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-cab66e63-0fbf-405d-b51e-05299da1b6b4 req-72f30d11-db2b-4fc0-a58f-ed209d4bab7c service neutron] Notify callbacks [] for port, precommit_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:00.152951 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.provisioning_blocks [req-cab66e63-0fbf-405d-b51e-05299da1b6b4 req-72f30d11-db2b-4fc0-a58f-ed209d4bab7c service neutron] Transition to ACTIVE for port object ea15af4a-963c-46da-9f67-5e7f195ae1b3 will not be triggered until provisioned by entity L2. {{(pid=99027) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 17:45:00.270253 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-cab66e63-0fbf-405d-b51e-05299da1b6b4 req-72f30d11-db2b-4fc0-a58f-ed209d4bab7c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15468979'] for port, after_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:00.273210 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-5bde7c25-5ae1-489b-9a7d-86209365f2f2 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:45:00.351116 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] get_ports_and_sgs() called for port_ids ['8066cba1-4128-4b8c-a5a5-eb7aae2f80cc'] {{(pid=99028) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 25 17:45:00.405928 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-72f30d11-db2b-4fc0-a58f-ed209d4bab7c service neutron] Pushing event updated for resources: {'Port': ['ID=ea15af4a-963c-46da-9f67-5e7f195ae1b3,revision_number=2']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:45:00.439597 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-72f30d11-db2b-4fc0-a58f-ed209d4bab7c service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.165s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:45:00.510259 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.managers [req-cab66e63-0fbf-405d-b51e-05299da1b6b4 req-72f30d11-db2b-4fc0-a58f-ed209d4bab7c service neutron] Attempting to bind port ea15af4a-963c-46da-9f67-5e7f195ae1b3 on host hv-cinder-78956 for vnic_type normal with profile  {{(pid=99027) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 17:45:00.510517 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.managers [req-cab66e63-0fbf-405d-b51e-05299da1b6b4 req-72f30d11-db2b-4fc0-a58f-ed209d4bab7c service neutron] Attempting to bind port ea15af4a-963c-46da-9f67-5e7f195ae1b3 by drivers openvswitch,hyperv on host hv-cinder-78956 at level 0 using segments [{'id': '87df170f-54cc-461b-a7ac-79e125fc526b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1304, 'network_id': '6c7eca3b-72f3-4ba8-9e95-614d64496512'}] {{(pid=99027) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 17:45:00.510835 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cab66e63-0fbf-405d-b51e-05299da1b6b4 req-72f30d11-db2b-4fc0-a58f-ed209d4bab7c service neutron] Attempting to bind port ea15af4a-963c-46da-9f67-5e7f195ae1b3 on network 6c7eca3b-72f3-4ba8-9e95-614d64496512 {{(pid=99027) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 17:45:00.516008 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cab66e63-0fbf-405d-b51e-05299da1b6b4 req-72f30d11-db2b-4fc0-a58f-ed209d4bab7c service neutron] Port ea15af4a-963c-46da-9f67-5e7f195ae1b3 on network 6c7eca3b-72f3-4ba8-9e95-614d64496512 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78956 {{(pid=99027) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 25 17:45:00.516358 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cab66e63-0fbf-405d-b51e-05299da1b6b4 req-72f30d11-db2b-4fc0-a58f-ed209d4bab7c service neutron] Attempting to bind port ea15af4a-963c-46da-9f67-5e7f195ae1b3 on network 6c7eca3b-72f3-4ba8-9e95-614d64496512 {{(pid=99027) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 17:45:00.521402 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cab66e63-0fbf-405d-b51e-05299da1b6b4 req-72f30d11-db2b-4fc0-a58f-ed209d4bab7c service neutron] Checking agent: {'id': '4d02a528-6a0e-4977-985f-4bcff1ca6cb7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78956', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 17, 40, 41), 'started_at': datetime.datetime(2021, 5, 25, 17, 40, 41), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 17, 44, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=99027) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 17:45:00.521727 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cab66e63-0fbf-405d-b51e-05299da1b6b4 req-72f30d11-db2b-4fc0-a58f-ed209d4bab7c service neutron] Checking segment: {'id': '87df170f-54cc-461b-a7ac-79e125fc526b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1304, 'network_id': '6c7eca3b-72f3-4ba8-9e95-614d64496512'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=99027) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 17:45:00.522099 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cab66e63-0fbf-405d-b51e-05299da1b6b4 req-72f30d11-db2b-4fc0-a58f-ed209d4bab7c service neutron] Bound using segment: {'id': '87df170f-54cc-461b-a7ac-79e125fc526b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1304, 'network_id': '6c7eca3b-72f3-4ba8-9e95-614d64496512'} {{(pid=99027) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 17:45:00.522507 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.managers [req-cab66e63-0fbf-405d-b51e-05299da1b6b4 req-72f30d11-db2b-4fc0-a58f-ed209d4bab7c service neutron] Bound port: ea15af4a-963c-46da-9f67-5e7f195ae1b3, host: hv-cinder-78956, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '87df170f-54cc-461b-a7ac-79e125fc526b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1304, 'network_id': '6c7eca3b-72f3-4ba8-9e95-614d64496512'}}] {{(pid=99027) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 17:45:00.522841 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-cab66e63-0fbf-405d-b51e-05299da1b6b4 req-72f30d11-db2b-4fc0-a58f-ed209d4bab7c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:00.614895 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.db [req-cab66e63-0fbf-405d-b51e-05299da1b6b4 req-72f30d11-db2b-4fc0-a58f-ed209d4bab7c service neutron] For port ea15af4a-963c-46da-9f67-5e7f195ae1b3, host hv-cinder-78956, cleared binding levels {{(pid=99027) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 17:45:00.618199 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.db [req-cab66e63-0fbf-405d-b51e-05299da1b6b4 req-72f30d11-db2b-4fc0-a58f-ed209d4bab7c service neutron] For port ea15af4a-963c-46da-9f67-5e7f195ae1b3, host hv-cinder-78956, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=ea15af4a-963c-46da-9f67-5e7f195ae1b3,segment=NetworkSegment(87df170f-54cc-461b-a7ac-79e125fc526b),segment_id=87df170f-54cc-461b-a7ac-79e125fc526b)] {{(pid=99027) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 17:45:00.737339 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-cab66e63-0fbf-405d-b51e-05299da1b6b4 req-72f30d11-db2b-4fc0-a58f-ed209d4bab7c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15468979'] for port, after_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:00.747151 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-9f9d9046-5585-4035-a15a-4f713f977a4c service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:45:00.826299 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-72f30d11-db2b-4fc0-a58f-ed209d4bab7c service neutron] Pushing event updated for resources: {'Port': ['ID=ea15af4a-963c-46da-9f67-5e7f195ae1b3,revision_number=3']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:45:00.842081 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-72f30d11-db2b-4fc0-a58f-ed209d4bab7c service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.095s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:45:00.844495 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cab66e63-0fbf-405d-b51e-05299da1b6b4 req-72f30d11-db2b-4fc0-a58f-ed209d4bab7c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:45:00.845688 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-cab66e63-0fbf-405d-b51e-05299da1b6b4 req-72f30d11-db2b-4fc0-a58f-ed209d4bab7c service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-239387'] for port, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:00.848065 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-cab66e63-0fbf-405d-b51e-05299da1b6b4 req-72f30d11-db2b-4fc0-a58f-ed209d4bab7c service neutron] 10.222.0.125 "PUT /v2.0/ports/ea15af4a-963c-46da-9f67-5e7f195ae1b3 HTTP/1.1" status: 200  len: 1093 time: 1.3147268
May 25 17:45:00.848990 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'bae2e9d5-1cac-484c-80c2-34799cc5fb40', 'tag': 'ea15af4a-963c-46da-9f67-5e7f195ae1b3'}] {{(pid=99027) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 17:45:00.866525 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 44206) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:45:00.914628 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31acfaa1-0a27-4fef-9767-07cc8042d33b req-dd8174ae-9c7a-4064-9859-96dfe5f8eb0c tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:45:00.916251 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-31acfaa1-0a27-4fef-9767-07cc8042d33b req-dd8174ae-9c7a-4064-9859-96dfe5f8eb0c tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/ports?device_id=bae2e9d5-1cac-484c-80c2-34799cc5fb40 HTTP/1.1" status: 200  len: 943 time: 0.1191378
May 25 17:45:00.951813 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-3033a38d-1ff6-41ca-bb69-934b9cdb5de9 req-299db758-44d4-4b44-b3cd-768179628cc1 tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] 10.222.0.122 "GET /v2.0/ports?device_id=5dd77d13-488f-4888-88ca-871972724044 HTTP/1.1" status: 200  len: 210 time: 0.0510592
May 25 17:45:00.981189 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-31acfaa1-0a27-4fef-9767-07cc8042d33b req-384dd163-2028-42e4-b1c0-a8a065f97c40 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/security-groups?id=dda11ec6-545c-479e-bba9-4390fea678fa&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0580764
May 25 17:45:01.010906 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'bae2e9d5-1cac-484c-80c2-34799cc5fb40', 'tag': 'ea15af4a-963c-46da-9f67-5e7f195ae1b3', 'status': 'completed', 'code': 200}
May 25 17:45:01.057752 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-1b69bf05-006c-459f-bcbe-ff9aa282d72e admin admin] Notify callbacks [] for security_group, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:01.071781 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-1b69bf05-006c-459f-bcbe-ff9aa282d72e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:45:01.075507 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-1b69bf05-006c-459f-bcbe-ff9aa282d72e admin admin] Usage tracker for resource:security_group_rule and tenant:4ca2b6987517442dad6f4752df925ed8 is out of sync, need to count used quota {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:45:01.079029 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-1b69bf05-006c-459f-bcbe-ff9aa282d72e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:45:01.084549 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-1b69bf05-006c-459f-bcbe-ff9aa282d72e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:45:01.103279 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cab66e63-0fbf-405d-b51e-05299da1b6b4 req-6e28e470-72c5-4073-86f7-a6c061b94770 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:45:01.104763 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-cab66e63-0fbf-405d-b51e-05299da1b6b4 req-6e28e470-72c5-4073-86f7-a6c061b94770 service neutron] 10.222.0.125 "GET /v2.0/ports?tenant_id=5ae575cfd07c4a88aa626c15e6bccfd9&device_id=bae2e9d5-1cac-484c-80c2-34799cc5fb40 HTTP/1.1" status: 200  len: 1096 time: 0.0725992
May 25 17:45:01.188832 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-1b69bf05-006c-459f-bcbe-ff9aa282d72e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:01.272075 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-cab66e63-0fbf-405d-b51e-05299da1b6b4 req-aacb3abd-8c3a-4f9e-83f4-1d84f85ce839 service neutron] 10.222.0.125 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=ea15af4a-963c-46da-9f67-5e7f195ae1b3 HTTP/1.1" status: 200  len: 217 time: 0.1598146
May 25 17:45:01.290995 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-1b69bf05-006c-459f-bcbe-ff9aa282d72e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:01.300543 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-61c5eb24-c63e-41c6-9b18-572a0526d57c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:45:01.338819 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cab66e63-0fbf-405d-b51e-05299da1b6b4 req-438ec8ef-5ce4-45ef-9315-3965bcf52dcb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:45:01.343592 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-cab66e63-0fbf-405d-b51e-05299da1b6b4 req-438ec8ef-5ce4-45ef-9315-3965bcf52dcb service neutron] 10.222.0.125 "GET /v2.0/subnets?id=279772c8-d366-4fc6-9c34-e6ddf99b5e08 HTTP/1.1" status: 200  len: 854 time: 0.0588448
May 25 17:45:01.343753 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-1b69bf05-006c-459f-bcbe-ff9aa282d72e admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=4ca2b6987517442dad6f4752df925ed8&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4731355
May 25 17:45:01.343753 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b69bf05-006c-459f-bcbe-ff9aa282d72e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ebda2940-28aa-4d9d-a589-b6784c3b79fd,revision_number=1']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:45:01.344031 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 44216) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:45:01.346257 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-1b69bf05-006c-459f-bcbe-ff9aa282d72e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:45:01.407063 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-cab66e63-0fbf-405d-b51e-05299da1b6b4 req-e14fb78f-f5f4-4a96-a1ae-1988e4411511 service neutron] 10.222.0.125 "GET /v2.0/ports?network_id=6c7eca3b-72f3-4ba8-9e95-614d64496512&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0493033
May 25 17:45:01.544531 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-66679d61-0cca-47d0-969e-1add8b2bae6b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:01.596889 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-66679d61-0cca-47d0-969e-1add8b2bae6b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:01.607766 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-cab66e63-0fbf-405d-b51e-05299da1b6b4 req-c8a5bb48-85b4-4706-96e8-c8b8833cf62a service neutron] 10.222.0.125 "GET /v2.0/networks/6c7eca3b-72f3-4ba8-9e95-614d64496512?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1926696
May 25 17:45:01.758143 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-cab66e63-0fbf-405d-b51e-05299da1b6b4 req-24dfa68c-a7d8-4ca1-9150-3af7aff635f1 service neutron] 10.222.0.125 "GET /v2.0/networks/6c7eca3b-72f3-4ba8-9e95-614d64496512?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1419487
May 25 17:45:01.833783 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-66679d61-0cca-47d0-969e-1add8b2bae6b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:01.838748 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-bdfb0b74-f7a8-4efb-b0d0-30f7981ab2fc admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:45:01.850411 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-66679d61-0cca-47d0-969e-1add8b2bae6b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ebda2940-28aa-4d9d-a589-b6784c3b79fd,revision_number=None']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:45:01.853273 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-66679d61-0cca-47d0-969e-1add8b2bae6b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:45:01.855201 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-66679d61-0cca-47d0-969e-1add8b2bae6b admin admin] Notify callbacks [] for security_group, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:01.856286 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-66679d61-0cca-47d0-969e-1add8b2bae6b admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/ebda2940-28aa-4d9d-a589-b6784c3b79fd HTTP/1.1" status: 204  len: 168 time: 0.5112584
May 25 17:45:01.996191 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8919ce20-70be-4ce0-87fe-4fb884ae4295 req-f2b30e93-1d3b-4de8-b4c4-28713fae176d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:45:01.997723 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-8919ce20-70be-4ce0-87fe-4fb884ae4295 req-f2b30e93-1d3b-4de8-b4c4-28713fae176d service neutron] 10.222.0.125 "GET /v2.0/ports?tenant_id=5ae575cfd07c4a88aa626c15e6bccfd9&device_id=bae2e9d5-1cac-484c-80c2-34799cc5fb40 HTTP/1.1" status: 200  len: 1096 time: 0.0744956
May 25 17:45:02.191041 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8919ce20-70be-4ce0-87fe-4fb884ae4295 req-f24920ae-ec4f-4c4b-93d0-022c059c3b44 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:45:02.192587 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-8919ce20-70be-4ce0-87fe-4fb884ae4295 req-f24920ae-ec4f-4c4b-93d0-022c059c3b44 service neutron] 10.222.0.125 "GET /v2.0/networks?id=6c7eca3b-72f3-4ba8-9e95-614d64496512 HTTP/1.1" status: 200  len: 916 time: 0.1852331
May 25 17:45:02.274294 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-8919ce20-70be-4ce0-87fe-4fb884ae4295 req-1df7d697-5f43-4bae-be1a-6be1c49a013f service neutron] 10.222.0.125 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=ea15af4a-963c-46da-9f67-5e7f195ae1b3 HTTP/1.1" status: 200  len: 217 time: 0.0727119
May 25 17:45:02.286559 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24bd4b81-f908-4d70-bc3a-d1c097ef3a28 req-af75f49f-e23a-42c2-b7cc-9a09d198b939 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:45:02.287233 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-24bd4b81-f908-4d70-bc3a-d1c097ef3a28 req-af75f49f-e23a-42c2-b7cc-9a09d198b939 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Synchronizing usage tracker for tenant:5ae575cfd07c4a88aa626c15e6bccfd9 on resource:port {{(pid=99027) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 17:45:02.354138 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8919ce20-70be-4ce0-87fe-4fb884ae4295 req-af38d09d-c4ea-415e-a6e8-bb83f4a23a58 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:45:02.355529 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-8919ce20-70be-4ce0-87fe-4fb884ae4295 req-af38d09d-c4ea-415e-a6e8-bb83f4a23a58 service neutron] 10.222.0.125 "GET /v2.0/subnets?id=279772c8-d366-4fc6-9c34-e6ddf99b5e08 HTTP/1.1" status: 200  len: 854 time: 0.0656400
May 25 17:45:02.410752 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-8919ce20-70be-4ce0-87fe-4fb884ae4295 req-aebc2a7b-6845-4446-b357-8a0ab2c087de service neutron] 10.222.0.125 "GET /v2.0/ports?network_id=6c7eca3b-72f3-4ba8-9e95-614d64496512&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0470767
May 25 17:45:02.535479 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-24bd4b81-f908-4d70-bc3a-d1c097ef3a28 req-af75f49f-e23a-42c2-b7cc-9a09d198b939 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Unset dirty status for tenant:5ae575cfd07c4a88aa626c15e6bccfd9 on resource:port {{(pid=99027) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 17:45:02.543061 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-24bd4b81-f908-4d70-bc3a-d1c097ef3a28 req-af75f49f-e23a-42c2-b7cc-9a09d198b939 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/ports?device_id=bae2e9d5-1cac-484c-80c2-34799cc5fb40 HTTP/1.1" status: 200  len: 943 time: 0.4215627
May 25 17:45:02.582204 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-8919ce20-70be-4ce0-87fe-4fb884ae4295 req-30b1f50d-edfd-4a9f-8cdb-3e2970151621 service neutron] 10.222.0.125 "GET /v2.0/networks/6c7eca3b-72f3-4ba8-9e95-614d64496512?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1591659
May 25 17:45:02.705545 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-24bd4b81-f908-4d70-bc3a-d1c097ef3a28 req-3ca1d6c1-9e8c-4c18-9cab-1bab88220189 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/security-groups?id=dda11ec6-545c-479e-bba9-4390fea678fa&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1609924
May 25 17:45:02.774343 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 44272) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:45:02.776867 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Device 8066cba1-4128-4b8c-a5a5-eb7aae2f80cc no longer exists at agent hyperv_hv-cinder-78956 {{(pid=99028) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 17:45:02.784254 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-8919ce20-70be-4ce0-87fe-4fb884ae4295 req-05b671c9-84fe-476d-9364-faba4255675a service neutron] 10.222.0.125 "GET /v2.0/networks/6c7eca3b-72f3-4ba8-9e95-614d64496512?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1905248
May 25 17:45:02.793332 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-c10307c2-e967-4ee0-9f83-3c8e51fbcc53 admin admin] Notify callbacks [] for security_group, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:02.810105 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-c10307c2-e967-4ee0-9f83-3c8e51fbcc53 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:45:02.819043 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.plugin [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] No Port match for: 8066cba1-4128-4b8c-a5a5-eb7aae2f80cc {{(pid=99028) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 25 17:45:02.819461 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Device 8066cba1-4128-4b8c-a5a5-eb7aae2f80cc not bound to the agent host hv-cinder-78956 {{(pid=99028) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 25 17:45:02.820025 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-c10307c2-e967-4ee0-9f83-3c8e51fbcc53 admin admin] Usage tracker for resource:security_group_rule and tenant:0953b10fdcaa4c838ebffd4e779b2336 is out of sync, need to count used quota {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:45:02.824492 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-c10307c2-e967-4ee0-9f83-3c8e51fbcc53 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:45:02.831683 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-c10307c2-e967-4ee0-9f83-3c8e51fbcc53 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:45:02.918275 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-c10307c2-e967-4ee0-9f83-3c8e51fbcc53 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:03.027962 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-c10307c2-e967-4ee0-9f83-3c8e51fbcc53 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:03.041207 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-1db69526-beb4-4583-b426-7e936505ce3c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:45:03.081216 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-c10307c2-e967-4ee0-9f83-3c8e51fbcc53 admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=0953b10fdcaa4c838ebffd4e779b2336&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3057525
May 25 17:45:03.082874 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c10307c2-e967-4ee0-9f83-3c8e51fbcc53 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=48825f91-240e-492b-b7bc-06df4008fcf5,revision_number=1']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:45:03.083905 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 44282) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:45:03.095822 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-c10307c2-e967-4ee0-9f83-3c8e51fbcc53 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:45:03.153767 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-13c47f88-42d1-4f19-9d90-2931dc540419 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:03.187538 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-13c47f88-42d1-4f19-9d90-2931dc540419 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:03.330916 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-13c47f88-42d1-4f19-9d90-2931dc540419 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:03.335740 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:45:03.351287 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13c47f88-42d1-4f19-9d90-2931dc540419 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=48825f91-240e-492b-b7bc-06df4008fcf5,revision_number=None']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:45:03.354180 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-13c47f88-42d1-4f19-9d90-2931dc540419 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:45:03.356070 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-13c47f88-42d1-4f19-9d90-2931dc540419 admin admin] Notify callbacks [] for security_group, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:03.360538 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-13c47f88-42d1-4f19-9d90-2931dc540419 admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/48825f91-240e-492b-b7bc-06df4008fcf5 HTTP/1.1" status: 204  len: 168 time: 0.2754147
May 25 17:45:03.905822 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1052ce18-7926-4af6-a00a-898558e9aa26 req-f41bc4da-42d5-4043-b06c-c87e98d63632 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:45:03.907975 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-1052ce18-7926-4af6-a00a-898558e9aa26 req-f41bc4da-42d5-4043-b06c-c87e98d63632 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/ports?device_id=bae2e9d5-1cac-484c-80c2-34799cc5fb40 HTTP/1.1" status: 200  len: 943 time: 0.0908828
May 25 17:45:03.961639 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-1052ce18-7926-4af6-a00a-898558e9aa26 req-4576e15e-db62-42bb-bb11-d182aa9f7d93 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/security-groups?id=dda11ec6-545c-479e-bba9-4390fea678fa&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0475302
May 25 17:45:04.619775 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 44386) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:45:04.772693 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-fc127a89-0913-4c36-b151-d39e9f255219 admin admin] Notify callbacks [] for security_group, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:04.795179 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Device ea15af4a-963c-46da-9f67-5e7f195ae1b3 details requested by agent hyperv_hv-cinder-78956 with host hv-cinder-78956 {{(pid=99028) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 25 17:45:04.796333 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-fc127a89-0913-4c36-b151-d39e9f255219 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:45:04.801881 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-fc127a89-0913-4c36-b151-d39e9f255219 admin admin] Usage tracker for resource:security_group_rule and tenant:b2a41ecec4204a8b913886abb78e2638 is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:45:04.804797 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-fc127a89-0913-4c36-b151-d39e9f255219 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:45:04.812110 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-fc127a89-0913-4c36-b151-d39e9f255219 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:45:04.943823 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-fc127a89-0913-4c36-b151-d39e9f255219 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:04.987081 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] For port ea15af4a-963c-46da-9f67-5e7f195ae1b3, host hv-cinder-78956, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=ea15af4a-963c-46da-9f67-5e7f195ae1b3,segment=NetworkSegment(87df170f-54cc-461b-a7ac-79e125fc526b),segment_id=87df170f-54cc-461b-a7ac-79e125fc526b)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:45:05.005735 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-fc127a89-0913-4c36-b151-d39e9f255219 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:05.007449 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Returning: {'device': 'ea15af4a-963c-46da-9f67-5e7f195ae1b3', 'network_id': '6c7eca3b-72f3-4ba8-9e95-614d64496512', 'port_id': 'ea15af4a-963c-46da-9f67-5e7f195ae1b3', 'mac_address': 'fa:16:3e:03:88:da', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1304, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '279772c8-d366-4fc6-9c34-e6ddf99b5e08', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=99028) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 25 17:45:05.068354 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-6580a7c3-8722-46d8-956d-f4594062a4de admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:45:05.119735 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:05.132011 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-fc127a89-0913-4c36-b151-d39e9f255219 admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=b2a41ecec4204a8b913886abb78e2638&name=default HTTP/1.1" status: 200  len: 2979 time: 0.5111413
May 25 17:45:05.134658 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 44414) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:45:05.152710 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc127a89-0913-4c36-b151-d39e9f255219 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=34706fcd-8591-4e4a-b272-50168cd9a705,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:45:05.156500 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-fc127a89-0913-4c36-b151-d39e9f255219 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:45:05.173741 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.notifiers.nova [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id ea15af4a-963c-46da-9f67-5e7f195ae1b3 {{(pid=99028) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 25 17:45:05.209497 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] For port ea15af4a-963c-46da-9f67-5e7f195ae1b3, host hv-cinder-78956, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=ea15af4a-963c-46da-9f67-5e7f195ae1b3,segment=NetworkSegment(87df170f-54cc-461b-a7ac-79e125fc526b),segment_id=87df170f-54cc-461b-a7ac-79e125fc526b)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:45:05.246469 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-be2682fe-afba-4dee-b1fe-d3ce78933b47 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:05.275297 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-be2682fe-afba-4dee-b1fe-d3ce78933b47 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:05.293770 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca17d14a-c53d-4c41-85bd-4a8c0bd9feb0 req-a78e3ed6-b69d-4a09-af48-6ab429347c9e tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:45:05.296433 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-ca17d14a-c53d-4c41-85bd-4a8c0bd9feb0 req-a78e3ed6-b69d-4a09-af48-6ab429347c9e tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/ports?device_id=bae2e9d5-1cac-484c-80c2-34799cc5fb40 HTTP/1.1" status: 200  len: 943 time: 0.1385295
May 25 17:45:05.320150 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:05.322947 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:45:05.429032 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-be2682fe-afba-4dee-b1fe-d3ce78933b47 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:05.438657 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-0d125e76-b103-44fc-8e45-34ac115d4c63 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:45:05.443419 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Pushing event updated for resources: {'Port': ['ID=ea15af4a-963c-46da-9f67-5e7f195ae1b3,revision_number=4']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:45:05.454176 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.131s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:45:05.490232 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be2682fe-afba-4dee-b1fe-d3ce78933b47 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=34706fcd-8591-4e4a-b272-50168cd9a705,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:45:05.499969 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-be2682fe-afba-4dee-b1fe-d3ce78933b47 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.061s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:45:05.507867 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-be2682fe-afba-4dee-b1fe-d3ce78933b47 admin admin] Notify callbacks [] for security_group, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:05.516028 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-be2682fe-afba-4dee-b1fe-d3ce78933b47 admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/34706fcd-8591-4e4a-b272-50168cd9a705 HTTP/1.1" status: 204  len: 168 time: 0.3734424
May 25 17:45:05.591100 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-ca17d14a-c53d-4c41-85bd-4a8c0bd9feb0 req-e7be93c9-2b58-44c4-9f88-7254bf96711d tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/security-groups?id=dda11ec6-545c-479e-bba9-4390fea678fa&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2883871
May 25 17:45:05.636888 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] get_ports_and_sgs() called for port_ids ['ea15af4a-963c-46da-9f67-5e7f195ae1b3'] {{(pid=99028) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 25 17:45:05.762278 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.agents_db [None req-14fae233-15dc-4576-836b-621c5f95b584 None None] Agent healthcheck: found 6 active agents {{(pid=99029) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 17:45:06.807091 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Device ea15af4a-963c-46da-9f67-5e7f195ae1b3 up at agent hyperv_hv-cinder-78956 {{(pid=99028) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 17:45:06.828446 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a25ee1d4-e072-41d0-a704-dc6887a6e2eb req-e9bf4a9f-7763-4f13-a64c-3fd17d1b4e1c tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:45:06.835598 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-a25ee1d4-e072-41d0-a704-dc6887a6e2eb req-e9bf4a9f-7763-4f13-a64c-3fd17d1b4e1c tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/ports?device_id=bae2e9d5-1cac-484c-80c2-34799cc5fb40 HTTP/1.1" status: 200  len: 944 time: 0.1152751
May 25 17:45:06.887575 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-a25ee1d4-e072-41d0-a704-dc6887a6e2eb req-59f9f55a-8f27-4147-ada8-7516b7db7a28 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/security-groups?id=dda11ec6-545c-479e-bba9-4390fea678fa&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0510736
May 25 17:45:06.976502 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Provisioning for port ea15af4a-963c-46da-9f67-5e7f195ae1b3 completed by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 17:45:06.983731 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Provisioning complete for port ea15af4a-963c-46da-9f67-5e7f195ae1b3 triggered by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 17:45:06.984133 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:07.121147 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:07.162099 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'bae2e9d5-1cac-484c-80c2-34799cc5fb40', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ea15af4a-963c-46da-9f67-5e7f195ae1b3'}] {{(pid=99028) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 17:45:07.168624 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] For port ea15af4a-963c-46da-9f67-5e7f195ae1b3, host hv-cinder-78956, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=ea15af4a-963c-46da-9f67-5e7f195ae1b3,segment=NetworkSegment(87df170f-54cc-461b-a7ac-79e125fc526b),segment_id=87df170f-54cc-461b-a7ac-79e125fc526b)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:45:07.249767 dv-cinder-789564-2-iscsi neutron-server[99028]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'bae2e9d5-1cac-484c-80c2-34799cc5fb40', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ea15af4a-963c-46da-9f67-5e7f195ae1b3', 'code': 200}
May 25 17:45:07.257033 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:07.261311 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:45:07.346181 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Pushing event updated for resources: {'Port': ['ID=ea15af4a-963c-46da-9f67-5e7f195ae1b3,revision_number=5']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:45:07.349243 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:45:07.649505 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b58d1c2c-d0f2-44c8-b882-408da4290aac req-1c99f607-3df9-43cd-9e82-649e2a7eed84 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:45:07.650983 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-b58d1c2c-d0f2-44c8-b882-408da4290aac req-1c99f607-3df9-43cd-9e82-649e2a7eed84 service neutron] 10.222.0.125 "GET /v2.0/ports?device_id=bae2e9d5-1cac-484c-80c2-34799cc5fb40 HTTP/1.1" status: 200  len: 1098 time: 0.0755718
May 25 17:45:07.693899 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-b58d1c2c-d0f2-44c8-b882-408da4290aac req-513a8fde-4c59-4859-aeaf-ccc8e165e024 service neutron] 10.222.0.125 "GET /v2.0/security-groups?id=dda11ec6-545c-479e-bba9-4390fea678fa&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0366716
May 25 17:45:08.120687 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c82a277e-421b-4e32-853b-8c1d154ba109 req-47f3ad24-8824-4f81-a7b7-e61c28970ac2 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:45:08.122263 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-c82a277e-421b-4e32-853b-8c1d154ba109 req-47f3ad24-8824-4f81-a7b7-e61c28970ac2 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/ports?device_id=bae2e9d5-1cac-484c-80c2-34799cc5fb40 HTTP/1.1" status: 200  len: 945 time: 0.0902052
May 25 17:45:08.170571 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-c82a277e-421b-4e32-853b-8c1d154ba109 req-5f2dab5c-063f-40bc-8841-82bbd53f4f29 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/security-groups?id=dda11ec6-545c-479e-bba9-4390fea678fa&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0411589
May 25 17:45:09.402296 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c9046c9-75ca-4bcb-bb6a-fa48c545ce68 req-ca01ced3-bb22-4e3c-be5e-6e847615d00c tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:45:09.405511 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-0c9046c9-75ca-4bcb-bb6a-fa48c545ce68 req-ca01ced3-bb22-4e3c-be5e-6e847615d00c tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/ports?device_id=bae2e9d5-1cac-484c-80c2-34799cc5fb40 HTTP/1.1" status: 200  len: 945 time: 0.1161485
May 25 17:45:09.460864 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-0c9046c9-75ca-4bcb-bb6a-fa48c545ce68 req-609d6b0f-0afb-4bb2-a969-c553f9c3ce12 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/security-groups?id=dda11ec6-545c-479e-bba9-4390fea678fa&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0505064
May 25 17:45:11.221026 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12ed2044-78cf-4e15-88d8-0b167b3ee253 req-f1faebbd-1ba4-45f1-926a-3df3e288b238 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:45:11.230185 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-12ed2044-78cf-4e15-88d8-0b167b3ee253 req-f1faebbd-1ba4-45f1-926a-3df3e288b238 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=432d7a94-0218-4907-bc7c-650f24a5b1e1 HTTP/1.1" status: 200  len: 945 time: 0.0897329
May 25 17:45:11.234854 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29c601b5-6b35-4eb1-bb36-cfe1e9c62bdb req-6c03424a-1d05-4087-ad40-d53a71afdb85 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:45:11.236937 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-29c601b5-6b35-4eb1-bb36-cfe1e9c62bdb req-6c03424a-1d05-4087-ad40-d53a71afdb85 service neutron] 10.222.0.125 "GET /v2.0/ports?tenant_id=5b2f6ca8c5b94c2f8894c04f297b5f8b&device_id=432d7a94-0218-4907-bc7c-650f24a5b1e1 HTTP/1.1" status: 200  len: 1098 time: 0.0791247
May 25 17:45:11.281970 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-12ed2044-78cf-4e15-88d8-0b167b3ee253 req-099dd86d-7297-4aea-ac78-657cb03f71ed tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0504112
May 25 17:45:11.387955 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 44672) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:45:11.399112 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29c601b5-6b35-4eb1-bb36-cfe1e9c62bdb req-5aeb24f6-80c7-4f4d-b5e3-741ae75a3167 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:45:11.400830 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-29c601b5-6b35-4eb1-bb36-cfe1e9c62bdb req-5aeb24f6-80c7-4f4d-b5e3-741ae75a3167 service neutron] 10.222.0.125 "GET /v2.0/networks?id=2abe381d-082b-4294-8193-c6556a56adb4 HTTP/1.1" status: 200  len: 920 time: 0.1578286
May 25 17:45:11.485501 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-29c601b5-6b35-4eb1-bb36-cfe1e9c62bdb req-89c1fe90-ba9b-4ab9-b32d-1b51e157a44d service neutron] 10.222.0.125 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=ca8c744f-fdc1-456d-ad85-74dff5ed46eb HTTP/1.1" status: 200  len: 217 time: 0.0791464
May 25 17:45:11.485726 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:11.552596 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29c601b5-6b35-4eb1-bb36-cfe1e9c62bdb req-bd8d99e3-5d64-4bb1-bc9e-35088cab9410 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:45:11.554069 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-29c601b5-6b35-4eb1-bb36-cfe1e9c62bdb req-bd8d99e3-5d64-4bb1-bc9e-35088cab9410 service neutron] 10.222.0.125 "GET /v2.0/subnets?id=e7ef8006-ae0e-4a18-b5c7-707d13fb7031 HTTP/1.1" status: 200  len: 858 time: 0.0625594
May 25 17:45:11.586453 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-0f6f8873-125e-4f2d-8f34-fe6aa5558e32 admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=9028482ca1824f25a204f6a680c95a63&name=default HTTP/1.1" status: 200  len: 2979 time: 0.1943057
May 25 17:45:11.586778 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 44684) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:45:11.604290 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-29c601b5-6b35-4eb1-bb36-cfe1e9c62bdb req-3fb35a15-0429-46cd-b9d5-ed066c68a791 service neutron] 10.222.0.125 "GET /v2.0/ports?network_id=2abe381d-082b-4294-8193-c6556a56adb4&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0445333
May 25 17:45:11.653054 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-279d5dc1-72ea-4393-9091-82fa985dead3 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:11.685471 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-279d5dc1-72ea-4393-9091-82fa985dead3 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:11.749400 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-29c601b5-6b35-4eb1-bb36-cfe1e9c62bdb req-d8f2808f-0232-40d0-880c-a0fb1baa50cd service neutron] 10.222.0.125 "GET /v2.0/networks/2abe381d-082b-4294-8193-c6556a56adb4?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1396525
May 25 17:45:11.845473 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-279d5dc1-72ea-4393-9091-82fa985dead3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:11.850629 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-6704f04b-cf55-4e37-b430-27b2a5b4e6d0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:45:11.866706 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-279d5dc1-72ea-4393-9091-82fa985dead3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bbd044e3-418c-425e-a277-d3ef2e6c73a3,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:45:11.869522 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-279d5dc1-72ea-4393-9091-82fa985dead3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:45:11.895037 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-29c601b5-6b35-4eb1-bb36-cfe1e9c62bdb req-f3eab129-34a6-4690-9cb4-2699dbe13387 service neutron] 10.222.0.125 "GET /v2.0/networks/2abe381d-082b-4294-8193-c6556a56adb4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1404815
May 25 17:45:11.950244 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-279d5dc1-72ea-4393-9091-82fa985dead3 admin admin] Notify callbacks [] for security_group, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:11.953550 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-279d5dc1-72ea-4393-9091-82fa985dead3 admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/bbd044e3-418c-425e-a277-d3ef2e6c73a3 HTTP/1.1" status: 204  len: 168 time: 0.3657737
May 25 17:45:12.496634 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-266f1372-5e4f-4157-994b-598fa4cbe436 req-8d53a58a-500c-4973-bf88-65eb1c5775b2 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:45:12.498806 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-266f1372-5e4f-4157-994b-598fa4cbe436 req-8d53a58a-500c-4973-bf88-65eb1c5775b2 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=432d7a94-0218-4907-bc7c-650f24a5b1e1 HTTP/1.1" status: 200  len: 945 time: 0.0827947
May 25 17:45:12.549786 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-266f1372-5e4f-4157-994b-598fa4cbe436 req-697d83b5-80ca-4b23-a6d6-b2057850d666 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0403821
May 25 17:45:13.738771 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2983c61-5a93-45e5-90aa-9ddf8bd02528 req-583a037c-0738-4fd1-aa46-8a9fe8499c3f tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:45:13.740330 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-b2983c61-5a93-45e5-90aa-9ddf8bd02528 req-583a037c-0738-4fd1-aa46-8a9fe8499c3f tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=432d7a94-0218-4907-bc7c-650f24a5b1e1 HTTP/1.1" status: 200  len: 945 time: 0.0842483
May 25 17:45:13.787135 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-b2983c61-5a93-45e5-90aa-9ddf8bd02528 req-67ff3325-a65b-44bf-b422-31dee38a9e55 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0406787
May 25 17:45:14.996204 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-643b6530-b9e8-4b07-976c-1042e33dd814 req-4ff1b171-fc2d-4194-8985-f8dd20abcfa6 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:45:14.997755 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-643b6530-b9e8-4b07-976c-1042e33dd814 req-4ff1b171-fc2d-4194-8985-f8dd20abcfa6 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=432d7a94-0218-4907-bc7c-650f24a5b1e1 HTTP/1.1" status: 200  len: 945 time: 0.0950980
May 25 17:45:15.047348 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-643b6530-b9e8-4b07-976c-1042e33dd814 req-0e2ccf51-b707-419d-b95d-b4f99123cc13 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0432706
May 25 17:45:15.574857 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 44802) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:45:15.698887 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-594b39d3-5999-4bb3-a0fb-5127040e4453 admin admin] Notify callbacks [] for security_group, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:15.714046 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-594b39d3-5999-4bb3-a0fb-5127040e4453 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:45:15.718494 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-594b39d3-5999-4bb3-a0fb-5127040e4453 admin admin] Usage tracker for resource:security_group_rule and tenant:fff3e8f5f03f494d9ce4d1b09f17bd75 is out of sync, need to count used quota {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:45:15.721298 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-594b39d3-5999-4bb3-a0fb-5127040e4453 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:45:15.726918 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-594b39d3-5999-4bb3-a0fb-5127040e4453 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:45:15.807136 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-594b39d3-5999-4bb3-a0fb-5127040e4453 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:15.891172 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-594b39d3-5999-4bb3-a0fb-5127040e4453 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:15.898441 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-a8f1caea-8429-4922-8028-1df177bb447c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:45:15.940705 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-594b39d3-5999-4bb3-a0fb-5127040e4453 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=57fb86dc-c884-4c12-b490-9f556f3fa8d3,revision_number=1']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:45:15.943951 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-594b39d3-5999-4bb3-a0fb-5127040e4453 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:45:15.946433 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-594b39d3-5999-4bb3-a0fb-5127040e4453 admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=fff3e8f5f03f494d9ce4d1b09f17bd75&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3704185
May 25 17:45:15.949366 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 44810) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:45:16.009009 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-c07efb6b-3e94-47db-9658-defca7f61b04 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:16.035838 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-c07efb6b-3e94-47db-9658-defca7f61b04 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:16.136434 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-c07efb6b-3e94-47db-9658-defca7f61b04 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:16.144215 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-036801c0-0024-4f19-8990-3aeedd310d4a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:45:16.157964 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c07efb6b-3e94-47db-9658-defca7f61b04 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=57fb86dc-c884-4c12-b490-9f556f3fa8d3,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:45:16.166459 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-c07efb6b-3e94-47db-9658-defca7f61b04 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.022s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:45:16.167556 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-c07efb6b-3e94-47db-9658-defca7f61b04 admin admin] Notify callbacks [] for security_group, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:16.172784 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-c07efb6b-3e94-47db-9658-defca7f61b04 admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/57fb86dc-c884-4c12-b490-9f556f3fa8d3 HTTP/1.1" status: 204  len: 168 time: 0.2192650
May 25 17:45:16.276442 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c44ba9a6-22a5-4675-be42-e9189cb8aa17 req-4012d42f-58b9-44d6-a14a-5f9fb45185f0 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:45:16.278358 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-c44ba9a6-22a5-4675-be42-e9189cb8aa17 req-4012d42f-58b9-44d6-a14a-5f9fb45185f0 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=432d7a94-0218-4907-bc7c-650f24a5b1e1 HTTP/1.1" status: 200  len: 945 time: 0.1081645
May 25 17:45:16.332511 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-c44ba9a6-22a5-4675-be42-e9189cb8aa17 req-b44f65eb-182d-46aa-bef8-ddb46932dfbf tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0476730
May 25 17:45:16.887216 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 44830) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:45:16.905995 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-edfe0232-c1e1-4259-a4aa-55f9a7422fdc admin admin] Notify callbacks [] for security_group, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:16.920409 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-edfe0232-c1e1-4259-a4aa-55f9a7422fdc admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:45:16.924182 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-edfe0232-c1e1-4259-a4aa-55f9a7422fdc admin admin] Usage tracker for resource:security_group_rule and tenant:deeacc6ec2b04c669c548b58e6c02ca9 is out of sync, need to count used quota {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:45:16.927110 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-edfe0232-c1e1-4259-a4aa-55f9a7422fdc admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:45:16.932723 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-edfe0232-c1e1-4259-a4aa-55f9a7422fdc admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:45:17.017999 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-edfe0232-c1e1-4259-a4aa-55f9a7422fdc admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:17.090780 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-edfe0232-c1e1-4259-a4aa-55f9a7422fdc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:17.173238 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-021c9664-62e2-4832-a420-b592596b0d85 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:45:17.221068 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-edfe0232-c1e1-4259-a4aa-55f9a7422fdc admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=deeacc6ec2b04c669c548b58e6c02ca9&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3301876
May 25 17:45:17.221068 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-edfe0232-c1e1-4259-a4aa-55f9a7422fdc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=30c8258b-0970-483c-b14a-cb357c408246,revision_number=1']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:45:17.221411 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 44836) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:45:17.223261 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-edfe0232-c1e1-4259-a4aa-55f9a7422fdc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:45:17.286202 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-975874a4-be18-4081-b5c9-1bb3d2736b49 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:17.313277 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-975874a4-be18-4081-b5c9-1bb3d2736b49 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:17.445100 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-975874a4-be18-4081-b5c9-1bb3d2736b49 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:17.449272 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-806ba3ad-b912-4756-928f-2bf35c911b01 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:45:17.461966 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-975874a4-be18-4081-b5c9-1bb3d2736b49 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=30c8258b-0970-483c-b14a-cb357c408246,revision_number=None']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:45:17.471307 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-975874a4-be18-4081-b5c9-1bb3d2736b49 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.022s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:45:17.482776 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-975874a4-be18-4081-b5c9-1bb3d2736b49 admin admin] Notify callbacks [] for security_group, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:17.485915 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-975874a4-be18-4081-b5c9-1bb3d2736b49 admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/30c8258b-0970-483c-b14a-cb357c408246 HTTP/1.1" status: 204  len: 168 time: 0.2618732
May 25 17:45:17.549432 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01a4b2d8-0909-40f5-87f8-a91591a196ad req-076dea8b-ca1e-4988-baca-377ab7cd7ed3 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:45:17.550853 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-01a4b2d8-0909-40f5-87f8-a91591a196ad req-076dea8b-ca1e-4988-baca-377ab7cd7ed3 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=432d7a94-0218-4907-bc7c-650f24a5b1e1 HTTP/1.1" status: 200  len: 945 time: 0.0917952
May 25 17:45:17.598850 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-01a4b2d8-0909-40f5-87f8-a91591a196ad req-9f023cba-2879-4c72-b1ea-37bbbbfc0fa1 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0413320
May 25 17:45:18.136639 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-efe79b71-c732-4bd8-8ef4-f2b005911fab None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:18.794008 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a463090-0046-4d0f-8fba-62606827c2a8 req-ce6c4d23-7fa1-4565-b8c2-dd5b1fe4aac2 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:45:18.795656 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-6a463090-0046-4d0f-8fba-62606827c2a8 req-ce6c4d23-7fa1-4565-b8c2-dd5b1fe4aac2 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=432d7a94-0218-4907-bc7c-650f24a5b1e1 HTTP/1.1" status: 200  len: 945 time: 0.0822685
May 25 17:45:18.846791 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-6a463090-0046-4d0f-8fba-62606827c2a8 req-efa734a1-68fc-4f57-8b1f-c60e44ba0fd9 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0449855
May 25 17:45:20.662417 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-854fc04a-715a-48fa-9fca-6da62afeca8a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:20.822157 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:21.044423 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b318a0d9-16e7-4559-a0d0-060d9807b00a req-bf4cde49-9048-4cf3-8b14-ba4eafe66e69 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:45:21.045916 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-b318a0d9-16e7-4559-a0d0-060d9807b00a req-bf4cde49-9048-4cf3-8b14-ba4eafe66e69 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=432d7a94-0218-4907-bc7c-650f24a5b1e1 HTTP/1.1" status: 200  len: 945 time: 0.0843606
May 25 17:45:21.089293 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-b318a0d9-16e7-4559-a0d0-060d9807b00a req-10623e57-e9b4-43ac-b881-ddf1a2e84f9c tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0376029
May 25 17:45:21.742675 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-7e261f94-b84f-443e-be49-3bc1ac903b55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:22.297345 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e941420-e354-43ab-9e16-9d4ede7dad05 req-cbcfa3e4-2053-49e4-930e-05a0d62d8904 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:45:22.298850 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-7e941420-e354-43ab-9e16-9d4ede7dad05 req-cbcfa3e4-2053-49e4-930e-05a0d62d8904 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=432d7a94-0218-4907-bc7c-650f24a5b1e1 HTTP/1.1" status: 200  len: 945 time: 0.0923271
May 25 17:45:22.351098 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-7e941420-e354-43ab-9e16-9d4ede7dad05 req-ad0d1bd3-578c-4fdc-b3a0-e7d6bcbf0f0b tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0410776
May 25 17:45:23.280353 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-6df2b2a7-a54e-4d57-9be3-033078b9d5b3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:23.573170 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a184ae7a-2eb9-42fe-b942-353a8e383883 req-25734b13-4a23-4897-aa34-e0f391c30c2d tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:45:23.575068 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-a184ae7a-2eb9-42fe-b942-353a8e383883 req-25734b13-4a23-4897-aa34-e0f391c30c2d tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=432d7a94-0218-4907-bc7c-650f24a5b1e1 HTTP/1.1" status: 200  len: 945 time: 0.0931382
May 25 17:45:23.627082 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-a184ae7a-2eb9-42fe-b942-353a8e383883 req-878cc61b-339b-4321-aa3a-f61b239cc89c tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0443771
May 25 17:45:24.832232 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62f886e6-cd3b-4e72-ac06-c982e5c9574f req-d71fa510-9189-43cf-8f41-0c4df55fefce tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:45:24.833766 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-62f886e6-cd3b-4e72-ac06-c982e5c9574f req-d71fa510-9189-43cf-8f41-0c4df55fefce tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=432d7a94-0218-4907-bc7c-650f24a5b1e1 HTTP/1.1" status: 200  len: 945 time: 0.0832055
May 25 17:45:24.890486 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-62f886e6-cd3b-4e72-ac06-c982e5c9574f req-8a5c4360-724f-406f-acea-f0976598a0c9 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0497148
May 25 17:45:26.082046 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f37fbb27-ace0-4f97-bf83-cb67559109db req-b434278e-1983-4802-80fc-3da1b6669bd1 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:45:26.083515 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-f37fbb27-ace0-4f97-bf83-cb67559109db req-b434278e-1983-4802-80fc-3da1b6669bd1 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=432d7a94-0218-4907-bc7c-650f24a5b1e1 HTTP/1.1" status: 200  len: 945 time: 0.0805383
May 25 17:45:26.131498 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-f37fbb27-ace0-4f97-bf83-cb67559109db req-519177d3-6fcf-486f-8632-f6e043b79c70 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0421848
May 25 17:45:26.745304 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46355bd7-2873-4d27-b32d-e0edcef072ae req-8628fca5-8d6c-47bd-a965-f9da2386e0c4 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:45:26.747177 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-46355bd7-2873-4d27-b32d-e0edcef072ae req-8628fca5-8d6c-47bd-a965-f9da2386e0c4 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/ports?device_id=bae2e9d5-1cac-484c-80c2-34799cc5fb40 HTTP/1.1" status: 200  len: 945 time: 0.0855966
May 25 17:45:26.794768 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-46355bd7-2873-4d27-b32d-e0edcef072ae req-0cf88340-f989-4f88-bce8-fd10a563a7c2 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/security-groups?id=dda11ec6-545c-479e-bba9-4390fea678fa&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0403059
May 25 17:45:27.398704 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db6c972d-5433-4448-b3d0-a92347820b57 req-e472124a-9b7f-402b-baf8-d12752c0febf tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:45:27.400072 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-db6c972d-5433-4448-b3d0-a92347820b57 req-e472124a-9b7f-402b-baf8-d12752c0febf tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=432d7a94-0218-4907-bc7c-650f24a5b1e1 HTTP/1.1" status: 200  len: 945 time: 0.1593015
May 25 17:45:27.449052 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-db6c972d-5433-4448-b3d0-a92347820b57 req-c6cf4c07-68f5-4b33-903f-df60edf9c251 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0413375
May 25 17:45:27.923659 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8321e7a-68a7-48d5-a860-0c961e4e7766 req-b672a979-5c59-4420-9dd6-74e658f50c65 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:45:27.925245 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-d8321e7a-68a7-48d5-a860-0c961e4e7766 req-b672a979-5c59-4420-9dd6-74e658f50c65 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.125 "GET /v2.0/ports?device_id=bae2e9d5-1cac-484c-80c2-34799cc5fb40 HTTP/1.1" status: 200  len: 945 time: 0.1072807
May 25 17:45:28.043711 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e743280e-a434-4c5b-b618-6749ec50bffa req-2f74a191-e554-4214-ab16-a55cebbf523e tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:45:28.046215 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-e743280e-a434-4c5b-b618-6749ec50bffa req-2f74a191-e554-4214-ab16-a55cebbf523e tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/ports?device_id=bae2e9d5-1cac-484c-80c2-34799cc5fb40 HTTP/1.1" status: 200  len: 945 time: 0.1188264
May 25 17:45:28.089512 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.plugin [req-d8321e7a-68a7-48d5-a860-0c961e4e7766 req-44dbc8a0-a50a-4a6a-a7f6-ab873b2d7e63 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Deleting port ea15af4a-963c-46da-9f67-5e7f195ae1b3 {{(pid=99027) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 17:45:28.089512 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-d8321e7a-68a7-48d5-a860-0c961e4e7766 req-44dbc8a0-a50a-4a6a-a7f6-ab873b2d7e63 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781841220419'] for port, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:28.112592 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-e743280e-a434-4c5b-b618-6749ec50bffa req-0d567f42-81cd-4edd-af6d-7aeebc80e317 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/security-groups?id=dda11ec6-545c-479e-bba9-4390fea678fa&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0585005
May 25 17:45:28.259060 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.db [req-d8321e7a-68a7-48d5-a860-0c961e4e7766 req-44dbc8a0-a50a-4a6a-a7f6-ab873b2d7e63 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] For port ea15af4a-963c-46da-9f67-5e7f195ae1b3, host hv-cinder-78956, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=ea15af4a-963c-46da-9f67-5e7f195ae1b3,segment=NetworkSegment(87df170f-54cc-461b-a7ac-79e125fc526b),segment_id=87df170f-54cc-461b-a7ac-79e125fc526b)] {{(pid=99027) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:45:28.259403 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-d8321e7a-68a7-48d5-a860-0c961e4e7766 req-44dbc8a0-a50a-4a6a-a7f6-ab873b2d7e63 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-418810'] for port, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:28.397648 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.plugin [req-d8321e7a-68a7-48d5-a860-0c961e4e7766 req-44dbc8a0-a50a-4a6a-a7f6-ab873b2d7e63 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Calling delete_port for ea15af4a-963c-46da-9f67-5e7f195ae1b3 owned by compute:nova {{(pid=99027) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 17:45:28.625732 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-d8321e7a-68a7-48d5-a860-0c961e4e7766 req-44dbc8a0-a50a-4a6a-a7f6-ab873b2d7e63 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781841222566', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781840788188', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15468986'] for port, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:28.632834 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-38583416-a71d-4900-9f4f-c20333fc238c tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:45:28.688379 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44dbc8a0-a50a-4a6a-a7f6-ab873b2d7e63 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Pushing event deleted for resources: {'Port': ['ID=ea15af4a-963c-46da-9f67-5e7f195ae1b3,revision_number=None']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:45:28.738523 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-44dbc8a0-a50a-4a6a-a7f6-ab873b2d7e63 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:45:28.738939 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-44dbc8a0-a50a-4a6a-a7f6-ab873b2d7e63 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:45:28.739429 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-44dbc8a0-a50a-4a6a-a7f6-ab873b2d7e63 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:45:28.739913 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-44dbc8a0-a50a-4a6a-a7f6-ab873b2d7e63 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:45:28.740391 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-44dbc8a0-a50a-4a6a-a7f6-ab873b2d7e63 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:45:28.740889 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-44dbc8a0-a50a-4a6a-a7f6-ab873b2d7e63 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:45:28.741376 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-44dbc8a0-a50a-4a6a-a7f6-ab873b2d7e63 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:45:28.742115 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-44dbc8a0-a50a-4a6a-a7f6-ab873b2d7e63 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:45:28.742615 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-44dbc8a0-a50a-4a6a-a7f6-ab873b2d7e63 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:45:28.743123 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-44dbc8a0-a50a-4a6a-a7f6-ab873b2d7e63 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:45:28.743646 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-44dbc8a0-a50a-4a6a-a7f6-ab873b2d7e63 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:45:28.744008 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-44dbc8a0-a50a-4a6a-a7f6-ab873b2d7e63 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:45:28.749231 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-44dbc8a0-a50a-4a6a-a7f6-ab873b2d7e63 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.116s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:45:28.822549 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c21140f-416b-401a-b54c-255d577ab5c0 req-d09674c8-ce55-47dd-ae48-9207414012ec tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:45:28.824187 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-0c21140f-416b-401a-b54c-255d577ab5c0 req-d09674c8-ce55-47dd-ae48-9207414012ec tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=432d7a94-0218-4907-bc7c-650f24a5b1e1 HTTP/1.1" status: 200  len: 945 time: 0.2623160
May 25 17:45:28.831680 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.l3_dvrscheduler_db [req-d8321e7a-68a7-48d5-a860-0c961e4e7766 req-44dbc8a0-a50a-4a6a-a7f6-ab873b2d7e63 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] No DVR routers for this DVR port ea15af4a-963c-46da-9f67-5e7f195ae1b3 on host hv-cinder-78956 {{(pid=99027) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 25 17:45:28.865839 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-d8321e7a-68a7-48d5-a860-0c961e4e7766 req-44dbc8a0-a50a-4a6a-a7f6-ab873b2d7e63 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-239387'] for port, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:28.870467 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'bae2e9d5-1cac-484c-80c2-34799cc5fb40', 'name': 'network-vif-deleted', 'tag': 'ea15af4a-963c-46da-9f67-5e7f195ae1b3'}] {{(pid=99027) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 17:45:28.897654 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-0c21140f-416b-401a-b54c-255d577ab5c0 req-60cabfb2-bef2-4629-bb0b-1af31421d43e tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0641992
May 25 17:45:28.955894 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'bae2e9d5-1cac-484c-80c2-34799cc5fb40', 'name': 'network-vif-deleted', 'tag': 'ea15af4a-963c-46da-9f67-5e7f195ae1b3', 'status': 'completed', 'code': 200}
May 25 17:45:28.983498 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-d8321e7a-68a7-48d5-a860-0c961e4e7766 req-44dbc8a0-a50a-4a6a-a7f6-ab873b2d7e63 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.125 "DELETE /v2.0/ports/ea15af4a-963c-46da-9f67-5e7f195ae1b3 HTTP/1.1" status: 204  len: 173 time: 1.0533960
May 25 17:45:29.280550 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-7da9ed5b-97ba-4f5a-b401-af79507fb09c req-9afbcd14-f593-4dcc-b463-6a0e9053b5cc tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Synchronizing usage tracker for tenant:5ae575cfd07c4a88aa626c15e6bccfd9 on resource:port {{(pid=99027) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 17:45:29.365375 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-7da9ed5b-97ba-4f5a-b401-af79507fb09c req-9afbcd14-f593-4dcc-b463-6a0e9053b5cc tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Unset dirty status for tenant:5ae575cfd07c4a88aa626c15e6bccfd9 on resource:port {{(pid=99027) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 17:45:29.366551 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-7da9ed5b-97ba-4f5a-b401-af79507fb09c req-9afbcd14-f593-4dcc-b463-6a0e9053b5cc tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/ports?device_id=bae2e9d5-1cac-484c-80c2-34799cc5fb40 HTTP/1.1" status: 200  len: 210 time: 0.1327801
May 25 17:45:29.603336 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] get_ports_and_sgs() called for port_ids ['4698ed19-7e41-4457-a1fd-16d5f606084a', 'cd9e7667-ca15-4541-9b3a-687f6f585523', 'db138deb-607b-422a-8726-ecea43965047', 'ea15af4a-963c-46da-9f67-5e7f195ae1b3'] {{(pid=99028) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 25 17:45:30.126381 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dee7d8e7-dd0a-4bd8-9251-3e2d3403ce60 req-b6fc5d0a-5824-4eb4-8e91-ae6e326f4654 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:45:30.127985 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-dee7d8e7-dd0a-4bd8-9251-3e2d3403ce60 req-b6fc5d0a-5824-4eb4-8e91-ae6e326f4654 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=432d7a94-0218-4907-bc7c-650f24a5b1e1 HTTP/1.1" status: 200  len: 945 time: 0.0896816
May 25 17:45:30.176490 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-dee7d8e7-dd0a-4bd8-9251-3e2d3403ce60 req-adbdbc82-ca92-474a-a1f8-5576b98288c7 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0415196
May 25 17:45:31.414257 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca1f42e8-9d31-40dc-a766-2c8ad2fb67bb req-4a8a0dfd-6bc9-401b-9823-e4874e6a89a4 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:45:31.415786 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-ca1f42e8-9d31-40dc-a766-2c8ad2fb67bb req-4a8a0dfd-6bc9-401b-9823-e4874e6a89a4 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=432d7a94-0218-4907-bc7c-650f24a5b1e1 HTTP/1.1" status: 200  len: 945 time: 0.1214538
May 25 17:45:31.468366 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-ca1f42e8-9d31-40dc-a766-2c8ad2fb67bb req-2f0466df-01e3-4682-b4b8-a063700ed880 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0463347
May 25 17:45:32.590277 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd8f924b-cf1a-45ee-a50e-30ca582da0e1 req-cc1562e8-2fc7-4e3a-a976-35ef15160e05 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:45:32.592891 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-bd8f924b-cf1a-45ee-a50e-30ca582da0e1 req-cc1562e8-2fc7-4e3a-a976-35ef15160e05 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/ports?device_id=292a3490-b43c-4640-bb5e-75df7d772b03 HTTP/1.1" status: 200  len: 945 time: 0.1263525
May 25 17:45:32.656582 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-bd8f924b-cf1a-45ee-a50e-30ca582da0e1 req-066d9a21-1e63-4e0a-8ff6-dd9d9f1b8891 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/security-groups?id=dda11ec6-545c-479e-bba9-4390fea678fa&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0575910
May 25 17:45:32.709487 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 45178) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:45:32.732926 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5c44e5d-3ec8-4aca-b19a-08e6e70e2f73 req-e138a906-d9cb-4351-8376-723a01159a54 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:45:32.743291 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-a5c44e5d-3ec8-4aca-b19a-08e6e70e2f73 req-e138a906-d9cb-4351-8376-723a01159a54 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=432d7a94-0218-4907-bc7c-650f24a5b1e1 HTTP/1.1" status: 200  len: 945 time: 0.1142631
May 25 17:45:32.786652 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-a5c44e5d-3ec8-4aca-b19a-08e6e70e2f73 req-1e4064ed-5803-4359-823b-b046fbb88eec tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0459633
May 25 17:45:32.876116 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-8ce91b55-a1a5-48d6-aa04-a040674d39b1 admin admin] Notify callbacks [] for security_group, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:32.894792 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-8ce91b55-a1a5-48d6-aa04-a040674d39b1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:45:32.899040 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-8ce91b55-a1a5-48d6-aa04-a040674d39b1 admin admin] Usage tracker for resource:security_group_rule and tenant:15d8c2357e4842b8b1dfaa088636b2d6 is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:45:32.902478 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-8ce91b55-a1a5-48d6-aa04-a040674d39b1 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:45:32.909342 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-8ce91b55-a1a5-48d6-aa04-a040674d39b1 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:45:32.936745 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Device ea15af4a-963c-46da-9f67-5e7f195ae1b3 no longer exists at agent hyperv_hv-cinder-78956 {{(pid=99028) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 17:45:33.008473 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.plugin [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] No Port match for: ea15af4a-963c-46da-9f67-5e7f195ae1b3 {{(pid=99028) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 25 17:45:33.008821 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Device ea15af4a-963c-46da-9f67-5e7f195ae1b3 not bound to the agent host hv-cinder-78956 {{(pid=99028) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 25 17:45:33.039651 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-8ce91b55-a1a5-48d6-aa04-a040674d39b1 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:33.125879 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-8ce91b55-a1a5-48d6-aa04-a040674d39b1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:33.135009 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-cc523cda-a029-452b-9202-fc91728aac29 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:45:33.208127 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-8ce91b55-a1a5-48d6-aa04-a040674d39b1 admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=15d8c2357e4842b8b1dfaa088636b2d6&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4970827
May 25 17:45:33.209148 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ce91b55-a1a5-48d6-aa04-a040674d39b1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b9ddee46-ecf3-46ee-bfa7-071ca76fa774,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:45:33.211166 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 45184) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:45:33.213526 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-8ce91b55-a1a5-48d6-aa04-a040674d39b1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:45:33.281765 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-99c7f780-410d-4a52-8e80-f7e17b589276 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:33.308788 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-99c7f780-410d-4a52-8e80-f7e17b589276 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:33.411203 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-99c7f780-410d-4a52-8e80-f7e17b589276 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:33.416525 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-c07efb6b-3e94-47db-9658-defca7f61b04 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:45:33.439750 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99c7f780-410d-4a52-8e80-f7e17b589276 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b9ddee46-ecf3-46ee-bfa7-071ca76fa774,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:45:33.451107 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-99c7f780-410d-4a52-8e80-f7e17b589276 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:45:33.451478 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-99c7f780-410d-4a52-8e80-f7e17b589276 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:45:33.451952 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-99c7f780-410d-4a52-8e80-f7e17b589276 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:45:33.452312 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-99c7f780-410d-4a52-8e80-f7e17b589276 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:45:33.452661 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-99c7f780-410d-4a52-8e80-f7e17b589276 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:45:33.453024 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-99c7f780-410d-4a52-8e80-f7e17b589276 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:45:33.453391 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-99c7f780-410d-4a52-8e80-f7e17b589276 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:45:33.453736 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-99c7f780-410d-4a52-8e80-f7e17b589276 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:45:33.454083 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-99c7f780-410d-4a52-8e80-f7e17b589276 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:45:33.454424 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-99c7f780-410d-4a52-8e80-f7e17b589276 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:45:33.454766 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-99c7f780-410d-4a52-8e80-f7e17b589276 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:45:33.455106 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-99c7f780-410d-4a52-8e80-f7e17b589276 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:45:33.458379 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-99c7f780-410d-4a52-8e80-f7e17b589276 admin admin] Notify callbacks [] for security_group, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:33.460665 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-99c7f780-410d-4a52-8e80-f7e17b589276 admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/b9ddee46-ecf3-46ee-bfa7-071ca76fa774 HTTP/1.1" status: 204  len: 168 time: 0.2474291
May 25 17:45:33.460665 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-99c7f780-410d-4a52-8e80-f7e17b589276 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:45:33.696600 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2f76062-27de-462e-a118-31bc5f774ca0 req-44353375-4a08-467f-86bd-38b9e2564b5d tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:45:33.698739 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-b2f76062-27de-462e-a118-31bc5f774ca0 req-44353375-4a08-467f-86bd-38b9e2564b5d tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.125 "GET /v2.0/ports?device_id=292a3490-b43c-4640-bb5e-75df7d772b03 HTTP/1.1" status: 200  len: 945 time: 0.0950377
May 25 17:45:33.997356 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13cf463d-c90c-4223-accf-fe411192590c req-0de51448-a1ef-477d-b77a-0143cb74ec33 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:45:33.999552 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-13cf463d-c90c-4223-accf-fe411192590c req-0de51448-a1ef-477d-b77a-0143cb74ec33 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/ports?device_id=292a3490-b43c-4640-bb5e-75df7d772b03 HTTP/1.1" status: 200  len: 945 time: 0.2096608
May 25 17:45:34.002185 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.plugin [req-b2f76062-27de-462e-a118-31bc5f774ca0 req-a10dbed3-284d-490b-8736-4b8f03b88811 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Deleting port db138deb-607b-422a-8726-ecea43965047 {{(pid=99027) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 17:45:34.002518 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-b2f76062-27de-462e-a118-31bc5f774ca0 req-a10dbed3-284d-490b-8736-4b8f03b88811 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781841220419'] for port, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:34.014986 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-480eb95b-c998-43bf-aac9-05684c3f9dcc req-8d842bcf-c0e2-4920-8847-189e852f1b9a tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:45:34.016737 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-480eb95b-c998-43bf-aac9-05684c3f9dcc req-8d842bcf-c0e2-4920-8847-189e852f1b9a tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=432d7a94-0218-4907-bc7c-650f24a5b1e1 HTTP/1.1" status: 200  len: 945 time: 0.0954010
May 25 17:45:34.065631 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-480eb95b-c998-43bf-aac9-05684c3f9dcc req-123d794a-3381-4668-bb8a-f70f296b8819 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0416338
May 25 17:45:34.163037 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-13cf463d-c90c-4223-accf-fe411192590c req-d178defd-2409-447e-a9c4-2c8f3795e5b2 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/security-groups?id=dda11ec6-545c-479e-bba9-4390fea678fa&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1413183
May 25 17:45:34.215657 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 45202) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:45:34.313858 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-9566509f-6eb0-4716-b429-80079ba5b734 admin admin] Notify callbacks [] for security_group, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:34.324856 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.db [req-b2f76062-27de-462e-a118-31bc5f774ca0 req-a10dbed3-284d-490b-8736-4b8f03b88811 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] For port db138deb-607b-422a-8726-ecea43965047, host hv-cinder-78956, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=db138deb-607b-422a-8726-ecea43965047,segment=NetworkSegment(87df170f-54cc-461b-a7ac-79e125fc526b),segment_id=87df170f-54cc-461b-a7ac-79e125fc526b)] {{(pid=99027) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:45:34.325234 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-b2f76062-27de-462e-a118-31bc5f774ca0 req-a10dbed3-284d-490b-8736-4b8f03b88811 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-418810'] for port, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:34.389901 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-9566509f-6eb0-4716-b429-80079ba5b734 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:45:34.456972 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.plugin [req-b2f76062-27de-462e-a118-31bc5f774ca0 req-a10dbed3-284d-490b-8736-4b8f03b88811 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Calling delete_port for db138deb-607b-422a-8726-ecea43965047 owned by compute:nova {{(pid=99027) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 17:45:34.459770 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-9566509f-6eb0-4716-b429-80079ba5b734 admin admin] Usage tracker for resource:security_group_rule and tenant:5dfc91d12664483980443ade02b56500 is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:45:34.464044 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-9566509f-6eb0-4716-b429-80079ba5b734 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:45:34.471996 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-9566509f-6eb0-4716-b429-80079ba5b734 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:45:34.653022 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-9566509f-6eb0-4716-b429-80079ba5b734 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:34.719712 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-9566509f-6eb0-4716-b429-80079ba5b734 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:34.727536 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-de458754-0056-47c4-a2d9-3dba73c5942d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:45:34.773195 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-b2f76062-27de-462e-a118-31bc5f774ca0 req-a10dbed3-284d-490b-8736-4b8f03b88811 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781841222566', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781840788188', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15468986'] for port, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:34.775053 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9566509f-6eb0-4716-b429-80079ba5b734 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ac7452ee-dfb1-44f2-a5ed-a8fdf4802884,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:45:34.779756 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-9566509f-6eb0-4716-b429-80079ba5b734 admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=5dfc91d12664483980443ade02b56500&name=default HTTP/1.1" status: 200  len: 2979 time: 0.5630724
May 25 17:45:34.780968 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-9566509f-6eb0-4716-b429-80079ba5b734 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:45:34.783970 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 45212) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:45:34.785313 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:45:34.833147 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] get_ports_and_sgs() called for port_ids ['4698ed19-7e41-4457-a1fd-16d5f606084a', 'cd9e7667-ca15-4541-9b3a-687f6f585523', 'db138deb-607b-422a-8726-ecea43965047'] {{(pid=99028) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 25 17:45:34.841627 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a10dbed3-284d-490b-8736-4b8f03b88811 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Pushing event deleted for resources: {'Port': ['ID=db138deb-607b-422a-8726-ecea43965047,revision_number=None']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:45:34.843374 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-a10dbed3-284d-490b-8736-4b8f03b88811 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.058s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:45:34.884936 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-e5dc57db-8638-46a5-957e-4a1a6760187a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:34.916515 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-e5dc57db-8638-46a5-957e-4a1a6760187a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:34.921148 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.l3_dvrscheduler_db [req-b2f76062-27de-462e-a118-31bc5f774ca0 req-a10dbed3-284d-490b-8736-4b8f03b88811 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] No DVR routers for this DVR port db138deb-607b-422a-8726-ecea43965047 on host hv-cinder-78956 {{(pid=99027) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 25 17:45:34.924633 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-b2f76062-27de-462e-a118-31bc5f774ca0 req-a10dbed3-284d-490b-8736-4b8f03b88811 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-239387'] for port, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:34.927550 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '292a3490-b43c-4640-bb5e-75df7d772b03', 'name': 'network-vif-deleted', 'tag': 'db138deb-607b-422a-8726-ecea43965047'}] {{(pid=99027) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 17:45:35.001914 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '292a3490-b43c-4640-bb5e-75df7d772b03', 'name': 'network-vif-deleted', 'tag': 'db138deb-607b-422a-8726-ecea43965047', 'status': 'completed', 'code': 200}
May 25 17:45:35.057697 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-b2f76062-27de-462e-a118-31bc5f774ca0 req-a10dbed3-284d-490b-8736-4b8f03b88811 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.125 "DELETE /v2.0/ports/db138deb-607b-422a-8726-ecea43965047 HTTP/1.1" status: 204  len: 173 time: 1.3542976
May 25 17:45:35.079891 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-e5dc57db-8638-46a5-957e-4a1a6760187a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:35.087222 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-0bcafef7-ea2f-42e7-a98a-b24efb681e8e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:45:35.105065 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5dc57db-8638-46a5-957e-4a1a6760187a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ac7452ee-dfb1-44f2-a5ed-a8fdf4802884,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:45:35.119232 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-e5dc57db-8638-46a5-957e-4a1a6760187a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:45:35.123120 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-e5dc57db-8638-46a5-957e-4a1a6760187a admin admin] Notify callbacks [] for security_group, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:35.125441 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-e5dc57db-8638-46a5-957e-4a1a6760187a admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/ac7452ee-dfb1-44f2-a5ed-a8fdf4802884 HTTP/1.1" status: 204  len: 168 time: 0.3402958
May 25 17:45:35.327272 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20837f33-0a1e-407e-925f-a93704547260 req-9a29f4cd-8975-4eb8-9ced-d058b1fc9150 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:45:35.328911 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-20837f33-0a1e-407e-925f-a93704547260 req-9a29f4cd-8975-4eb8-9ced-d058b1fc9150 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=432d7a94-0218-4907-bc7c-650f24a5b1e1 HTTP/1.1" status: 200  len: 945 time: 0.1081920
May 25 17:45:35.381533 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-20837f33-0a1e-407e-925f-a93704547260 req-2810f754-6fae-47ce-81e8-0d2fc09a32f9 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0469203
May 25 17:45:35.405158 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-b3656c80-62df-4acb-a97d-fc8448ec6601 req-ad11a59b-528f-48cb-abe2-59c7893e419a tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/ports?device_id=292a3490-b43c-4640-bb5e-75df7d772b03 HTTP/1.1" status: 200  len: 210 time: 0.0797606
May 25 17:45:36.575394 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 45254) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:45:36.623957 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bd64762-6c67-4595-904e-fe820bc5f318 req-31fa9eaf-e9ee-44cb-a878-bbb2132d311c tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:45:36.625780 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-1bd64762-6c67-4595-904e-fe820bc5f318 req-31fa9eaf-e9ee-44cb-a878-bbb2132d311c tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=432d7a94-0218-4907-bc7c-650f24a5b1e1 HTTP/1.1" status: 200  len: 945 time: 0.1021860
May 25 17:45:36.687256 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-1bd64762-6c67-4595-904e-fe820bc5f318 req-0cfbd156-7170-43d8-a8cc-7c14f99b35f4 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0534513
May 25 17:45:36.731199 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.v2.base [None req-4d4d809e-c888-473e-a330-89210a35d1f0 admin admin] Request body: {'network': {'name': 'tempest-VolumesSnapshotTestJSON-1319641586-network', 'tenant_id': '76807af9dbfd494e8d149bc35c086824'}} {{(pid=99026) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:45:36.736467 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-4d4d809e-c888-473e-a330-89210a35d1f0 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:45:36.742532 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-4d4d809e-c888-473e-a330-89210a35d1f0 admin admin] Usage tracker for resource:network and tenant:76807af9dbfd494e8d149bc35c086824 is out of sync, need to count used quota {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:45:36.746089 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-4d4d809e-c888-473e-a330-89210a35d1f0 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:45:36.754120 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-4d4d809e-c888-473e-a330-89210a35d1f0 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:45:36.908535 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4d4d809e-c888-473e-a330-89210a35d1f0 admin admin] Made reservation on behalf of 76807af9dbfd494e8d149bc35c086824 for: {'network': 1} {{(pid=99026) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 17:45:36.910948 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-4d4d809e-c888-473e-a330-89210a35d1f0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-1465344'] for network, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:36.926063 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-4d4d809e-c888-473e-a330-89210a35d1f0 admin admin] Notify callbacks [] for security_group, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:36.944984 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-4d4d809e-c888-473e-a330-89210a35d1f0 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:45:36.980519 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-4d4d809e-c888-473e-a330-89210a35d1f0 admin admin] Usage tracker for resource:security_group_rule and tenant:76807af9dbfd494e8d149bc35c086824 is out of sync, need to count used quota {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:45:36.980699 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Device db138deb-607b-422a-8726-ecea43965047 no longer exists at agent hyperv_hv-cinder-78956 {{(pid=99028) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 17:45:36.981204 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-4d4d809e-c888-473e-a330-89210a35d1f0 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:45:36.981204 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-4d4d809e-c888-473e-a330-89210a35d1f0 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:45:36.989394 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.plugin [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] No Port match for: db138deb-607b-422a-8726-ecea43965047 {{(pid=99028) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 25 17:45:36.989769 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Device db138deb-607b-422a-8726-ecea43965047 not bound to the agent host hv-cinder-78956 {{(pid=99028) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 25 17:45:37.054746 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-4d4d809e-c888-473e-a330-89210a35d1f0 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:37.313939 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-4d4d809e-c888-473e-a330-89210a35d1f0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:37.320041 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-99c7f780-410d-4a52-8e80-f7e17b589276 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:45:37.360485 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-4d4d809e-c888-473e-a330-89210a35d1f0 admin admin] vlan segment allocate from pool success with {'vlan_id': 1345, 'physical_network': 'physnet1'}  {{(pid=99026) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 25 17:45:37.380109 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d4d809e-c888-473e-a330-89210a35d1f0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b1cd410a-637d-478e-b9aa-ed7e2ce8bad3,revision_number=1']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:45:37.384946 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-4d4d809e-c888-473e-a330-89210a35d1f0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1469168'] for segment, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:37.395070 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.db.segments_db [None req-4d4d809e-c888-473e-a330-89210a35d1f0 admin admin] Added segment 31f775e4-1843-4e6f-aa8f-371e25229749 of type vlan for network 6339c1bc-651f-4152-a569-5ee35d1a9bfe
May 25 17:45:37.395070 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-4d4d809e-c888-473e-a330-89210a35d1f0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.067s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:45:37.415307 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-4d4d809e-c888-473e-a330-89210a35d1f0 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8781840806997'] for network, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:37.519871 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-4d4d809e-c888-473e-a330-89210a35d1f0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-459299', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551400'] for network, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:37.521292 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4d4d809e-c888-473e-a330-89210a35d1f0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:45:37.521883 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-4d4d809e-c888-473e-a330-89210a35d1f0 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for network, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:37.525470 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:45:37.585389 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e7c3080-bbc0-4c56-b38e-bec158e9050d req-dc16cebb-5b71-40c4-b044-c884614aaa6f tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:45:37.586187 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-6e7c3080-bbc0-4c56-b38e-bec158e9050d req-dc16cebb-5b71-40c4-b044-c884614aaa6f tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Synchronizing usage tracker for tenant:5ae575cfd07c4a88aa626c15e6bccfd9 on resource:port {{(pid=99027) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 17:45:37.634878 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d4d809e-c888-473e-a330-89210a35d1f0 admin admin] Pushing event updated for resources: {'Network': ['ID=6339c1bc-651f-4152-a569-5ee35d1a9bfe,revision_number=1']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:45:37.637925 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-4d4d809e-c888-473e-a330-89210a35d1f0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.112s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:45:37.646698 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Network 6339c1bc-651f-4152-a569-5ee35d1a9bfe details requested by agent ovs-agent-dv-cinder-789564-2-iscsi with host dv-cinder-789564-2-iscsi {{(pid=99028) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 25 17:45:37.657398 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-6e7c3080-bbc0-4c56-b38e-bec158e9050d req-dc16cebb-5b71-40c4-b044-c884614aaa6f tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Unset dirty status for tenant:5ae575cfd07c4a88aa626c15e6bccfd9 on resource:port {{(pid=99027) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 17:45:37.660212 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-6e7c3080-bbc0-4c56-b38e-bec158e9050d req-dc16cebb-5b71-40c4-b044-c884614aaa6f tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/ports?device_id=ac0d5316-763a-434a-82ea-c3d559ad0984 HTTP/1.1" status: 200  len: 945 time: 0.1631222
May 25 17:45:37.708843 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-6e7c3080-bbc0-4c56-b38e-bec158e9050d req-758d060d-f951-4d86-b428-4f8e8da88c58 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/security-groups?id=dda11ec6-545c-479e-bba9-4390fea678fa&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0433905
May 25 17:45:37.714967 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-4d4d809e-c888-473e-a330-89210a35d1f0 admin admin] 10.222.0.122 "POST /v2.0/networks HTTP/1.1" status: 201  len: 888 time: 1.1383862
May 25 17:45:37.718690 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 45268) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:45:37.733601 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.v2.base [None req-17467e1d-2627-4c9b-9ed2-22cc0ebd7e5b admin admin] Request body: {'subnet': {'network_id': '6339c1bc-651f-4152-a569-5ee35d1a9bfe', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesSnapshotTestJSON-1319641586-subnet', 'tenant_id': '76807af9dbfd494e8d149bc35c086824', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=99026) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:45:37.739532 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-17467e1d-2627-4c9b-9ed2-22cc0ebd7e5b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:45:37.744251 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-17467e1d-2627-4c9b-9ed2-22cc0ebd7e5b admin admin] Usage tracker for resource:subnet and tenant:76807af9dbfd494e8d149bc35c086824 is out of sync, need to count used quota {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:45:37.748222 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-17467e1d-2627-4c9b-9ed2-22cc0ebd7e5b admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:45:37.754425 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-17467e1d-2627-4c9b-9ed2-22cc0ebd7e5b admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:45:37.858961 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-17467e1d-2627-4c9b-9ed2-22cc0ebd7e5b admin admin] Made reservation on behalf of 76807af9dbfd494e8d149bc35c086824 for: {'subnet': 1} {{(pid=99026) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 17:45:37.861277 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-17467e1d-2627-4c9b-9ed2-22cc0ebd7e5b admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-14794261'] for subnet, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:38.007869 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01804152-82a0-4055-8c8a-dfb947711414 req-b800b8e1-404b-4b8d-8515-90ac5b920fcc tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:45:38.009616 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-01804152-82a0-4055-8c8a-dfb947711414 req-b800b8e1-404b-4b8d-8515-90ac5b920fcc tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=432d7a94-0218-4907-bc7c-650f24a5b1e1 HTTP/1.1" status: 200  len: 945 time: 0.1907527
May 25 17:45:38.142412 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-01804152-82a0-4055-8c8a-dfb947711414 req-d94eb7c1-c5d8-451e-9cc2-e490f049b9a1 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1200185
May 25 17:45:38.532196 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-17467e1d-2627-4c9b-9ed2-22cc0ebd7e5b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114466', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-15477896', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-14794243'] for subnet, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:38.536166 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:45:38.609694 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17467e1d-2627-4c9b-9ed2-22cc0ebd7e5b admin admin] Pushing event updated for resources: {'Subnet': ['ID=1002a83a-fcaf-455e-9402-7a92f32b974e,revision_number=0']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:45:38.612431 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-17467e1d-2627-4c9b-9ed2-22cc0ebd7e5b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:45:38.620877 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-17467e1d-2627-4c9b-9ed2-22cc0ebd7e5b admin admin] Checking segment: {'id': '31f775e4-1843-4e6f-aa8f-371e25229749', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1345, 'network_id': '6339c1bc-651f-4152-a569-5ee35d1a9bfe'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=99026) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 17:45:38.621335 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-17467e1d-2627-4c9b-9ed2-22cc0ebd7e5b admin admin] Network hostable DHCP agents. Network: 6339c1bc-651f-4152-a569-5ee35d1a9bfe, hostable agents: ['c8b0a350-254b-4562-874b-120ecdef0e25'], hosted agents: [] {{(pid=99026) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 25 17:45:38.724973 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-743fcc90-4849-47e7-adcb-f98d4ed92a43 req-003ff19f-80e0-47b7-9b40-92189e66606e tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:45:38.725728 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-17467e1d-2627-4c9b-9ed2-22cc0ebd7e5b admin admin] Network 6339c1bc-651f-4152-a569-5ee35d1a9bfe is scheduled to be hosted by DHCP agent c8b0a350-254b-4562-874b-120ecdef0e25 with binding_index 1 {{(pid=99026) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 25 17:45:38.729481 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-743fcc90-4849-47e7-adcb-f98d4ed92a43 req-003ff19f-80e0-47b7-9b40-92189e66606e tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.125 "GET /v2.0/ports?device_id=ac0d5316-763a-434a-82ea-c3d559ad0984 HTTP/1.1" status: 200  len: 945 time: 0.1318326
May 25 17:45:38.896678 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.scheduler.base_scheduler [None req-17467e1d-2627-4c9b-9ed2-22cc0ebd7e5b admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-789564-2-iscsi, 6339c1bc-651f-4152-a569-5ee35d1a9bfe) {{(pid=99026) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 17:45:38.907780 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-17467e1d-2627-4c9b-9ed2-22cc0ebd7e5b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:45:38.912493 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ee2ff508-77af-4689-a930-214e62cf5947 None None] Network 6339c1bc-651f-4152-a569-5ee35d1a9bfe requested from dv-cinder-789564-2-iscsi {{(pid=99028) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 17:45:38.925835 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-17467e1d-2627-4c9b-9ed2-22cc0ebd7e5b admin admin] Notify callbacks [] for subnet, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:38.941714 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.plugin [req-743fcc90-4849-47e7-adcb-f98d4ed92a43 req-4412df6a-8960-4c2c-99e9-1510a04759bf tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Deleting port cd9e7667-ca15-4541-9b3a-687f6f585523 {{(pid=99027) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 17:45:38.942031 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-743fcc90-4849-47e7-adcb-f98d4ed92a43 req-4412df6a-8960-4c2c-99e9-1510a04759bf tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781841220419'] for port, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:38.965412 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85a0fa05-9356-4558-ad0d-c72214456ce6 req-1f3f385e-55de-4b12-abad-7f3d3e65c532 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:45:38.969618 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-85a0fa05-9356-4558-ad0d-c72214456ce6 req-1f3f385e-55de-4b12-abad-7f3d3e65c532 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/ports?device_id=ac0d5316-763a-434a-82ea-c3d559ad0984 HTTP/1.1" status: 200  len: 945 time: 0.1319559
May 25 17:45:39.076631 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-17467e1d-2627-4c9b-9ed2-22cc0ebd7e5b admin admin] 10.222.0.122 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 851 time: 1.3560808
May 25 17:45:39.113337 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-85a0fa05-9356-4558-ad0d-c72214456ce6 req-3d5e6344-e71f-4a56-a918-5e08297bd009 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/security-groups?id=dda11ec6-545c-479e-bba9-4390fea678fa&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0937998
May 25 17:45:39.141427 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.db [req-743fcc90-4849-47e7-adcb-f98d4ed92a43 req-4412df6a-8960-4c2c-99e9-1510a04759bf tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] For port cd9e7667-ca15-4541-9b3a-687f6f585523, host hv-cinder-78956, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=cd9e7667-ca15-4541-9b3a-687f6f585523,segment=NetworkSegment(87df170f-54cc-461b-a7ac-79e125fc526b),segment_id=87df170f-54cc-461b-a7ac-79e125fc526b)] {{(pid=99027) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:45:39.141808 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-743fcc90-4849-47e7-adcb-f98d4ed92a43 req-4412df6a-8960-4c2c-99e9-1510a04759bf tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-418810'] for port, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:39.150213 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ada7131a-3f33-41d1-a1ef-f8dadfe942c4 None None] Network 6339c1bc-651f-4152-a569-5ee35d1a9bfe requested from dv-cinder-789564-2-iscsi {{(pid=99028) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 17:45:39.348179 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.plugin [req-743fcc90-4849-47e7-adcb-f98d4ed92a43 req-4412df6a-8960-4c2c-99e9-1510a04759bf tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Calling delete_port for cd9e7667-ca15-4541-9b3a-687f6f585523 owned by compute:nova {{(pid=99027) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 17:45:39.428245 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c3da375-266e-4520-b8d8-0e0aa8892e33 req-08e3a39d-2e40-4c01-b1e0-1738ab00d80b tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:45:39.432161 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-0c3da375-266e-4520-b8d8-0e0aa8892e33 req-08e3a39d-2e40-4c01-b1e0-1738ab00d80b tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=432d7a94-0218-4907-bc7c-650f24a5b1e1 HTTP/1.1" status: 200  len: 945 time: 0.1107848
May 25 17:45:39.484137 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-0c3da375-266e-4520-b8d8-0e0aa8892e33 req-1375d747-c468-4401-a545-b45a749a6ebd tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0471401
May 25 17:45:39.536696 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-743fcc90-4849-47e7-adcb-f98d4ed92a43 req-4412df6a-8960-4c2c-99e9-1510a04759bf tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781841222566', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781840788188', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15468986'] for port, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:39.542921 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:45:39.586411 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4412df6a-8960-4c2c-99e9-1510a04759bf tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Pushing event deleted for resources: {'Port': ['ID=cd9e7667-ca15-4541-9b3a-687f6f585523,revision_number=None']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:45:39.590225 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-4412df6a-8960-4c2c-99e9-1510a04759bf tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:45:39.599089 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] get_ports_and_sgs() called for port_ids ['4698ed19-7e41-4457-a1fd-16d5f606084a', 'cd9e7667-ca15-4541-9b3a-687f6f585523'] {{(pid=99028) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 25 17:45:39.745783 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.l3_dvrscheduler_db [req-743fcc90-4849-47e7-adcb-f98d4ed92a43 req-4412df6a-8960-4c2c-99e9-1510a04759bf tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] No DVR routers for this DVR port cd9e7667-ca15-4541-9b3a-687f6f585523 on host hv-cinder-78956 {{(pid=99027) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 25 17:45:39.748499 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-743fcc90-4849-47e7-adcb-f98d4ed92a43 req-4412df6a-8960-4c2c-99e9-1510a04759bf tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-239387'] for port, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:39.751150 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ac0d5316-763a-434a-82ea-c3d559ad0984', 'name': 'network-vif-deleted', 'tag': 'cd9e7667-ca15-4541-9b3a-687f6f585523'}] {{(pid=99027) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 17:45:39.804076 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ac0d5316-763a-434a-82ea-c3d559ad0984', 'name': 'network-vif-deleted', 'tag': 'cd9e7667-ca15-4541-9b3a-687f6f585523', 'status': 'completed', 'code': 200}
May 25 17:45:39.834381 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-743fcc90-4849-47e7-adcb-f98d4ed92a43 req-4412df6a-8960-4c2c-99e9-1510a04759bf tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.125 "DELETE /v2.0/ports/cd9e7667-ca15-4541-9b3a-687f6f585523 HTTP/1.1" status: 204  len: 173 time: 1.1000881
May 25 17:45:39.960849 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-13ef8ed3-6cc2-436e-842c-edc27c4e7869 req-991ffd84-8aec-4187-b162-6bf2a58cc8ea service neutron] 10.222.0.125 "GET /v2.0/ports?device_id=78a85fac-d281-494d-90da-a47ddc8255e5&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.0710790
May 25 17:45:40.063060 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13ef8ed3-6cc2-436e-842c-edc27c4e7869 req-87531805-165c-42ff-88ef-230eaab7e06e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:45:40.064239 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-13ef8ed3-6cc2-436e-842c-edc27c4e7869 req-87531805-165c-42ff-88ef-230eaab7e06e service neutron] 10.222.0.125 "GET /v2.0/ports?tenant_id=5b2f6ca8c5b94c2f8894c04f297b5f8b&device_id=78a85fac-d281-494d-90da-a47ddc8255e5 HTTP/1.1" status: 200  len: 1098 time: 0.0787916
May 25 17:45:40.251147 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13ef8ed3-6cc2-436e-842c-edc27c4e7869 req-44c1cea9-c4a1-41a1-8ac4-afb4fafa7aa8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:45:40.252663 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-13ef8ed3-6cc2-436e-842c-edc27c4e7869 req-44c1cea9-c4a1-41a1-8ac4-afb4fafa7aa8 service neutron] 10.222.0.125 "GET /v2.0/networks?id=2abe381d-082b-4294-8193-c6556a56adb4 HTTP/1.1" status: 200  len: 920 time: 0.1687496
May 25 17:45:40.300429 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-64ffe0de-f671-44cb-a624-0b86cc6dba7d req-e9933cbc-7021-441a-9bf5-ef2d9f14d2fe tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/ports?device_id=ac0d5316-763a-434a-82ea-c3d559ad0984 HTTP/1.1" status: 200  len: 210 time: 0.0549624
May 25 17:45:40.338748 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-13ef8ed3-6cc2-436e-842c-edc27c4e7869 req-d51804e3-be55-446d-b325-a224194b7208 service neutron] 10.222.0.125 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=8a9ac879-c35f-482a-b8f0-6355fbb9a900 HTTP/1.1" status: 200  len: 217 time: 0.0774372
May 25 17:45:40.408890 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13ef8ed3-6cc2-436e-842c-edc27c4e7869 req-d751a52f-3590-4306-8fc1-0d1235b6662a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:45:40.410505 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-13ef8ed3-6cc2-436e-842c-edc27c4e7869 req-d751a52f-3590-4306-8fc1-0d1235b6662a service neutron] 10.222.0.125 "GET /v2.0/subnets?id=e7ef8006-ae0e-4a18-b5c7-707d13fb7031 HTTP/1.1" status: 200  len: 858 time: 0.0669265
May 25 17:45:40.461857 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-13ef8ed3-6cc2-436e-842c-edc27c4e7869 req-d0f2ab77-0210-4ec7-9396-01453bf71139 service neutron] 10.222.0.125 "GET /v2.0/ports?network_id=2abe381d-082b-4294-8193-c6556a56adb4&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0464962
May 25 17:45:40.604437 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-13ef8ed3-6cc2-436e-842c-edc27c4e7869 req-6e46d70f-b97a-43fa-83f9-0e2aeee39054 service neutron] 10.222.0.125 "GET /v2.0/networks/2abe381d-082b-4294-8193-c6556a56adb4?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1336164
May 25 17:45:40.795253 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-13ef8ed3-6cc2-436e-842c-edc27c4e7869 req-6665f3e1-16ca-48aa-838e-65537d36932d service neutron] 10.222.0.125 "GET /v2.0/networks/2abe381d-082b-4294-8193-c6556a56adb4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1605470
May 25 17:45:40.802827 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d05d375d-3d34-4150-ac23-3ad335ced99a req-04fd9bbc-8f4c-4913-90db-00aa53d6beb8 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:45:40.804274 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-d05d375d-3d34-4150-ac23-3ad335ced99a req-04fd9bbc-8f4c-4913-90db-00aa53d6beb8 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=432d7a94-0218-4907-bc7c-650f24a5b1e1 HTTP/1.1" status: 200  len: 945 time: 0.2030051
May 25 17:45:40.852417 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-d05d375d-3d34-4150-ac23-3ad335ced99a req-cbdb7d3f-eb83-47e0-b75d-fd643a1db783 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0406506
May 25 17:45:41.456841 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:41.636268 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fb9a747-1efe-430f-b98e-e54c510fc6ca req-8f4ab08c-6554-48a5-a292-09b74d50d594 tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:45:41.636857 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [req-8fb9a747-1efe-430f-b98e-e54c510fc6ca req-8f4ab08c-6554-48a5-a292-09b74d50d594 tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] Synchronizing usage tracker for tenant:76807af9dbfd494e8d149bc35c086824 on resource:network {{(pid=99026) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 17:45:41.776529 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [req-8fb9a747-1efe-430f-b98e-e54c510fc6ca req-8f4ab08c-6554-48a5-a292-09b74d50d594 tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] Unset dirty status for tenant:76807af9dbfd494e8d149bc35c086824 on resource:network {{(pid=99026) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 17:45:41.777742 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-8fb9a747-1efe-430f-b98e-e54c510fc6ca req-8f4ab08c-6554-48a5-a292-09b74d50d594 tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] 10.222.0.122 "GET /v2.0/networks?id=6339c1bc-651f-4152-a569-5ee35d1a9bfe HTTP/1.1" status: 200  len: 814 time: 0.2903578
May 25 17:45:41.793918 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-8fb9a747-1efe-430f-b98e-e54c510fc6ca req-3b0435a4-d902-4403-8d7f-bcbe395f4931 tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] 10.222.0.122 "GET /v2.0/quotas/76807af9dbfd494e8d149bc35c086824 HTTP/1.1" status: 200  len: 375 time: 0.0095773
May 25 17:45:41.845904 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-8fb9a747-1efe-430f-b98e-e54c510fc6ca req-717070b2-2239-4b07-af14-f41512858b4c tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] 10.222.0.122 "GET /v2.0/ports?tenant_id=76807af9dbfd494e8d149bc35c086824&fields=id HTTP/1.1" status: 200  len: 210 time: 0.0459306
May 25 17:45:41.981044 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-8fb9a747-1efe-430f-b98e-e54c510fc6ca req-97fd1f01-8897-4c82-b46a-7af3cc2aeaba service neutron] 10.222.0.122 "GET /v2.0/networks/6339c1bc-651f-4152-a569-5ee35d1a9bfe?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1283453
May 25 17:45:42.044717 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0871f22b-e027-48ae-bec8-141f5f000109 req-1d38a353-7ca1-4a91-9d19-efe9f53e7fe7 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:45:42.046402 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-0871f22b-e027-48ae-bec8-141f5f000109 req-1d38a353-7ca1-4a91-9d19-efe9f53e7fe7 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=432d7a94-0218-4907-bc7c-650f24a5b1e1 HTTP/1.1" status: 200  len: 945 time: 0.0842974
May 25 17:45:42.094399 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-0871f22b-e027-48ae-bec8-141f5f000109 req-4ab74fba-8fa1-4b31-a40d-b319206e693f tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0420849
May 25 17:45:42.122246 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-8fb9a747-1efe-430f-b98e-e54c510fc6ca req-249d8585-4bca-4475-9b5b-fbb304feacb3 service neutron] 10.222.0.122 "GET /v2.0/networks/6339c1bc-651f-4152-a569-5ee35d1a9bfe?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1350088
May 25 17:45:42.453504 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-9ea6597d-598b-4029-a883-7a30ed75d47e req-6604bf73-9825-4842-9ac9-fd981b27fbc0 tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] 10.222.0.122 "GET /v2.0/ports?device_id=a5f77497-cef4-469a-8e86-1f56e2b212f1 HTTP/1.1" status: 200  len: 210 time: 0.0471461
May 25 17:45:42.764869 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.agents_db [None req-14fae233-15dc-4576-836b-621c5f95b584 None None] Agent healthcheck: found 6 active agents {{(pid=99029) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 17:45:43.013833 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Device cd9e7667-ca15-4541-9b3a-687f6f585523 no longer exists at agent hyperv_hv-cinder-78956 {{(pid=99028) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 17:45:43.053868 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.plugin [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] No Port match for: cd9e7667-ca15-4541-9b3a-687f6f585523 {{(pid=99028) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 25 17:45:43.054213 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Device cd9e7667-ca15-4541-9b3a-687f6f585523 not bound to the agent host hv-cinder-78956 {{(pid=99028) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 25 17:45:43.297107 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0701da92-e98a-44ff-a60d-bf168a42d951 req-6449749e-1cd2-4ba2-adf1-b9c33146e7b3 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:45:43.298551 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-0701da92-e98a-44ff-a60d-bf168a42d951 req-6449749e-1cd2-4ba2-adf1-b9c33146e7b3 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=432d7a94-0218-4907-bc7c-650f24a5b1e1 HTTP/1.1" status: 200  len: 945 time: 0.0863688
May 25 17:45:43.348062 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-0701da92-e98a-44ff-a60d-bf168a42d951 req-9921253d-f592-4186-86cb-f5963c8ca9db tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0435510
May 25 17:45:43.551685 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-debddd56-abd2-44ae-b88c-def662b0a4b7 req-83e8cb14-e6c2-4ebc-ac7c-ab6b56485c8f tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] 10.222.0.122 "GET /v2.0/ports?device_id=a5f77497-cef4-469a-8e86-1f56e2b212f1 HTTP/1.1" status: 200  len: 210 time: 0.0445297
May 25 17:45:43.615068 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3ecd6a4-8e38-4aa8-9f52-4739452b0c5d req-29d15bef-c458-4b16-a0ab-0d1bcffcd4c3 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:45:43.615799 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-a3ecd6a4-8e38-4aa8-9f52-4739452b0c5d req-29d15bef-c458-4b16-a0ab-0d1bcffcd4c3 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Synchronizing usage tracker for tenant:5ae575cfd07c4a88aa626c15e6bccfd9 on resource:port {{(pid=99027) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 17:45:43.713783 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-a3ecd6a4-8e38-4aa8-9f52-4739452b0c5d req-29d15bef-c458-4b16-a0ab-0d1bcffcd4c3 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Unset dirty status for tenant:5ae575cfd07c4a88aa626c15e6bccfd9 on resource:port {{(pid=99027) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 17:45:43.715650 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-a3ecd6a4-8e38-4aa8-9f52-4739452b0c5d req-29d15bef-c458-4b16-a0ab-0d1bcffcd4c3 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/ports?device_id=3fb3211e-48f5-46f5-8035-ddbc35109aa8 HTTP/1.1" status: 200  len: 946 time: 0.1975729
May 25 17:45:43.769754 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-a3ecd6a4-8e38-4aa8-9f52-4739452b0c5d req-e5a0061a-2a92-4af4-b501-fcec806fe64f tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/security-groups?id=dda11ec6-545c-479e-bba9-4390fea678fa&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0474012
May 25 17:45:44.553569 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ff537b8-325b-49a4-a5dc-46ecd6377665 req-b4777d14-07a3-4169-8cb5-401bbc11160b tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:45:44.554994 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-1ff537b8-325b-49a4-a5dc-46ecd6377665 req-b4777d14-07a3-4169-8cb5-401bbc11160b tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=432d7a94-0218-4907-bc7c-650f24a5b1e1 HTTP/1.1" status: 200  len: 945 time: 0.0834119
May 25 17:45:44.605349 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-1ff537b8-325b-49a4-a5dc-46ecd6377665 req-e6005f65-0d2e-4926-a976-c32abc6a1359 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0441597
May 25 17:45:44.708281 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-58380d59-9a09-46f8-a0c8-a7c94e6ba5ca req-b8ea6306-b890-431b-96a1-8cb367a08f06 tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] 10.222.0.122 "GET /v2.0/ports?device_id=a5f77497-cef4-469a-8e86-1f56e2b212f1 HTTP/1.1" status: 200  len: 210 time: 0.0453897
May 25 17:45:44.971412 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb141e58-3dfb-4de8-a97c-10c92c572b8c req-21c6a1e5-38a4-476f-9318-83f658cdd20b tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:45:44.973217 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-cb141e58-3dfb-4de8-a97c-10c92c572b8c req-21c6a1e5-38a4-476f-9318-83f658cdd20b tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/ports?device_id=3fb3211e-48f5-46f5-8035-ddbc35109aa8 HTTP/1.1" status: 200  len: 946 time: 0.0885115
May 25 17:45:45.022577 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-cb141e58-3dfb-4de8-a97c-10c92c572b8c req-68b6b9c5-9b15-48d1-a4ab-03bc0a7321d9 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/security-groups?id=dda11ec6-545c-479e-bba9-4390fea678fa&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0434835
May 25 17:45:45.186942 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fb9a747-1efe-430f-b98e-e54c510fc6ca req-0fbb3b97-6b2d-493f-b158-de678f4d3224 tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:45:45.188387 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-8fb9a747-1efe-430f-b98e-e54c510fc6ca req-0fbb3b97-6b2d-493f-b158-de678f4d3224 tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] 10.222.0.125 "GET /v2.0/networks?id=6339c1bc-651f-4152-a569-5ee35d1a9bfe HTTP/1.1" status: 200  len: 814 time: 0.1664140
May 25 17:45:45.200087 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.v2.base [req-8fb9a747-1efe-430f-b98e-e54c510fc6ca req-b1265bbc-88b0-4b8f-9a1b-675f1504c10c tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] Request body: {'port': {'device_id': 'a5f77497-cef4-469a-8e86-1f56e2b212f1', 'network_id': '6339c1bc-651f-4152-a569-5ee35d1a9bfe', 'admin_state_up': True, 'tenant_id': '76807af9dbfd494e8d149bc35c086824'}} {{(pid=99027) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:45:45.415302 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [req-8fb9a747-1efe-430f-b98e-e54c510fc6ca req-b1265bbc-88b0-4b8f-9a1b-675f1504c10c tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:45:45.419191 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-8fb9a747-1efe-430f-b98e-e54c510fc6ca req-b1265bbc-88b0-4b8f-9a1b-675f1504c10c tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] Usage tracker for resource:port and tenant:76807af9dbfd494e8d149bc35c086824 is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:45:45.422031 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-8fb9a747-1efe-430f-b98e-e54c510fc6ca req-b1265bbc-88b0-4b8f-9a1b-675f1504c10c tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] Quota usage for port was recalculated. Used quota:0. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:45:45.427873 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [req-8fb9a747-1efe-430f-b98e-e54c510fc6ca req-b1265bbc-88b0-4b8f-9a1b-675f1504c10c tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:45:45.554122 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-8fb9a747-1efe-430f-b98e-e54c510fc6ca req-b1265bbc-88b0-4b8f-9a1b-675f1504c10c tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] Made reservation on behalf of 76807af9dbfd494e8d149bc35c086824 for: {'port': 1} {{(pid=99027) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 17:45:45.557707 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-8fb9a747-1efe-430f-b98e-e54c510fc6ca req-b1265bbc-88b0-4b8f-9a1b-675f1504c10c tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:45.746678 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.db_base_plugin_common [req-8fb9a747-1efe-430f-b98e-e54c510fc6ca req-b1265bbc-88b0-4b8f-9a1b-675f1504c10c tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] Allocated IP 172.20.0.8 (6339c1bc-651f-4152-a569-5ee35d1a9bfe/1002a83a-fcaf-455e-9402-7a92f32b974e/ed3a3fd8-1b1b-48b5-a172-10bb4b8b6145) {{(pid=99027) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 17:45:45.823511 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e19f406a-0a39-4ef8-a820-9c2bc529b123 req-680331fa-117c-462f-b778-dcd607bea392 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:45:45.825041 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-e19f406a-0a39-4ef8-a820-9c2bc529b123 req-680331fa-117c-462f-b778-dcd607bea392 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=432d7a94-0218-4907-bc7c-650f24a5b1e1 HTTP/1.1" status: 200  len: 945 time: 0.0911167
May 25 17:45:45.876158 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-e19f406a-0a39-4ef8-a820-9c2bc529b123 req-17651f25-0c89-4acf-bbfe-1f196f9b2093 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0425653
May 25 17:45:45.968630 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-8fb9a747-1efe-430f-b98e-e54c510fc6ca req-b1265bbc-88b0-4b8f-9a1b-675f1504c10c tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] Notify callbacks [] for port, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:46.030779 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-19baf969-90db-4a81-875c-341e97ba264f req-66962a6a-8b4d-4ddc-91b1-fe9089db8841 tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] 10.222.0.122 "GET /v2.0/ports?device_id=a5f77497-cef4-469a-8e86-1f56e2b212f1 HTTP/1.1" status: 200  len: 210 time: 0.0483325
May 25 17:45:46.057265 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-8fb9a747-1efe-430f-b98e-e54c510fc6ca req-b1265bbc-88b0-4b8f-9a1b-675f1504c10c tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781840788179', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15468986'] for port, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:46.065277 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-5bde7c25-5ae1-489b-9a7d-86209365f2f2 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:45:46.133328 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-8fb9a747-1efe-430f-b98e-e54c510fc6ca req-b1265bbc-88b0-4b8f-9a1b-675f1504c10c tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] Network 6339c1bc-651f-4152-a569-5ee35d1a9bfe is already hosted by enough agents. {{(pid=99027) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 17:45:46.136467 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.base_scheduler [req-8fb9a747-1efe-430f-b98e-e54c510fc6ca req-b1265bbc-88b0-4b8f-9a1b-675f1504c10c tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] Resources bound (agent type, host, resource id):  {{(pid=99027) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 17:45:46.139846 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.l3_dvrscheduler_db [req-8fb9a747-1efe-430f-b98e-e54c510fc6ca req-b1265bbc-88b0-4b8f-9a1b-675f1504c10c tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] Received port after_create {{(pid=99027) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 17:45:46.186513 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1265bbc-88b0-4b8f-9a1b-675f1504c10c tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] Pushing event updated for resources: {'Port': ['ID=ed3a3fd8-1b1b-48b5-a172-10bb4b8b6145,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:45:46.189441 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-b1265bbc-88b0-4b8f-9a1b-675f1504c10c tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.124s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:45:46.210411 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fb9a747-1efe-430f-b98e-e54c510fc6ca req-b1265bbc-88b0-4b8f-9a1b-675f1504c10c tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:45:46.211007 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-8fb9a747-1efe-430f-b98e-e54c510fc6ca req-b1265bbc-88b0-4b8f-9a1b-675f1504c10c tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-239387'] for port, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:46.331843 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-8fb9a747-1efe-430f-b98e-e54c510fc6ca req-b1265bbc-88b0-4b8f-9a1b-675f1504c10c tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] 10.222.0.125 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.1354198
May 25 17:45:46.342733 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.v2.base [req-8fb9a747-1efe-430f-b98e-e54c510fc6ca req-e389e06a-4d6c-4aa0-a0ec-24818b85cd45 service neutron] Request body: {'port': {'device_id': 'a5f77497-cef4-469a-8e86-1f56e2b212f1', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78956'}} {{(pid=99027) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:45:46.461037 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-8fb9a747-1efe-430f-b98e-e54c510fc6ca req-e389e06a-4d6c-4aa0-a0ec-24818b85cd45 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:46.631440 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ec31f40-cfb6-4e52-96bc-300e48f17b21 req-2fe92589-bf26-4637-bd46-f0cf5203d436 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:45:46.632994 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-7ec31f40-cfb6-4e52-96bc-300e48f17b21 req-2fe92589-bf26-4637-bd46-f0cf5203d436 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/ports?device_id=3fb3211e-48f5-46f5-8035-ddbc35109aa8 HTTP/1.1" status: 200  len: 946 time: 0.1425092
May 25 17:45:46.646386 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1b5b4e3-dfa4-4feb-bbb1-cba9f993f8af req-68e19b32-bfd1-4e0b-af86-5842565191c9 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:45:46.647822 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-f1b5b4e3-dfa4-4feb-bbb1-cba9f993f8af req-68e19b32-bfd1-4e0b-af86-5842565191c9 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.125 "GET /v2.0/ports?device_id=3fb3211e-48f5-46f5-8035-ddbc35109aa8 HTTP/1.1" status: 200  len: 946 time: 0.1213889
May 25 17:45:46.743830 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-7ec31f40-cfb6-4e52-96bc-300e48f17b21 req-2bff8a5b-e6c7-40a9-a7c6-8dfe2c4a9bc8 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/security-groups?id=dda11ec6-545c-479e-bba9-4390fea678fa&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0950367
May 25 17:45:46.815461 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.plugin [req-f1b5b4e3-dfa4-4feb-bbb1-cba9f993f8af req-e5c2fd47-a3b2-4978-8273-cbdeb9ad20fd tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Deleting port 4698ed19-7e41-4457-a1fd-16d5f606084a {{(pid=99026) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 17:45:46.815796 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [req-f1b5b4e3-dfa4-4feb-bbb1-cba9f993f8af req-e5c2fd47-a3b2-4978-8273-cbdeb9ad20fd tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781841220419'] for port, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:46.823538 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.notifiers.nova [req-8fb9a747-1efe-430f-b98e-e54c510fc6ca req-e389e06a-4d6c-4aa0-a0ec-24818b85cd45 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id ed3a3fd8-1b1b-48b5-a172-10bb4b8b6145 {{(pid=99027) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 25 17:45:46.831917 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-8fb9a747-1efe-430f-b98e-e54c510fc6ca req-e389e06a-4d6c-4aa0-a0ec-24818b85cd45 service neutron] Notify callbacks [] for port, precommit_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:46.846915 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.provisioning_blocks [req-8fb9a747-1efe-430f-b98e-e54c510fc6ca req-e389e06a-4d6c-4aa0-a0ec-24818b85cd45 service neutron] Transition to ACTIVE for port object ed3a3fd8-1b1b-48b5-a172-10bb4b8b6145 will not be triggered until provisioned by entity L2. {{(pid=99027) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 17:45:46.919964 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-8fb9a747-1efe-430f-b98e-e54c510fc6ca req-e389e06a-4d6c-4aa0-a0ec-24818b85cd45 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15468979'] for port, after_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:46.925424 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:45:47.045292 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.db [req-f1b5b4e3-dfa4-4feb-bbb1-cba9f993f8af req-e5c2fd47-a3b2-4978-8273-cbdeb9ad20fd tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] For port 4698ed19-7e41-4457-a1fd-16d5f606084a, host hv-cinder-78956, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=4698ed19-7e41-4457-a1fd-16d5f606084a,segment=NetworkSegment(87df170f-54cc-461b-a7ac-79e125fc526b),segment_id=87df170f-54cc-461b-a7ac-79e125fc526b)] {{(pid=99026) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:45:47.045913 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [req-f1b5b4e3-dfa4-4feb-bbb1-cba9f993f8af req-e5c2fd47-a3b2-4978-8273-cbdeb9ad20fd tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-418810'] for port, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:47.126084 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e389e06a-4d6c-4aa0-a0ec-24818b85cd45 service neutron] Pushing event updated for resources: {'Port': ['ID=ed3a3fd8-1b1b-48b5-a172-10bb4b8b6145,revision_number=2']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:45:47.164794 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-e389e06a-4d6c-4aa0-a0ec-24818b85cd45 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.239s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:45:47.221192 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.plugin [req-f1b5b4e3-dfa4-4feb-bbb1-cba9f993f8af req-e5c2fd47-a3b2-4978-8273-cbdeb9ad20fd tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Calling delete_port for 4698ed19-7e41-4457-a1fd-16d5f606084a owned by compute:nova {{(pid=99026) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 17:45:47.302957 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.managers [req-8fb9a747-1efe-430f-b98e-e54c510fc6ca req-e389e06a-4d6c-4aa0-a0ec-24818b85cd45 service neutron] Attempting to bind port ed3a3fd8-1b1b-48b5-a172-10bb4b8b6145 on host hv-cinder-78956 for vnic_type normal with profile  {{(pid=99027) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 17:45:47.303237 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.managers [req-8fb9a747-1efe-430f-b98e-e54c510fc6ca req-e389e06a-4d6c-4aa0-a0ec-24818b85cd45 service neutron] Attempting to bind port ed3a3fd8-1b1b-48b5-a172-10bb4b8b6145 by drivers openvswitch,hyperv on host hv-cinder-78956 at level 0 using segments [{'id': '31f775e4-1843-4e6f-aa8f-371e25229749', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1345, 'network_id': '6339c1bc-651f-4152-a569-5ee35d1a9bfe'}] {{(pid=99027) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 17:45:47.303635 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8fb9a747-1efe-430f-b98e-e54c510fc6ca req-e389e06a-4d6c-4aa0-a0ec-24818b85cd45 service neutron] Attempting to bind port ed3a3fd8-1b1b-48b5-a172-10bb4b8b6145 on network 6339c1bc-651f-4152-a569-5ee35d1a9bfe {{(pid=99027) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 17:45:47.316517 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2874c95-fb89-4697-b7c8-4ecf6ef33810 req-cbebed52-904f-4874-943f-bef495d910c8 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:45:47.318457 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-e2874c95-fb89-4697-b7c8-4ecf6ef33810 req-cbebed52-904f-4874-943f-bef495d910c8 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=432d7a94-0218-4907-bc7c-650f24a5b1e1 HTTP/1.1" status: 200  len: 945 time: 0.2857952
May 25 17:45:47.322508 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8fb9a747-1efe-430f-b98e-e54c510fc6ca req-e389e06a-4d6c-4aa0-a0ec-24818b85cd45 service neutron] Port ed3a3fd8-1b1b-48b5-a172-10bb4b8b6145 on network 6339c1bc-651f-4152-a569-5ee35d1a9bfe not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78956 {{(pid=99027) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 25 17:45:47.322508 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8fb9a747-1efe-430f-b98e-e54c510fc6ca req-e389e06a-4d6c-4aa0-a0ec-24818b85cd45 service neutron] Attempting to bind port ed3a3fd8-1b1b-48b5-a172-10bb4b8b6145 on network 6339c1bc-651f-4152-a569-5ee35d1a9bfe {{(pid=99027) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 17:45:47.340659 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dec693a8-4ce2-426d-ba57-509d654420ea req-4f9d7762-db6a-4e3d-9bc3-a8758f2828c0 tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:45:47.342823 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-dec693a8-4ce2-426d-ba57-509d654420ea req-4f9d7762-db6a-4e3d-9bc3-a8758f2828c0 tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] 10.222.0.122 "GET /v2.0/ports?device_id=a5f77497-cef4-469a-8e86-1f56e2b212f1 HTTP/1.1" status: 200  len: 943 time: 0.1315007
May 25 17:45:47.351665 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8fb9a747-1efe-430f-b98e-e54c510fc6ca req-e389e06a-4d6c-4aa0-a0ec-24818b85cd45 service neutron] Checking agent: {'id': '4d02a528-6a0e-4977-985f-4bcff1ca6cb7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78956', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 17, 40, 41), 'started_at': datetime.datetime(2021, 5, 25, 17, 40, 41), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 17, 45, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=99027) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 17:45:47.357545 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8fb9a747-1efe-430f-b98e-e54c510fc6ca req-e389e06a-4d6c-4aa0-a0ec-24818b85cd45 service neutron] Checking segment: {'id': '31f775e4-1843-4e6f-aa8f-371e25229749', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1345, 'network_id': '6339c1bc-651f-4152-a569-5ee35d1a9bfe'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=99027) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 17:45:47.357545 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8fb9a747-1efe-430f-b98e-e54c510fc6ca req-e389e06a-4d6c-4aa0-a0ec-24818b85cd45 service neutron] Bound using segment: {'id': '31f775e4-1843-4e6f-aa8f-371e25229749', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1345, 'network_id': '6339c1bc-651f-4152-a569-5ee35d1a9bfe'} {{(pid=99027) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 17:45:47.357545 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.managers [req-8fb9a747-1efe-430f-b98e-e54c510fc6ca req-e389e06a-4d6c-4aa0-a0ec-24818b85cd45 service neutron] Bound port: ed3a3fd8-1b1b-48b5-a172-10bb4b8b6145, host: hv-cinder-78956, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '31f775e4-1843-4e6f-aa8f-371e25229749', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1345, 'network_id': '6339c1bc-651f-4152-a569-5ee35d1a9bfe'}}] {{(pid=99027) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 17:45:47.357545 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-8fb9a747-1efe-430f-b98e-e54c510fc6ca req-e389e06a-4d6c-4aa0-a0ec-24818b85cd45 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:47.418626 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-e2874c95-fb89-4697-b7c8-4ecf6ef33810 req-ac069f29-805c-446a-b5c6-42170c5ae236 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0916269
May 25 17:45:47.474950 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.db [req-8fb9a747-1efe-430f-b98e-e54c510fc6ca req-e389e06a-4d6c-4aa0-a0ec-24818b85cd45 service neutron] For port ed3a3fd8-1b1b-48b5-a172-10bb4b8b6145, host hv-cinder-78956, cleared binding levels {{(pid=99027) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 17:45:47.478317 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.db [req-8fb9a747-1efe-430f-b98e-e54c510fc6ca req-e389e06a-4d6c-4aa0-a0ec-24818b85cd45 service neutron] For port ed3a3fd8-1b1b-48b5-a172-10bb4b8b6145, host hv-cinder-78956, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=ed3a3fd8-1b1b-48b5-a172-10bb4b8b6145,segment=NetworkSegment(31f775e4-1843-4e6f-aa8f-371e25229749),segment_id=31f775e4-1843-4e6f-aa8f-371e25229749)] {{(pid=99027) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 17:45:47.500673 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [req-dec693a8-4ce2-426d-ba57-509d654420ea req-95314ac3-73ca-41fb-b7ac-1cc4f80e0168 tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] Synchronizing usage tracker for tenant:76807af9dbfd494e8d149bc35c086824 on resource:security_group {{(pid=99026) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 17:45:47.542641 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5f55d6b-a5ec-4893-acc8-221448b04015 req-8cf31ad9-5b7b-4f7a-a58e-e2b8b81f969f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:45:47.544873 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-e5f55d6b-a5ec-4893-acc8-221448b04015 req-8cf31ad9-5b7b-4f7a-a58e-e2b8b81f969f service neutron] 10.222.0.125 "GET /v2.0/ports?device_id=432d7a94-0218-4907-bc7c-650f24a5b1e1 HTTP/1.1" status: 200  len: 1098 time: 0.1783803
May 25 17:45:47.589117 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-e5f55d6b-a5ec-4893-acc8-221448b04015 req-11432c2e-f36f-410f-86f7-b5c96236b6ec service neutron] 10.222.0.125 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0384781
May 25 17:45:47.599090 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-8fb9a747-1efe-430f-b98e-e54c510fc6ca req-e389e06a-4d6c-4aa0-a0ec-24818b85cd45 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15468979'] for port, after_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:47.600737 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-4412df6a-8960-4c2c-99e9-1510a04759bf tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:45:47.646105 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [req-f1b5b4e3-dfa4-4feb-bbb1-cba9f993f8af req-e5c2fd47-a3b2-4978-8273-cbdeb9ad20fd tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781841222566', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781840788188', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15476536'] for port, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:47.647693 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [req-dec693a8-4ce2-426d-ba57-509d654420ea req-95314ac3-73ca-41fb-b7ac-1cc4f80e0168 tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] Unset dirty status for tenant:76807af9dbfd494e8d149bc35c086824 on resource:security_group {{(pid=99026) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 17:45:47.648889 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-dec693a8-4ce2-426d-ba57-509d654420ea req-95314ac3-73ca-41fb-b7ac-1cc4f80e0168 tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] 10.222.0.122 "GET /v2.0/security-groups?id=b1cd410a-637d-478e-b9aa-ed7e2ce8bad3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2984786
May 25 17:45:47.662484 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fb9a747-1efe-430f-b98e-e54c510fc6ca req-e389e06a-4d6c-4aa0-a0ec-24818b85cd45 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:45:47.663197 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-8fb9a747-1efe-430f-b98e-e54c510fc6ca req-e389e06a-4d6c-4aa0-a0ec-24818b85cd45 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-239387'] for port, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:47.665318 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-8fb9a747-1efe-430f-b98e-e54c510fc6ca req-e389e06a-4d6c-4aa0-a0ec-24818b85cd45 service neutron] 10.222.0.125 "PUT /v2.0/ports/ed3a3fd8-1b1b-48b5-a172-10bb4b8b6145 HTTP/1.1" status: 200  len: 1093 time: 1.3259928
May 25 17:45:47.665318 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a5f77497-cef4-469a-8e86-1f56e2b212f1', 'tag': 'ed3a3fd8-1b1b-48b5-a172-10bb4b8b6145'}] {{(pid=99027) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 17:45:47.665589 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-10f4a4fe-3f29-45f5-a579-2b6360486995 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:45:47.693243 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e389e06a-4d6c-4aa0-a0ec-24818b85cd45 service neutron] Pushing event updated for resources: {'Port': ['ID=ed3a3fd8-1b1b-48b5-a172-10bb4b8b6145,revision_number=3']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:45:47.706936 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-e389e06a-4d6c-4aa0-a0ec-24818b85cd45 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.106s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:45:47.707587 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] get_ports_and_sgs() called for port_ids ['4698ed19-7e41-4457-a1fd-16d5f606084a'] {{(pid=99028) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 25 17:45:47.713392 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5c2fd47-a3b2-4978-8273-cbdeb9ad20fd tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Pushing event deleted for resources: {'Port': ['ID=4698ed19-7e41-4457-a1fd-16d5f606084a,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:45:47.740440 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a5f77497-cef4-469a-8e86-1f56e2b212f1', 'tag': 'ed3a3fd8-1b1b-48b5-a172-10bb4b8b6145', 'status': 'completed', 'code': 200}
May 25 17:45:47.752152 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-e5c2fd47-a3b2-4978-8273-cbdeb9ad20fd tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:45:47.841614 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e11ed930-f6f0-4624-ab89-c1cdba3f6852 req-9b141864-3865-4e13-b4b7-6b8f490cd47e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:45:47.843471 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-e11ed930-f6f0-4624-ab89-c1cdba3f6852 req-9b141864-3865-4e13-b4b7-6b8f490cd47e service neutron] 10.222.0.125 "GET /v2.0/ports?tenant_id=76807af9dbfd494e8d149bc35c086824&device_id=a5f77497-cef4-469a-8e86-1f56e2b212f1 HTTP/1.1" status: 200  len: 1096 time: 0.0734158
May 25 17:45:48.040647 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-dc8b7033-b4d6-4911-8783-6c2c2b1e67c1 req-cbbfff51-cb3e-4c02-baf4-5c6d6e055a7d tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/ports?device_id=3fb3211e-48f5-46f5-8035-ddbc35109aa8 HTTP/1.1" status: 200  len: 210 time: 0.1710207
May 25 17:45:48.108602 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e11ed930-f6f0-4624-ab89-c1cdba3f6852 req-37e28361-8c74-4bf1-8cb3-3e18fdc72832 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:45:48.110020 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-e11ed930-f6f0-4624-ab89-c1cdba3f6852 req-37e28361-8c74-4bf1-8cb3-3e18fdc72832 service neutron] 10.222.0.125 "GET /v2.0/networks?tenant_id=76807af9dbfd494e8d149bc35c086824&shared=False HTTP/1.1" status: 200  len: 916 time: 0.2600150
May 25 17:45:48.130885 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.l3_dvrscheduler_db [req-f1b5b4e3-dfa4-4feb-bbb1-cba9f993f8af req-e5c2fd47-a3b2-4978-8273-cbdeb9ad20fd tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] No DVR routers for this DVR port 4698ed19-7e41-4457-a1fd-16d5f606084a on host hv-cinder-78956 {{(pid=99026) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 25 17:45:48.134526 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [req-f1b5b4e3-dfa4-4feb-bbb1-cba9f993f8af req-e5c2fd47-a3b2-4978-8273-cbdeb9ad20fd tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-239387'] for port, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:48.138618 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3fb3211e-48f5-46f5-8035-ddbc35109aa8', 'name': 'network-vif-deleted', 'tag': '4698ed19-7e41-4457-a1fd-16d5f606084a'}] {{(pid=99026) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 17:45:48.143918 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-cbdd8f1d-1d12-410c-9f8b-2b1b0c0c5201 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:48.188303 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3fb3211e-48f5-46f5-8035-ddbc35109aa8', 'name': 'network-vif-deleted', 'tag': '4698ed19-7e41-4457-a1fd-16d5f606084a', 'status': 'completed', 'code': 200}
May 25 17:45:48.234498 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-f1b5b4e3-dfa4-4feb-bbb1-cba9f993f8af req-e5c2fd47-a3b2-4978-8273-cbdeb9ad20fd tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.125 "DELETE /v2.0/ports/4698ed19-7e41-4457-a1fd-16d5f606084a HTTP/1.1" status: 204  len: 173 time: 1.5721896
May 25 17:45:48.254353 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e11ed930-f6f0-4624-ab89-c1cdba3f6852 req-e8540c2c-130e-4901-967c-d7942ce20b1a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:45:48.255823 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-e11ed930-f6f0-4624-ab89-c1cdba3f6852 req-e8540c2c-130e-4901-967c-d7942ce20b1a service neutron] 10.222.0.125 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 871 time: 0.1402342
May 25 17:45:48.386186 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fb9a747-1efe-430f-b98e-e54c510fc6ca req-c6f91bf0-092c-4297-bcdd-6faddfa701aa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:45:48.388103 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-8fb9a747-1efe-430f-b98e-e54c510fc6ca req-c6f91bf0-092c-4297-bcdd-6faddfa701aa service neutron] 10.222.0.125 "GET /v2.0/ports?tenant_id=76807af9dbfd494e8d149bc35c086824&device_id=a5f77497-cef4-469a-8e86-1f56e2b212f1 HTTP/1.1" status: 200  len: 1096 time: 0.0768025
May 25 17:45:48.460936 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-8fb9a747-1efe-430f-b98e-e54c510fc6ca req-9359f364-8e3a-4b33-8a6e-edfe89b77f44 service neutron] 10.222.0.125 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=ed3a3fd8-1b1b-48b5-a172-10bb4b8b6145 HTTP/1.1" status: 200  len: 217 time: 0.0663972
May 25 17:45:48.535045 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fb9a747-1efe-430f-b98e-e54c510fc6ca req-e35f19a2-8d23-485b-892b-9d51307417de service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:45:48.536623 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-8fb9a747-1efe-430f-b98e-e54c510fc6ca req-e35f19a2-8d23-485b-892b-9d51307417de service neutron] 10.222.0.125 "GET /v2.0/subnets?id=1002a83a-fcaf-455e-9402-7a92f32b974e HTTP/1.1" status: 200  len: 854 time: 0.0668995
May 25 17:45:48.638640 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-8fb9a747-1efe-430f-b98e-e54c510fc6ca req-d1f14b78-4bec-47bc-9248-8680ef84b973 service neutron] 10.222.0.125 "GET /v2.0/ports?network_id=6339c1bc-651f-4152-a569-5ee35d1a9bfe&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0918112
May 25 17:45:48.772221 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-856a2b35-803c-4c5d-ad8b-56986f61c31c req-592786ac-7859-4868-942b-c9972f4b31b5 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:45:48.773713 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-856a2b35-803c-4c5d-ad8b-56986f61c31c req-592786ac-7859-4868-942b-c9972f4b31b5 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=432d7a94-0218-4907-bc7c-650f24a5b1e1 HTTP/1.1" status: 200  len: 945 time: 0.2296019
May 25 17:45:48.815946 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-8fb9a747-1efe-430f-b98e-e54c510fc6ca req-aefce9bc-1a0f-4d0d-8f63-3bbee1c23015 service neutron] 10.222.0.125 "GET /v2.0/networks/6339c1bc-651f-4152-a569-5ee35d1a9bfe?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1715200
May 25 17:45:48.898597 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7950166-d2e0-482d-9057-6ca822a7f91a req-2e03d30d-9eb2-484b-8b73-5bd786f970fb tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:45:48.899958 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-c7950166-d2e0-482d-9057-6ca822a7f91a req-2e03d30d-9eb2-484b-8b73-5bd786f970fb tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] 10.222.0.122 "GET /v2.0/ports?device_id=a5f77497-cef4-469a-8e86-1f56e2b212f1 HTTP/1.1" status: 200  len: 943 time: 0.0984807
May 25 17:45:48.910807 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-856a2b35-803c-4c5d-ad8b-56986f61c31c req-096cacbb-1b17-45bf-ba3e-c85b4ac169c9 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1303179
May 25 17:45:48.959177 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-c7950166-d2e0-482d-9057-6ca822a7f91a req-533a2b1f-59b4-4bb2-9889-5793aee7c6fd tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] 10.222.0.122 "GET /v2.0/security-groups?id=b1cd410a-637d-478e-b9aa-ed7e2ce8bad3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0532482
May 25 17:45:48.983308 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-8fb9a747-1efe-430f-b98e-e54c510fc6ca req-25e1aedb-20bd-4c9e-9a9c-b342bc900a19 service neutron] 10.222.0.125 "GET /v2.0/networks/6339c1bc-651f-4152-a569-5ee35d1a9bfe?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1593554
May 25 17:45:49.260688 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-e3f95034-401e-4f18-8c84-a189aa8f2f4b req-ef018f13-1e96-4eab-a5f6-a7fe1a41ac8d tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] 10.222.0.122 "GET /v2.0/ports?device_id=3fb3211e-48f5-46f5-8035-ddbc35109aa8 HTTP/1.1" status: 200  len: 210 time: 0.0548015
May 25 17:45:49.798941 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9987fd53-d0ec-49a4-ae04-2b2a665e301c req-342cb435-fa26-48ac-bab4-0b817c5ac2d2 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:45:49.800414 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-9987fd53-d0ec-49a4-ae04-2b2a665e301c req-342cb435-fa26-48ac-bab4-0b817c5ac2d2 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=432d7a94-0218-4907-bc7c-650f24a5b1e1 HTTP/1.1" status: 200  len: 945 time: 0.0875888
May 25 17:45:49.892588 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-9987fd53-d0ec-49a4-ae04-2b2a665e301c req-0080e1f1-a741-481c-b0b4-49031eedecfe tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0856097
May 25 17:45:49.912789 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9cc77569-f8dd-4619-becb-c28dfb0b3cd9 req-c88904c6-7055-4387-9aae-4904dc5173d1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:45:49.914228 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-9cc77569-f8dd-4619-becb-c28dfb0b3cd9 req-c88904c6-7055-4387-9aae-4904dc5173d1 service neutron] 10.222.0.125 "GET /v2.0/ports?tenant_id=5b2f6ca8c5b94c2f8894c04f297b5f8b&device_id=432d7a94-0218-4907-bc7c-650f24a5b1e1 HTTP/1.1" status: 200  len: 1098 time: 0.0893445
May 25 17:45:50.049423 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9cc77569-f8dd-4619-becb-c28dfb0b3cd9 req-3d3e220f-31ef-4777-b54b-c27940cb6c74 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:45:50.050878 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-9cc77569-f8dd-4619-becb-c28dfb0b3cd9 req-3d3e220f-31ef-4777-b54b-c27940cb6c74 service neutron] 10.222.0.125 "GET /v2.0/networks?id=2abe381d-082b-4294-8193-c6556a56adb4 HTTP/1.1" status: 200  len: 920 time: 0.1289403
May 25 17:45:50.136605 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-9cc77569-f8dd-4619-becb-c28dfb0b3cd9 req-d87b7aca-dcca-4027-8cb1-a31487a40e66 service neutron] 10.222.0.125 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=ca8c744f-fdc1-456d-ad85-74dff5ed46eb HTTP/1.1" status: 200  len: 217 time: 0.0774810
May 25 17:45:50.167311 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a222f7e-daa5-49da-8fe0-925a72281e4a req-6e3c60d1-19cb-4c89-9a97-60bed697482d tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:45:50.170182 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-0a222f7e-daa5-49da-8fe0-925a72281e4a req-6e3c60d1-19cb-4c89-9a97-60bed697482d tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] 10.222.0.122 "GET /v2.0/ports?device_id=a5f77497-cef4-469a-8e86-1f56e2b212f1 HTTP/1.1" status: 200  len: 943 time: 0.0988715
May 25 17:45:50.219225 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9cc77569-f8dd-4619-becb-c28dfb0b3cd9 req-1a101011-a726-4fa9-b238-bf8582a2d8c6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:45:50.219686 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-0a222f7e-daa5-49da-8fe0-925a72281e4a req-ea59042d-d0c3-401b-9d24-85d099295f97 tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] 10.222.0.122 "GET /v2.0/security-groups?id=b1cd410a-637d-478e-b9aa-ed7e2ce8bad3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0430400
May 25 17:45:50.221426 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-9cc77569-f8dd-4619-becb-c28dfb0b3cd9 req-1a101011-a726-4fa9-b238-bf8582a2d8c6 service neutron] 10.222.0.125 "GET /v2.0/subnets?id=e7ef8006-ae0e-4a18-b5c7-707d13fb7031 HTTP/1.1" status: 200  len: 858 time: 0.0761096
May 25 17:45:50.276117 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-9cc77569-f8dd-4619-becb-c28dfb0b3cd9 req-4f7e9aa8-2021-4fef-87ef-4186234aae23 service neutron] 10.222.0.125 "GET /v2.0/ports?network_id=2abe381d-082b-4294-8193-c6556a56adb4&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0469689
May 25 17:45:50.373147 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 45488) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:45:50.439169 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.db_base_plugin_v2 [None req-242af33a-25a9-42fd-8280-dfebe2091130 admin admin] Deleting subnet 279772c8-d366-4fc6-9c34-e6ddf99b5e08 {{(pid=99026) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 25 17:45:50.442226 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-242af33a-25a9-42fd-8280-dfebe2091130 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:50.491276 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-242af33a-25a9-42fd-8280-dfebe2091130 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-14735050'] for subnet, precommit_delete_associations {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:50.506771 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-9cc77569-f8dd-4619-becb-c28dfb0b3cd9 req-3090cc8b-c862-4661-b5ff-2fa963358835 service neutron] 10.222.0.125 "GET /v2.0/networks/2abe381d-082b-4294-8193-c6556a56adb4?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2265029
May 25 17:45:50.547551 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-242af33a-25a9-42fd-8280-dfebe2091130 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1474503'] for subnet, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:50.644335 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-9cc77569-f8dd-4619-becb-c28dfb0b3cd9 req-d40cc8cc-c735-47f2-9ed6-0c3c8f375eb8 service neutron] 10.222.0.125 "GET /v2.0/networks/2abe381d-082b-4294-8193-c6556a56adb4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1324904
May 25 17:45:50.708165 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-f154c6b7-524e-47f5-b510-76d2778c6d1c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:50.868379 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:50.896781 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-242af33a-25a9-42fd-8280-dfebe2091130 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1473138', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114466', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-15477963', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-14794250'] for subnet, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:50.902010 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:45:50.940798 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-242af33a-25a9-42fd-8280-dfebe2091130 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=279772c8-d366-4fc6-9c34-e6ddf99b5e08,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:45:50.943736 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-242af33a-25a9-42fd-8280-dfebe2091130 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:45:50.946706 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-242af33a-25a9-42fd-8280-dfebe2091130 admin admin] Notify callbacks [] for subnet, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:50.954423 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-242af33a-25a9-42fd-8280-dfebe2091130 admin admin] 10.222.0.122 "DELETE /v2.0/subnets/279772c8-d366-4fc6-9c34-e6ddf99b5e08 HTTP/1.1" status: 204  len: 168 time: 0.5801184
May 25 17:45:50.956908 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 45496) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:45:51.055367 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Device ed3a3fd8-1b1b-48b5-a172-10bb4b8b6145 details requested by agent hyperv_hv-cinder-78956 with host hv-cinder-78956 {{(pid=99028) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 25 17:45:51.058216 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Device 4698ed19-7e41-4457-a1fd-16d5f606084a no longer exists at agent hyperv_hv-cinder-78956 {{(pid=99028) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 17:45:51.072238 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-854e62fb-cdaa-403c-a14e-f1470ce7895e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1492659'] for network, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:51.090459 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e2fa9d4-c9ed-47d8-9c77-d405585ce6ef req-8c11d7f9-ae6f-4e2d-a99a-e9c93360b093 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:45:51.092611 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-0e2fa9d4-c9ed-47d8-9c77-d405585ce6ef req-8c11d7f9-ae6f-4e2d-a99a-e9c93360b093 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=432d7a94-0218-4907-bc7c-650f24a5b1e1 HTTP/1.1" status: 200  len: 945 time: 0.0843036
May 25 17:45:51.097400 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.plugin [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] No Port match for: 4698ed19-7e41-4457-a1fd-16d5f606084a {{(pid=99028) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 25 17:45:51.098010 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Device 4698ed19-7e41-4457-a1fd-16d5f606084a not bound to the agent host hv-cinder-78956 {{(pid=99028) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 25 17:45:51.157837 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-0e2fa9d4-c9ed-47d8-9c77-d405585ce6ef req-9b7b3f38-f904-4bfe-be7c-df983c90b0f1 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0589902
May 25 17:45:51.206706 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-854e62fb-cdaa-403c-a14e-f1470ce7895e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1470792', 'neutron.services.segments.db._delete_segments_for_network-8781841233116'] for network, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:51.219966 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.services.segments.db [None req-854e62fb-cdaa-403c-a14e-f1470ce7895e admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fcae56ef5e0>,) {'filters': {'network_id': ['6c7eca3b-72f3-4ba8-9e95-614d64496512']}} {{(pid=99026) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:45:51.232349 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.services.segments.db [None req-854e62fb-cdaa-403c-a14e-f1470ce7895e admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fcae56ef5e0>, '87df170f-54cc-461b-a7ac-79e125fc526b') {'for_net_delete': True} {{(pid=99026) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:45:51.232642 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.services.segments.db [None req-854e62fb-cdaa-403c-a14e-f1470ce7895e admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fcae56ef5e0>, '87df170f-54cc-461b-a7ac-79e125fc526b') {} {{(pid=99026) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:45:51.237130 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] For port ed3a3fd8-1b1b-48b5-a172-10bb4b8b6145, host hv-cinder-78956, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=ed3a3fd8-1b1b-48b5-a172-10bb4b8b6145,segment=NetworkSegment(31f775e4-1843-4e6f-aa8f-371e25229749),segment_id=31f775e4-1843-4e6f-aa8f-371e25229749)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:45:51.244935 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-854e62fb-cdaa-403c-a14e-f1470ce7895e admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8781841242525', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-14735041'] for segment, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:51.257501 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Returning: {'device': 'ed3a3fd8-1b1b-48b5-a172-10bb4b8b6145', 'network_id': '6339c1bc-651f-4152-a569-5ee35d1a9bfe', 'port_id': 'ed3a3fd8-1b1b-48b5-a172-10bb4b8b6145', 'mac_address': 'fa:16:3e:64:64:93', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1345, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '1002a83a-fcaf-455e-9402-7a92f32b974e', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=99028) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 25 17:45:51.269226 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-854e62fb-cdaa-403c-a14e-f1470ce7895e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1469168'] for segment, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:51.276569 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-854e62fb-cdaa-403c-a14e-f1470ce7895e admin admin] Releasing vlan 1304 on physical network physnet1 to pool {{(pid=99026) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 25 17:45:51.276774 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-854e62fb-cdaa-403c-a14e-f1470ce7895e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1469168', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-15476589'] for segment, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:51.352671 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:51.370726 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.notifiers.nova [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id ed3a3fd8-1b1b-48b5-a172-10bb4b8b6145 {{(pid=99028) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 25 17:45:51.374344 dv-cinder-789564-2-iscsi neutron-server[99026]: Traceback (most recent call last):
May 25 17:45:51.374344 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 25 17:45:51.374344 dv-cinder-789564-2-iscsi neutron-server[99026]:     timer()
May 25 17:45:51.374344 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 25 17:45:51.374344 dv-cinder-789564-2-iscsi neutron-server[99026]:     cb(*args, **kw)
May 25 17:45:51.374344 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 25 17:45:51.374344 dv-cinder-789564-2-iscsi neutron-server[99026]:     return func(*args, **kwargs)
May 25 17:45:51.374344 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 25 17:45:51.374344 dv-cinder-789564-2-iscsi neutron-server[99026]:     self._notify()
May 25 17:45:51.374344 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 25 17:45:51.374344 dv-cinder-789564-2-iscsi neutron-server[99026]:     self.callback(batched_events)
May 25 17:45:51.374344 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 25 17:45:51.374344 dv-cinder-789564-2-iscsi neutron-server[99026]:     event.method(event)
May 25 17:45:51.374344 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 25 17:45:51.374344 dv-cinder-789564-2-iscsi neutron-server[99026]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 25 17:45:51.374344 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 25 17:45:51.374344 dv-cinder-789564-2-iscsi neutron-server[99026]:     aggregate_uuid = self.p_client.list_aggregates(
May 25 17:45:51.374344 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 25 17:45:51.374344 dv-cinder-789564-2-iscsi neutron-server[99026]:     return f(self, *a, **k)
May 25 17:45:51.374344 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 25 17:45:51.374344 dv-cinder-789564-2-iscsi neutron-server[99026]:     return self._get(url).json()
May 25 17:45:51.374344 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 25 17:45:51.374344 dv-cinder-789564-2-iscsi neutron-server[99026]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 25 17:45:51.374344 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 25 17:45:51.374344 dv-cinder-789564-2-iscsi neutron-server[99026]:     return self.request(url, 'GET', **kwargs)
May 25 17:45:51.374344 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 25 17:45:51.374344 dv-cinder-789564-2-iscsi neutron-server[99026]:     base_url = self.get_endpoint(auth, allow=allow,
May 25 17:45:51.374344 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 25 17:45:51.374344 dv-cinder-789564-2-iscsi neutron-server[99026]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 25 17:45:51.374344 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 25 17:45:51.374344 dv-cinder-789564-2-iscsi neutron-server[99026]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 25 17:45:51.374344 dv-cinder-789564-2-iscsi neutron-server[99026]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 25 17:45:51.387364 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] For port ed3a3fd8-1b1b-48b5-a172-10bb4b8b6145, host hv-cinder-78956, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=ed3a3fd8-1b1b-48b5-a172-10bb4b8b6145,segment=NetworkSegment(31f775e4-1843-4e6f-aa8f-371e25229749),segment_id=31f775e4-1843-4e6f-aa8f-371e25229749)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:45:51.462804 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:51.464440 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:45:51.540310 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e585ff7a-f53e-4654-84a4-a2d3ace36e6d req-6f787ef6-df13-4e51-a835-3eaf0f2e0cf2 tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:45:51.542913 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-e585ff7a-f53e-4654-84a4-a2d3ace36e6d req-6f787ef6-df13-4e51-a835-3eaf0f2e0cf2 tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] 10.222.0.122 "GET /v2.0/ports?device_id=a5f77497-cef4-469a-8e86-1f56e2b212f1 HTTP/1.1" status: 200  len: 943 time: 0.1677396
May 25 17:45:51.550972 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Pushing event updated for resources: {'Port': ['ID=ed3a3fd8-1b1b-48b5-a172-10bb4b8b6145,revision_number=4']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:45:51.558451 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:45:51.558833 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:45:51.559198 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:45:51.559467 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:45:51.559860 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:45:51.560238 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:45:51.560649 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:45:51.560987 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:45:51.561354 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:45:51.561679 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:45:51.561998 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:45:51.562314 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:45:51.567297 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.103s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:45:51.600327 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-e585ff7a-f53e-4654-84a4-a2d3ace36e6d req-d204461a-d71e-44cd-874d-69d230904af7 tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] 10.222.0.122 "GET /v2.0/security-groups?id=b1cd410a-637d-478e-b9aa-ed7e2ce8bad3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0436914
May 25 17:45:51.601534 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-854e62fb-cdaa-403c-a14e-f1470ce7895e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1470785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-459299', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551400', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-419883'] for network, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:51.605520 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:45:51.622645 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-854e62fb-cdaa-403c-a14e-f1470ce7895e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for network, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:51.631589 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-854e62fb-cdaa-403c-a14e-f1470ce7895e admin admin] Pushing event deleted for resources: {'Network': ['ID=6c7eca3b-72f3-4ba8-9e95-614d64496512,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:45:51.635210 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-854e62fb-cdaa-403c-a14e-f1470ce7895e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:45:51.671338 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] get_ports_and_sgs() called for port_ids ['ed3a3fd8-1b1b-48b5-a172-10bb4b8b6145'] {{(pid=99028) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 25 17:45:51.725116 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-7e261f94-b84f-443e-be49-3bc1ac903b55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:51.783132 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-854e62fb-cdaa-403c-a14e-f1470ce7895e admin admin] 10.222.0.122 "DELETE /v2.0/networks/6c7eca3b-72f3-4ba8-9e95-614d64496512 HTTP/1.1" status: 204  len: 168 time: 0.8249998
May 25 17:45:52.021891 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 45514) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:45:52.154885 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-3001bd16-9689-421b-b2f5-58ee6c799f22 admin admin] Notify callbacks [] for security_group, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:52.170923 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-3001bd16-9689-421b-b2f5-58ee6c799f22 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:45:52.177185 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-3001bd16-9689-421b-b2f5-58ee6c799f22 admin admin] Usage tracker for resource:security_group_rule and tenant:bfa70cdd4b6c4e11b9bb3b1f06567b05 is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:45:52.184001 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-3001bd16-9689-421b-b2f5-58ee6c799f22 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:45:52.191296 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-3001bd16-9689-421b-b2f5-58ee6c799f22 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:45:52.203220 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 45522) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:45:52.287061 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-1d58d83a-ff57-4018-be25-0658a78e1ddd admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=5ae575cfd07c4a88aa626c15e6bccfd9&name=default HTTP/1.1" status: 200  len: 2975 time: 0.0802987
May 25 17:45:52.287649 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 45526) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:45:52.357040 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7af4f98-fa89-42fc-a1e2-e038e5e27598 req-600625e2-7e5b-46f8-8e7d-fc18e5853ba9 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:45:52.358482 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-b7af4f98-fa89-42fc-a1e2-e038e5e27598 req-600625e2-7e5b-46f8-8e7d-fc18e5853ba9 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=432d7a94-0218-4907-bc7c-650f24a5b1e1 HTTP/1.1" status: 200  len: 945 time: 0.0847120
May 25 17:45:52.369763 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-3001bd16-9689-421b-b2f5-58ee6c799f22 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:52.386003 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-0151b995-aa53-4ce8-99e1-c5a081477013 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:52.406661 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-b7af4f98-fa89-42fc-a1e2-e038e5e27598 req-d9801874-eda0-4a37-a127-f968a058a0bd tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0421088
May 25 17:45:52.413268 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-0151b995-aa53-4ce8-99e1-c5a081477013 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:52.452599 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-3001bd16-9689-421b-b2f5-58ee6c799f22 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:52.460612 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-63f50d31-110a-451e-98cf-2d1602cdb2ba admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:45:52.504859 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-3001bd16-9689-421b-b2f5-58ee6c799f22 admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=bfa70cdd4b6c4e11b9bb3b1f06567b05&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4818685
May 25 17:45:52.506382 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3001bd16-9689-421b-b2f5-58ee6c799f22 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=437b1cb0-b640-45b6-bbf5-919832593725,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:45:52.507870 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 45532) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:45:52.509724 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-3001bd16-9689-421b-b2f5-58ee6c799f22 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:45:52.587240 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-dfee87f0-3a76-4722-89a8-c9bd9c769ba2 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:52.605843 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-0151b995-aa53-4ce8-99e1-c5a081477013 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:52.612387 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-428802d2-72a1-4b92-b5e5-2eaa7e691e7a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:45:52.615809 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-dfee87f0-3a76-4722-89a8-c9bd9c769ba2 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:52.627927 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0151b995-aa53-4ce8-99e1-c5a081477013 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=dda11ec6-545c-479e-bba9-4390fea678fa,revision_number=None']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:45:52.643648 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-0151b995-aa53-4ce8-99e1-c5a081477013 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:45:52.778073 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-0151b995-aa53-4ce8-99e1-c5a081477013 admin admin] Notify callbacks [] for security_group, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:52.779562 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-0151b995-aa53-4ce8-99e1-c5a081477013 admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/dda11ec6-545c-479e-bba9-4390fea678fa HTTP/1.1" status: 204  len: 168 time: 0.4910183
May 25 17:45:52.811413 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-dfee87f0-3a76-4722-89a8-c9bd9c769ba2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:52.816328 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-d41a9d13-9f9b-43d8-8608-fe13e42c9a84 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:45:52.838615 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dfee87f0-3a76-4722-89a8-c9bd9c769ba2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=437b1cb0-b640-45b6-bbf5-919832593725,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:45:52.857950 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-dfee87f0-3a76-4722-89a8-c9bd9c769ba2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.041s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:45:52.860273 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-dfee87f0-3a76-4722-89a8-c9bd9c769ba2 admin admin] Notify callbacks [] for security_group, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:52.861441 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-dfee87f0-3a76-4722-89a8-c9bd9c769ba2 admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/437b1cb0-b640-45b6-bbf5-919832593725 HTTP/1.1" status: 204  len: 168 time: 0.3522460
May 25 17:45:52.912540 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd74a2a7-80fc-4627-8f01-a14f996d17d3 req-c03ee321-4ba9-4504-9774-e26bf66d30a0 tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:45:52.913260 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-fd74a2a7-80fc-4627-8f01-a14f996d17d3 req-c03ee321-4ba9-4504-9774-e26bf66d30a0 tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] Synchronizing usage tracker for tenant:76807af9dbfd494e8d149bc35c086824 on resource:port {{(pid=99027) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 17:45:53.039436 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-fd74a2a7-80fc-4627-8f01-a14f996d17d3 req-c03ee321-4ba9-4504-9774-e26bf66d30a0 tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] Unset dirty status for tenant:76807af9dbfd494e8d149bc35c086824 on resource:port {{(pid=99027) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 17:45:53.045656 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-fd74a2a7-80fc-4627-8f01-a14f996d17d3 req-c03ee321-4ba9-4504-9774-e26bf66d30a0 tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] 10.222.0.122 "GET /v2.0/ports?device_id=a5f77497-cef4-469a-8e86-1f56e2b212f1 HTTP/1.1" status: 200  len: 944 time: 0.2502766
May 25 17:45:53.064613 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Device ed3a3fd8-1b1b-48b5-a172-10bb4b8b6145 up at agent hyperv_hv-cinder-78956 {{(pid=99028) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 17:45:53.119552 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-fd74a2a7-80fc-4627-8f01-a14f996d17d3 req-c6097548-93e4-47a0-97e7-99bcc9fc980b tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] 10.222.0.122 "GET /v2.0/security-groups?id=b1cd410a-637d-478e-b9aa-ed7e2ce8bad3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0620446
May 25 17:45:53.239305 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Provisioning for port ed3a3fd8-1b1b-48b5-a172-10bb4b8b6145 completed by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 17:45:53.244911 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Provisioning complete for port ed3a3fd8-1b1b-48b5-a172-10bb4b8b6145 triggered by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 17:45:53.245724 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:53.279862 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-6df2b2a7-a54e-4d57-9be3-033078b9d5b3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:53.405441 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:53.441681 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a5f77497-cef4-469a-8e86-1f56e2b212f1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ed3a3fd8-1b1b-48b5-a172-10bb4b8b6145'}] {{(pid=99028) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 17:45:53.453239 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] For port ed3a3fd8-1b1b-48b5-a172-10bb4b8b6145, host hv-cinder-78956, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=ed3a3fd8-1b1b-48b5-a172-10bb4b8b6145,segment=NetworkSegment(31f775e4-1843-4e6f-aa8f-371e25229749),segment_id=31f775e4-1843-4e6f-aa8f-371e25229749)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:45:53.487098 dv-cinder-789564-2-iscsi neutron-server[99028]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a5f77497-cef4-469a-8e86-1f56e2b212f1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ed3a3fd8-1b1b-48b5-a172-10bb4b8b6145', 'code': 200}
May 25 17:45:53.533031 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:53.534901 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:45:53.601627 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Pushing event updated for resources: {'Port': ['ID=ed3a3fd8-1b1b-48b5-a172-10bb4b8b6145,revision_number=5']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:45:53.604883 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:45:53.911571 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-247b926c-ca9d-4e99-8d50-97e4456143db req-b2ae0e60-94b8-4f9f-bad1-46dcf7845c27 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:45:53.913069 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-247b926c-ca9d-4e99-8d50-97e4456143db req-b2ae0e60-94b8-4f9f-bad1-46dcf7845c27 service neutron] 10.222.0.125 "GET /v2.0/ports?device_id=a5f77497-cef4-469a-8e86-1f56e2b212f1 HTTP/1.1" status: 200  len: 1098 time: 0.0749521
May 25 17:45:53.957039 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-247b926c-ca9d-4e99-8d50-97e4456143db req-8fd41c48-d99f-48aa-86cf-43d7bd644989 service neutron] 10.222.0.125 "GET /v2.0/security-groups?id=b1cd410a-637d-478e-b9aa-ed7e2ce8bad3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0363038
May 25 17:45:54.307498 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79a67bbe-2b80-4ddb-8ba6-af84c764e40c req-5d39a3a1-83f0-40e3-86b6-187971f70073 tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:45:54.310969 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-79a67bbe-2b80-4ddb-8ba6-af84c764e40c req-5d39a3a1-83f0-40e3-86b6-187971f70073 tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] 10.222.0.122 "GET /v2.0/ports?device_id=a5f77497-cef4-469a-8e86-1f56e2b212f1 HTTP/1.1" status: 200  len: 945 time: 0.0887568
May 25 17:45:54.361701 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-79a67bbe-2b80-4ddb-8ba6-af84c764e40c req-b57cb1c3-d72a-4d61-8eb2-f37ae3ccff23 tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] 10.222.0.122 "GET /v2.0/security-groups?id=b1cd410a-637d-478e-b9aa-ed7e2ce8bad3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0436733
May 25 17:45:55.555548 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7c31015-16ff-4a2e-b53a-d8d61d75fd1a req-473abdab-cf86-4d3b-8710-882e4b612bdf tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:45:55.557043 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-f7c31015-16ff-4a2e-b53a-d8d61d75fd1a req-473abdab-cf86-4d3b-8710-882e4b612bdf tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] 10.222.0.122 "GET /v2.0/ports?device_id=a5f77497-cef4-469a-8e86-1f56e2b212f1 HTTP/1.1" status: 200  len: 945 time: 0.0835617
May 25 17:45:55.604066 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-f7c31015-16ff-4a2e-b53a-d8d61d75fd1a req-06f380a2-ea5e-49ac-a6bc-88d62ac69be1 tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] 10.222.0.122 "GET /v2.0/security-groups?id=b1cd410a-637d-478e-b9aa-ed7e2ce8bad3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0398674
May 25 17:45:57.926209 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad9a18d0-024c-4f8b-a018-40dec397b62e req-758b1bd4-88a8-4fa8-81db-190fab8c10d6 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:45:57.927725 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-ad9a18d0-024c-4f8b-a018-40dec397b62e req-758b1bd4-88a8-4fa8-81db-190fab8c10d6 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=78a85fac-d281-494d-90da-a47ddc8255e5 HTTP/1.1" status: 200  len: 945 time: 0.0956230
May 25 17:45:57.977733 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-ad9a18d0-024c-4f8b-a018-40dec397b62e req-c61a4e55-30c3-474a-b39f-f8832ef987b0 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0433278
May 25 17:45:59.210518 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d90f0ea4-5b4c-49d6-9863-a51a5f4cc2d3 req-1077948f-6401-451e-9fe0-0416cbbae5d9 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:45:59.212554 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-d90f0ea4-5b4c-49d6-9863-a51a5f4cc2d3 req-1077948f-6401-451e-9fe0-0416cbbae5d9 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=78a85fac-d281-494d-90da-a47ddc8255e5 HTTP/1.1" status: 200  len: 945 time: 0.1195993
May 25 17:45:59.280183 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-d90f0ea4-5b4c-49d6-9863-a51a5f4cc2d3 req-7abb8efe-82bf-4061-840c-f2880ed49f9c tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0599613
May 25 17:45:59.585050 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e43d80d7-2958-416d-ae77-5e94a2889d42 req-15fd6c37-37aa-4ed0-8b21-3c5cca1251c7 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:45:59.586816 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-e43d80d7-2958-416d-ae77-5e94a2889d42 req-15fd6c37-37aa-4ed0-8b21-3c5cca1251c7 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.125 "GET /v2.0/ports?device_id=78a85fac-d281-494d-90da-a47ddc8255e5 HTTP/1.1" status: 200  len: 945 time: 0.0925462
May 25 17:45:59.760936 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.plugin [req-e43d80d7-2958-416d-ae77-5e94a2889d42 req-e581ed3a-f635-445e-ba70-76416e074208 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Deleting port 8a9ac879-c35f-482a-b8f0-6355fbb9a900 {{(pid=99027) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 17:45:59.761299 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-e43d80d7-2958-416d-ae77-5e94a2889d42 req-e581ed3a-f635-445e-ba70-76416e074208 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781841220419'] for port, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:45:59.928831 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.db [req-e43d80d7-2958-416d-ae77-5e94a2889d42 req-e581ed3a-f635-445e-ba70-76416e074208 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] For port 8a9ac879-c35f-482a-b8f0-6355fbb9a900, host hv-cinder-78956, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=8a9ac879-c35f-482a-b8f0-6355fbb9a900,segment=NetworkSegment(d619a116-4277-4bad-a1ec-8ca0357dd129),segment_id=d619a116-4277-4bad-a1ec-8ca0357dd129)] {{(pid=99027) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:45:59.929207 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-e43d80d7-2958-416d-ae77-5e94a2889d42 req-e581ed3a-f635-445e-ba70-76416e074208 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-418810'] for port, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:00.071462 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.plugin [req-e43d80d7-2958-416d-ae77-5e94a2889d42 req-e581ed3a-f635-445e-ba70-76416e074208 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Calling delete_port for 8a9ac879-c35f-482a-b8f0-6355fbb9a900 owned by compute:nova {{(pid=99027) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 17:46:00.273864 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-e43d80d7-2958-416d-ae77-5e94a2889d42 req-e581ed3a-f635-445e-ba70-76416e074208 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781841222566', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781840788188', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15468986'] for port, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:00.280994 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-85fd2b34-0182-421e-90a8-ef70bec7b1a7 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:46:00.284627 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] get_ports_and_sgs() called for port_ids ['ca8c744f-fdc1-456d-ad85-74dff5ed46eb', '8a9ac879-c35f-482a-b8f0-6355fbb9a900'] {{(pid=99028) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 25 17:46:00.334794 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e581ed3a-f635-445e-ba70-76416e074208 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Pushing event deleted for resources: {'Port': ['ID=8a9ac879-c35f-482a-b8f0-6355fbb9a900,revision_number=None']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:46:00.338619 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-e581ed3a-f635-445e-ba70-76416e074208 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.058s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:46:00.473996 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.l3_dvrscheduler_db [req-e43d80d7-2958-416d-ae77-5e94a2889d42 req-e581ed3a-f635-445e-ba70-76416e074208 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] No DVR routers for this DVR port 8a9ac879-c35f-482a-b8f0-6355fbb9a900 on host hv-cinder-78956 {{(pid=99027) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 25 17:46:00.482864 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-e43d80d7-2958-416d-ae77-5e94a2889d42 req-e581ed3a-f635-445e-ba70-76416e074208 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-239387'] for port, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:00.486668 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '78a85fac-d281-494d-90da-a47ddc8255e5', 'name': 'network-vif-deleted', 'tag': '8a9ac879-c35f-482a-b8f0-6355fbb9a900'}] {{(pid=99027) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 17:46:00.508220 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-3f2458fd-dfd4-49b2-82ee-a1c420126c8d req-5f4c3953-c189-4ddc-af6a-2bc255f313bb tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=78a85fac-d281-494d-90da-a47ddc8255e5 HTTP/1.1" status: 200  len: 210 time: 0.0746889
May 25 17:46:00.585902 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '78a85fac-d281-494d-90da-a47ddc8255e5', 'name': 'network-vif-deleted', 'tag': '8a9ac879-c35f-482a-b8f0-6355fbb9a900', 'status': 'completed', 'code': 200}
May 25 17:46:00.605864 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-e43d80d7-2958-416d-ae77-5e94a2889d42 req-e581ed3a-f635-445e-ba70-76416e074208 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.125 "DELETE /v2.0/ports/8a9ac879-c35f-482a-b8f0-6355fbb9a900 HTTP/1.1" status: 204  len: 173 time: 1.0096326
May 25 17:46:01.703414 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-473e2320-88c7-4bba-b869-626c32069c8c req-06662bf4-f5d8-4f9a-9c80-abca52b0a2c3 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Synchronizing usage tracker for tenant:5b2f6ca8c5b94c2f8894c04f297b5f8b on resource:port {{(pid=99027) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 17:46:01.850735 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-473e2320-88c7-4bba-b869-626c32069c8c req-06662bf4-f5d8-4f9a-9c80-abca52b0a2c3 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Unset dirty status for tenant:5b2f6ca8c5b94c2f8894c04f297b5f8b on resource:port {{(pid=99027) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 17:46:01.851926 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-473e2320-88c7-4bba-b869-626c32069c8c req-06662bf4-f5d8-4f9a-9c80-abca52b0a2c3 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=78a85fac-d281-494d-90da-a47ddc8255e5 HTTP/1.1" status: 200  len: 210 time: 0.2023876
May 25 17:46:03.103718 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Device 8a9ac879-c35f-482a-b8f0-6355fbb9a900 no longer exists at agent hyperv_hv-cinder-78956 {{(pid=99028) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 17:46:03.143243 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.plugin [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] No Port match for: 8a9ac879-c35f-482a-b8f0-6355fbb9a900 {{(pid=99028) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 25 17:46:03.143596 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Device 8a9ac879-c35f-482a-b8f0-6355fbb9a900 not bound to the agent host hv-cinder-78956 {{(pid=99028) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 25 17:46:03.743790 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d068f665-a4e5-4b27-9243-e00c2d7985dd req-1564bc47-2a17-4765-995e-fbb18aefb2a1 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:46:03.745197 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-d068f665-a4e5-4b27-9243-e00c2d7985dd req-1564bc47-2a17-4765-995e-fbb18aefb2a1 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=432d7a94-0218-4907-bc7c-650f24a5b1e1 HTTP/1.1" status: 200  len: 945 time: 0.1705332
May 25 17:46:03.791847 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-d068f665-a4e5-4b27-9243-e00c2d7985dd req-b79ad0d7-c0de-408b-9056-2d58a9bf1667 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0408494
May 25 17:46:05.025825 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d03c609f-1f15-4410-a645-b0f7c4cedfe3 req-447aca5d-0dec-49d0-a95d-04d5ade54767 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:46:05.027285 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-d03c609f-1f15-4410-a645-b0f7c4cedfe3 req-447aca5d-0dec-49d0-a95d-04d5ade54767 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=432d7a94-0218-4907-bc7c-650f24a5b1e1 HTTP/1.1" status: 200  len: 945 time: 0.1021352
May 25 17:46:05.085025 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-d03c609f-1f15-4410-a645-b0f7c4cedfe3 req-68da39f2-8fdf-4ec7-8029-e681d10ae98b tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0510867
May 25 17:46:06.358179 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-648ae560-50e6-4335-9319-979b21d1c9c6 req-acff14e2-c6c9-4a6c-b1ec-1c58be4d147f tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:46:06.359798 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-648ae560-50e6-4335-9319-979b21d1c9c6 req-acff14e2-c6c9-4a6c-b1ec-1c58be4d147f tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=432d7a94-0218-4907-bc7c-650f24a5b1e1 HTTP/1.1" status: 200  len: 945 time: 0.0975981
May 25 17:46:06.410868 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-648ae560-50e6-4335-9319-979b21d1c9c6 req-11b11e23-17f5-4e37-9585-d78785f8172a tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0451441
May 25 17:46:06.798287 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 45828) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:46:06.957400 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-e0d2aa39-4a80-48ca-bc5e-972f16a11a61 admin admin] Notify callbacks [] for security_group, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:06.972321 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-e0d2aa39-4a80-48ca-bc5e-972f16a11a61 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:46:06.977070 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-e0d2aa39-4a80-48ca-bc5e-972f16a11a61 admin admin] Usage tracker for resource:security_group_rule and tenant:13e7d262c4c1405f8909e5ba33a25da0 is out of sync, need to count used quota {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:46:06.979412 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-e0d2aa39-4a80-48ca-bc5e-972f16a11a61 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:46:06.985926 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-e0d2aa39-4a80-48ca-bc5e-972f16a11a61 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:46:07.067488 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-e0d2aa39-4a80-48ca-bc5e-972f16a11a61 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:07.142896 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-e0d2aa39-4a80-48ca-bc5e-972f16a11a61 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:07.150280 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-be2682fe-afba-4dee-b1fe-d3ce78933b47 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:46:07.195957 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-e0d2aa39-4a80-48ca-bc5e-972f16a11a61 admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=13e7d262c4c1405f8909e5ba33a25da0&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3964272
May 25 17:46:07.197435 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0d2aa39-4a80-48ca-bc5e-972f16a11a61 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=62c177b1-ed7d-4d45-ba92-0429162c236c,revision_number=1']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:46:07.199804 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 45836) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:46:07.202690 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-e0d2aa39-4a80-48ca-bc5e-972f16a11a61 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:46:07.266884 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-300f7e32-738b-47d2-8659-7369ee1e9260 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:07.299603 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-300f7e32-738b-47d2-8659-7369ee1e9260 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:07.433849 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-300f7e32-738b-47d2-8659-7369ee1e9260 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:07.438930 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-e5dc57db-8638-46a5-957e-4a1a6760187a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:46:07.450888 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-300f7e32-738b-47d2-8659-7369ee1e9260 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=62c177b1-ed7d-4d45-ba92-0429162c236c,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:46:07.456213 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-300f7e32-738b-47d2-8659-7369ee1e9260 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:46:07.458842 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-300f7e32-738b-47d2-8659-7369ee1e9260 admin admin] Notify callbacks [] for security_group, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:07.459948 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-300f7e32-738b-47d2-8659-7369ee1e9260 admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/62c177b1-ed7d-4d45-ba92-0429162c236c HTTP/1.1" status: 204  len: 168 time: 0.2591646
May 25 17:46:07.485975 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-806bac78-f1f7-4818-8df9-9663c13c21b8 req-76536dd9-7f5d-4254-a580-a73bd818c50c tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:46:07.487957 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-806bac78-f1f7-4818-8df9-9663c13c21b8 req-76536dd9-7f5d-4254-a580-a73bd818c50c tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.125 "GET /v2.0/ports?device_id=432d7a94-0218-4907-bc7c-650f24a5b1e1 HTTP/1.1" status: 200  len: 945 time: 0.0898008
May 25 17:46:07.622475 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01396dc2-be25-40af-9950-a8e1a1039ca2 req-d2490e1b-bfff-4489-8310-d61dbb83dfd4 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:46:07.623972 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-01396dc2-be25-40af-9950-a8e1a1039ca2 req-d2490e1b-bfff-4489-8310-d61dbb83dfd4 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=432d7a94-0218-4907-bc7c-650f24a5b1e1 HTTP/1.1" status: 200  len: 945 time: 0.0916843
May 25 17:46:07.654167 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.plugin [req-806bac78-f1f7-4818-8df9-9663c13c21b8 req-837dd13d-d33c-460b-826b-8adb4f36a3ec tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Deleting port ca8c744f-fdc1-456d-ad85-74dff5ed46eb {{(pid=99027) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 17:46:07.654708 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-806bac78-f1f7-4818-8df9-9663c13c21b8 req-837dd13d-d33c-460b-826b-8adb4f36a3ec tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781841220419'] for port, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:07.675678 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-01396dc2-be25-40af-9950-a8e1a1039ca2 req-67eaf010-011f-4b61-b3d9-67278040cab1 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/security-groups?id=aec354c8-23d0-4d5f-ac17-f81c620a2f17&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0433362
May 25 17:46:07.879555 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.db [req-806bac78-f1f7-4818-8df9-9663c13c21b8 req-837dd13d-d33c-460b-826b-8adb4f36a3ec tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] For port ca8c744f-fdc1-456d-ad85-74dff5ed46eb, host hv-cinder-78956, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=ca8c744f-fdc1-456d-ad85-74dff5ed46eb,segment=NetworkSegment(d619a116-4277-4bad-a1ec-8ca0357dd129),segment_id=d619a116-4277-4bad-a1ec-8ca0357dd129)] {{(pid=99027) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:46:07.879931 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-806bac78-f1f7-4818-8df9-9663c13c21b8 req-837dd13d-d33c-460b-826b-8adb4f36a3ec tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-418810'] for port, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:08.036539 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.plugin [req-806bac78-f1f7-4818-8df9-9663c13c21b8 req-837dd13d-d33c-460b-826b-8adb4f36a3ec tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Calling delete_port for ca8c744f-fdc1-456d-ad85-74dff5ed46eb owned by compute:nova {{(pid=99027) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 17:46:08.267896 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-806bac78-f1f7-4818-8df9-9663c13c21b8 req-837dd13d-d33c-460b-826b-8adb4f36a3ec tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781841222566', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781840788188', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15468986'] for port, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:08.274796 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-b1265bbc-88b0-4b8f-9a1b-675f1504c10c tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:46:08.279960 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] get_ports_and_sgs() called for port_ids ['ca8c744f-fdc1-456d-ad85-74dff5ed46eb'] {{(pid=99028) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 25 17:46:08.321302 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-837dd13d-d33c-460b-826b-8adb4f36a3ec tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Pushing event deleted for resources: {'Port': ['ID=ca8c744f-fdc1-456d-ad85-74dff5ed46eb,revision_number=None']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:46:08.324969 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-837dd13d-d33c-460b-826b-8adb4f36a3ec tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:46:08.406241 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.l3_dvrscheduler_db [req-806bac78-f1f7-4818-8df9-9663c13c21b8 req-837dd13d-d33c-460b-826b-8adb4f36a3ec tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] No DVR routers for this DVR port ca8c744f-fdc1-456d-ad85-74dff5ed46eb on host hv-cinder-78956 {{(pid=99027) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 25 17:46:08.408750 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-806bac78-f1f7-4818-8df9-9663c13c21b8 req-837dd13d-d33c-460b-826b-8adb4f36a3ec tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-239387'] for port, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:08.411400 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '432d7a94-0218-4907-bc7c-650f24a5b1e1', 'name': 'network-vif-deleted', 'tag': 'ca8c744f-fdc1-456d-ad85-74dff5ed46eb'}] {{(pid=99027) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 17:46:08.460340 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '432d7a94-0218-4907-bc7c-650f24a5b1e1', 'name': 'network-vif-deleted', 'tag': 'ca8c744f-fdc1-456d-ad85-74dff5ed46eb', 'status': 'completed', 'code': 200}
May 25 17:46:08.536714 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-806bac78-f1f7-4818-8df9-9663c13c21b8 req-837dd13d-d33c-460b-826b-8adb4f36a3ec tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.125 "DELETE /v2.0/ports/ca8c744f-fdc1-456d-ad85-74dff5ed46eb HTTP/1.1" status: 204  len: 173 time: 1.0400090
May 25 17:46:08.848050 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-31bcacb6-8f9f-4f5e-9d54-681aae38c63e req-6e02ac14-8e4e-4bef-9c5f-b2408af4c0f4 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] 10.222.0.122 "GET /v2.0/ports?device_id=432d7a94-0218-4907-bc7c-650f24a5b1e1 HTTP/1.1" status: 200  len: 210 time: 0.0444314
May 25 17:46:09.953693 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 45920) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:46:10.383198 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 45930) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:46:10.525872 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-3349a420-350f-4fef-8875-ee73c7ef5b1f admin admin] Notify callbacks [] for security_group, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:10.543485 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-3349a420-350f-4fef-8875-ee73c7ef5b1f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:46:10.549177 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-3349a420-350f-4fef-8875-ee73c7ef5b1f admin admin] Usage tracker for resource:security_group_rule and tenant:d0e8e027f70f43f5b6abe6cd2c1b4d06 is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:46:10.551702 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-3349a420-350f-4fef-8875-ee73c7ef5b1f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:46:10.557970 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-3349a420-350f-4fef-8875-ee73c7ef5b1f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:46:10.652982 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-4b47fc6d-cd09-48e9-946d-37e5814c5323 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-420907'] for router_interface, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:10.661239 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-3349a420-350f-4fef-8875-ee73c7ef5b1f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:10.736447 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-3349a420-350f-4fef-8875-ee73c7ef5b1f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:10.747351 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-d8ee53c9-73f0-468f-af02-1274c1673fbc admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:46:10.802450 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3349a420-350f-4fef-8875-ee73c7ef5b1f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6bc9bf9f-169c-4f0d-a1e6-da35d9fbd6bd,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:46:10.806393 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-3349a420-350f-4fef-8875-ee73c7ef5b1f admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=d0e8e027f70f43f5b6abe6cd2c1b4d06&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4220116
May 25 17:46:10.807471 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-3349a420-350f-4fef-8875-ee73c7ef5b1f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.061s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:46:10.808984 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 45938) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:46:10.877796 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-7413b42a-bc46-46be-964e-bc9794601f4c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:10.910966 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-7413b42a-bc46-46be-964e-bc9794601f4c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:11.033563 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-7413b42a-bc46-46be-964e-bc9794601f4c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:11.038455 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:46:11.052809 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7413b42a-bc46-46be-964e-bc9794601f4c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6bc9bf9f-169c-4f0d-a1e6-da35d9fbd6bd,revision_number=None']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:46:11.055658 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-7413b42a-bc46-46be-964e-bc9794601f4c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:46:11.056983 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-7413b42a-bc46-46be-964e-bc9794601f4c admin admin] Notify callbacks [] for security_group, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:11.061652 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-7413b42a-bc46-46be-964e-bc9794601f4c admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/6bc9bf9f-169c-4f0d-a1e6-da35d9fbd6bd HTTP/1.1" status: 204  len: 168 time: 0.2474701
May 25 17:46:11.170236 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.plugin [None req-4b47fc6d-cd09-48e9-946d-37e5814c5323 admin admin] Deleting port f7fc9e77-51db-43c8-9f03-ac0ca1040af2 {{(pid=99026) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 17:46:11.170794 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-4b47fc6d-cd09-48e9-946d-37e5814c5323 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781841220419'] for port, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:11.176535 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Device ca8c744f-fdc1-456d-ad85-74dff5ed46eb no longer exists at agent hyperv_hv-cinder-78956 {{(pid=99028) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 17:46:11.210496 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.plugin [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] No Port match for: ca8c744f-fdc1-456d-ad85-74dff5ed46eb {{(pid=99028) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 25 17:46:11.210844 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Device ca8c744f-fdc1-456d-ad85-74dff5ed46eb not bound to the agent host hv-cinder-78956 {{(pid=99028) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 25 17:46:11.296660 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.db [None req-4b47fc6d-cd09-48e9-946d-37e5814c5323 admin admin] For port f7fc9e77-51db-43c8-9f03-ac0ca1040af2, host dv-cinder-789564-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=f7fc9e77-51db-43c8-9f03-ac0ca1040af2,segment=NetworkSegment(d619a116-4277-4bad-a1ec-8ca0357dd129),segment_id=d619a116-4277-4bad-a1ec-8ca0357dd129)] {{(pid=99026) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:46:11.297126 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-4b47fc6d-cd09-48e9-946d-37e5814c5323 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-418810'] for port, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:11.439161 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.plugin [None req-4b47fc6d-cd09-48e9-946d-37e5814c5323 admin admin] Calling delete_port for f7fc9e77-51db-43c8-9f03-ac0ca1040af2 owned by network:router_interface {{(pid=99026) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 17:46:11.507667 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:11.801573 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 45952) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:46:11.811529 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-4b47fc6d-cd09-48e9-946d-37e5814c5323 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781841222566', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781840788188', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15476536'] for port, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:11.817193 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-b77e4b1c-86cc-4a74-80f7-6be7e53762d1 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:46:11.819920 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-7835678d-b17c-49e0-84bd-e5dd0ad46970 admin admin] Notify callbacks [] for security_group, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:11.835256 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-7835678d-b17c-49e0-84bd-e5dd0ad46970 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:46:11.839173 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-7835678d-b17c-49e0-84bd-e5dd0ad46970 admin admin] Usage tracker for resource:security_group_rule and tenant:a705f666e64540b9946461c4ff022e92 is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:46:11.842151 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-7835678d-b17c-49e0-84bd-e5dd0ad46970 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:46:11.848385 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-7835678d-b17c-49e0-84bd-e5dd0ad46970 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:46:11.866570 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b47fc6d-cd09-48e9-946d-37e5814c5323 admin admin] Pushing event deleted for resources: {'Port': ['ID=f7fc9e77-51db-43c8-9f03-ac0ca1040af2,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:46:11.869606 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-4b47fc6d-cd09-48e9-946d-37e5814c5323 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:46:11.936293 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-7835678d-b17c-49e0-84bd-e5dd0ad46970 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:12.027925 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-7835678d-b17c-49e0-84bd-e5dd0ad46970 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:12.038839 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-66679d61-0cca-47d0-969e-1add8b2bae6b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:46:12.081467 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7835678d-b17c-49e0-84bd-e5dd0ad46970 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=06059b4e-e9f8-41d7-b6e3-9736ef7b6694,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:46:12.085808 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-7835678d-b17c-49e0-84bd-e5dd0ad46970 admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=a705f666e64540b9946461c4ff022e92&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2831101
May 25 17:46:12.086742 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-7835678d-b17c-49e0-84bd-e5dd0ad46970 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:46:12.088463 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 45956) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:46:12.157014 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-accf3087-4ddd-4b62-8fde-1c2e92ba59ff admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:12.186579 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-accf3087-4ddd-4b62-8fde-1c2e92ba59ff admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:12.246194 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-4b47fc6d-cd09-48e9-946d-37e5814c5323 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-551393', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-420795'] for router_interface, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:12.319509 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-accf3087-4ddd-4b62-8fde-1c2e92ba59ff admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:12.323352 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-a57f519c-3996-475b-93f8-133e651d9db7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:46:12.335226 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-accf3087-4ddd-4b62-8fde-1c2e92ba59ff admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=06059b4e-e9f8-41d7-b6e3-9736ef7b6694,revision_number=None']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:46:12.339268 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-accf3087-4ddd-4b62-8fde-1c2e92ba59ff admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:46:12.343576 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-accf3087-4ddd-4b62-8fde-1c2e92ba59ff admin admin] Notify callbacks [] for security_group, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:12.344846 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-accf3087-4ddd-4b62-8fde-1c2e92ba59ff admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/06059b4e-e9f8-41d7-b6e3-9736ef7b6694 HTTP/1.1" status: 204  len: 168 time: 0.2554665
May 25 17:46:12.626513 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4b47fc6d-cd09-48e9-946d-37e5814c5323 admin admin] Router df4629e6-3b17-47f3-88e4-022b915a6a91 has already been hosted by L3 agent eaeb6875-c4ed-43b6-8658-aa4e52324fdf {{(pid=99026) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 25 17:46:12.817640 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4b47fc6d-cd09-48e9-946d-37e5814c5323 admin admin] Notify agent at l3_agent.dv-cinder-789564-2-iscsi the message routers_updated {{(pid=99026) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 25 17:46:12.827548 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-465ec728-470e-4ca6-8cee-bf07dcc38d77 None None] Sync routers for ids ['df4629e6-3b17-47f3-88e4-022b915a6a91'] in dv-cinder-789564-2-iscsi {{(pid=99029) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 25 17:46:12.832499 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-4b47fc6d-cd09-48e9-946d-37e5814c5323 admin admin] 10.222.0.122 "PUT /v2.0/routers/df4629e6-3b17-47f3-88e4-022b915a6a91/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.8776207
May 25 17:46:12.835006 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 45978) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:46:12.842264 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_dvrscheduler_db [None req-465ec728-470e-4ca6-8cee-bf07dcc38d77 None None] Routers {'df4629e6-3b17-47f3-88e4-022b915a6a91'} bound to L3 agent in host dv-cinder-789564-2-iscsi {{(pid=99029) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 17:46:12.842895 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_hamode_db [None req-465ec728-470e-4ca6-8cee-bf07dcc38d77 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcae6fd2160>, 'dv-cinder-789564-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-25T17:34:21Z,description=<?>,heartbeat_timestamp=2021-05-25T17:45:51Z,host='dv-cinder-789564-2-iscsi',id=eaeb6875-c4ed-43b6-8658-aa4e52324fdf,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T17:34:21Z,topic='l3_agent')) {'router_ids': ['df4629e6-3b17-47f3-88e4-022b915a6a91'], 'active': True} {{(pid=99029) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:46:13.040001 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_dvr_db [None req-465ec728-470e-4ca6-8cee-bf07dcc38d77 None None] Set router df4629e6-3b17-47f3-88e4-022b915a6a91 gateway port host: dv-cinder-789564-2-iscsi {{(pid=99029) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 17:46:13.049936 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-5dc948ed-65f6-4093-9c0a-0ef1d1b8aab3 admin admin] Notify callbacks [] for router, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:13.246489 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-5dc948ed-65f6-4093-9c0a-0ef1d1b8aab3 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:13.355202 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_hamode_db [None req-465ec728-470e-4ca6-8cee-bf07dcc38d77 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcae6fd2160>, [{'id': 'df4629e6-3b17-47f3-88e4-022b915a6a91', 'name': 'tempest-ServerRescueNegativeTestJSON-301463405-router', 'tenant_id': '5b2f6ca8c5b94c2f8894c04f297b5f8b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.206'}], 'enable_snat': True}, 'gw_port_id': 'ba3fdf48-5b50-4a04-9bed-01d9f2c8cf44', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:42:21Z', 'updated_at': '2021-05-25T17:46:11Z', 'revision_number': 5, 'project_id': '5b2f6ca8c5b94c2f8894c04f297b5f8b', 'gw_port': {'id': 'ba3fdf48-5b50-4a04-9bed-01d9f2c8cf44', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:8b:8e:8a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'df4629e6-3b17-47f3-88e4-022b915a6a91', 'device_owner': 'network:router_gateway', 'standard_attr_id': 74, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.206', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:42:22Z', 'updated_at': '2021-05-25T17:42:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi'}], 'dv-cinder-789564-2-iscsi', False) {} {{(pid=99029) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:46:13.360871 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-465ec728-470e-4ca6-8cee-bf07dcc38d77 None None] Checking router: df4629e6-3b17-47f3-88e4-022b915a6a91 for host: dv-cinder-789564-2-iscsi {{(pid=99029) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 25 17:46:13.370568 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_dvrscheduler_db [None req-465ec728-470e-4ca6-8cee-bf07dcc38d77 None None] Routers {'df4629e6-3b17-47f3-88e4-022b915a6a91'} bound to L3 agent in host dv-cinder-789564-2-iscsi {{(pid=99029) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 17:46:13.371236 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_hamode_db [None req-465ec728-470e-4ca6-8cee-bf07dcc38d77 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcae6fd2160>, 'dv-cinder-789564-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-25T17:34:21Z,description=<?>,heartbeat_timestamp=2021-05-25T17:45:51Z,host='dv-cinder-789564-2-iscsi',id=eaeb6875-c4ed-43b6-8658-aa4e52324fdf,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T17:34:21Z,topic='l3_agent')) {'router_ids': ['df4629e6-3b17-47f3-88e4-022b915a6a91'], 'active': True} {{(pid=99029) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:46:13.419662 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.plugin [None req-5dc948ed-65f6-4093-9c0a-0ef1d1b8aab3 admin admin] Deleting port ba3fdf48-5b50-4a04-9bed-01d9f2c8cf44 {{(pid=99026) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 17:46:13.420049 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-5dc948ed-65f6-4093-9c0a-0ef1d1b8aab3 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781841220419'] for port, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:13.542111 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_dvr_db [None req-465ec728-470e-4ca6-8cee-bf07dcc38d77 None None] Set router df4629e6-3b17-47f3-88e4-022b915a6a91 gateway port host: None {{(pid=99029) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 17:46:13.554380 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.db [None req-5dc948ed-65f6-4093-9c0a-0ef1d1b8aab3 admin admin] For port ba3fdf48-5b50-4a04-9bed-01d9f2c8cf44, host dv-cinder-789564-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=ba3fdf48-5b50-4a04-9bed-01d9f2c8cf44,segment=NetworkSegment(471771f9-c462-4865-800d-0d5029e9eb3e),segment_id=471771f9-c462-4865-800d-0d5029e9eb3e)] {{(pid=99026) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:46:13.554817 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-5dc948ed-65f6-4093-9c0a-0ef1d1b8aab3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-418810'] for port, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:13.683072 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_hamode_db [None req-465ec728-470e-4ca6-8cee-bf07dcc38d77 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcae6fd2160>, [{'id': 'df4629e6-3b17-47f3-88e4-022b915a6a91', 'name': 'tempest-ServerRescueNegativeTestJSON-301463405-router', 'tenant_id': '5b2f6ca8c5b94c2f8894c04f297b5f8b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:42:21Z', 'updated_at': '2021-05-25T17:46:13Z', 'revision_number': 6, 'project_id': '5b2f6ca8c5b94c2f8894c04f297b5f8b', 'gw_port_host': None}], 'dv-cinder-789564-2-iscsi', False) {} {{(pid=99029) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:46:13.686533 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.plugin [None req-5dc948ed-65f6-4093-9c0a-0ef1d1b8aab3 admin admin] Calling delete_port for ba3fdf48-5b50-4a04-9bed-01d9f2c8cf44 owned by network:router_gateway {{(pid=99026) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 17:46:13.694378 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-465ec728-470e-4ca6-8cee-bf07dcc38d77 None None] The sync data for ids ['df4629e6-3b17-47f3-88e4-022b915a6a91'] in dv-cinder-789564-2-iscsi is: [{'id': 'df4629e6-3b17-47f3-88e4-022b915a6a91', 'name': 'tempest-ServerRescueNegativeTestJSON-301463405-router', 'tenant_id': '5b2f6ca8c5b94c2f8894c04f297b5f8b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:42:21Z', 'updated_at': '2021-05-25T17:46:13Z', 'revision_number': 6, 'project_id': '5b2f6ca8c5b94c2f8894c04f297b5f8b', 'gw_port_host': None}] {{(pid=99029) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 25 17:46:14.016534 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-5dc948ed-65f6-4093-9c0a-0ef1d1b8aab3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781841222566', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781840788188', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15476536'] for port, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:14.021356 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-4b47fc6d-cd09-48e9-946d-37e5814c5323 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:46:14.065663 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5dc948ed-65f6-4093-9c0a-0ef1d1b8aab3 admin admin] Pushing event deleted for resources: {'Port': ['ID=ba3fdf48-5b50-4a04-9bed-01d9f2c8cf44,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:46:14.068858 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-5dc948ed-65f6-4093-9c0a-0ef1d1b8aab3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:46:14.160045 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-5dc948ed-65f6-4093-9c0a-0ef1d1b8aab3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-419894'] for router_gateway, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:14.350307 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-5dc948ed-65f6-4093-9c0a-0ef1d1b8aab3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-415163', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-6965'] for router, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:14.353796 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-5dc948ed-65f6-4093-9c0a-0ef1d1b8aab3 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:14.525838 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-5dc948ed-65f6-4093-9c0a-0ef1d1b8aab3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-414855'] for router, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:14.526391 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5dc948ed-65f6-4093-9c0a-0ef1d1b8aab3 admin admin] Fanout notify agent at l3_agent the message router_deleted on router df4629e6-3b17-47f3-88e4-022b915a6a91 {{(pid=99026) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
May 25 17:46:14.540122 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-5dc948ed-65f6-4093-9c0a-0ef1d1b8aab3 admin admin] Notify callbacks [] for router, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:14.541408 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-5dc948ed-65f6-4093-9c0a-0ef1d1b8aab3 admin admin] 10.222.0.122 "DELETE /v2.0/routers/df4629e6-3b17-47f3-88e4-022b915a6a91 HTTP/1.1" status: 204  len: 168 time: 1.7052858
May 25 17:46:14.544666 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 46024) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:46:14.614610 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.db_base_plugin_v2 [None req-5605677a-9a89-4ce3-9e52-8d0f13b2e061 admin admin] Deleting subnet e7ef8006-ae0e-4a18-b5c7-707d13fb7031 {{(pid=99027) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 25 17:46:14.618621 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-5605677a-9a89-4ce3-9e52-8d0f13b2e061 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:14.671146 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-5605677a-9a89-4ce3-9e52-8d0f13b2e061 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-15628865'] for subnet, precommit_delete_associations {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:14.728070 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-5605677a-9a89-4ce3-9e52-8d0f13b2e061 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1474503'] for subnet, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:15.125408 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-5605677a-9a89-4ce3-9e52-8d0f13b2e061 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1473138', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114466', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-15467081', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-14778143'] for subnet, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:15.129534 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:46:15.168122 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5605677a-9a89-4ce3-9e52-8d0f13b2e061 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=e7ef8006-ae0e-4a18-b5c7-707d13fb7031,revision_number=None']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:46:15.170754 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-5605677a-9a89-4ce3-9e52-8d0f13b2e061 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.041s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:46:15.171807 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-5605677a-9a89-4ce3-9e52-8d0f13b2e061 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for subnet, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:15.178027 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-5605677a-9a89-4ce3-9e52-8d0f13b2e061 admin admin] 10.222.0.122 "DELETE /v2.0/subnets/e7ef8006-ae0e-4a18-b5c7-707d13fb7031 HTTP/1.1" status: 204  len: 168 time: 0.6321917
May 25 17:46:15.180380 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 46034) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:46:15.226779 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device ba3fdf48-5b50-4a04-9bed-01d9f2c8cf44 no longer exists at agent ovs-agent-dv-cinder-789564-2-iscsi {{(pid=99028) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 17:46:15.267245 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.plugin [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] No Port match for: ba3fdf48-5b50-4a04-9bed-01d9f2c8cf44 {{(pid=99028) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 25 17:46:15.268590 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device ba3fdf48-5b50-4a04-9bed-01d9f2c8cf44 not bound to the agent host dv-cinder-789564-2-iscsi {{(pid=99028) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 25 17:46:15.269215 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device f7fc9e77-51db-43c8-9f03-ac0ca1040af2 no longer exists at agent ovs-agent-dv-cinder-789564-2-iscsi {{(pid=99028) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 17:46:15.287531 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-6bf7aba1-c884-454f-a9e1-e813683b2277 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1492659'] for network, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:15.309605 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.plugin [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] No Port match for: f7fc9e77-51db-43c8-9f03-ac0ca1040af2 {{(pid=99028) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 25 17:46:15.309959 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device f7fc9e77-51db-43c8-9f03-ac0ca1040af2 not bound to the agent host dv-cinder-789564-2-iscsi {{(pid=99028) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 25 17:46:15.431300 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-6bf7aba1-c884-454f-a9e1-e813683b2277 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1470792', 'neutron.services.segments.db._delete_segments_for_network-8781841233116'] for network, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:15.444840 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.services.segments.db [None req-6bf7aba1-c884-454f-a9e1-e813683b2277 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fcae6c248b0>,) {'filters': {'network_id': ['2abe381d-082b-4294-8193-c6556a56adb4']}} {{(pid=99027) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:46:15.457997 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.services.segments.db [None req-6bf7aba1-c884-454f-a9e1-e813683b2277 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fcae6c248b0>, 'd619a116-4277-4bad-a1ec-8ca0357dd129') {'for_net_delete': True} {{(pid=99027) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:46:15.458284 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.services.segments.db [None req-6bf7aba1-c884-454f-a9e1-e813683b2277 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fcae6c248b0>, 'd619a116-4277-4bad-a1ec-8ca0357dd129') {} {{(pid=99027) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:46:15.469952 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-6bf7aba1-c884-454f-a9e1-e813683b2277 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8781841242525', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-15628874'] for segment, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:15.486611 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-6bf7aba1-c884-454f-a9e1-e813683b2277 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1469168'] for segment, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:15.493664 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-6bf7aba1-c884-454f-a9e1-e813683b2277 admin admin] Releasing vlan 1329 on physical network physnet1 to pool {{(pid=99027) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 25 17:46:15.494186 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-6bf7aba1-c884-454f-a9e1-e813683b2277 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1469168', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-15469039'] for segment, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:15.519238 dv-cinder-789564-2-iscsi neutron-server[99027]: Traceback (most recent call last):
May 25 17:46:15.519238 dv-cinder-789564-2-iscsi neutron-server[99027]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 25 17:46:15.519238 dv-cinder-789564-2-iscsi neutron-server[99027]:     timer()
May 25 17:46:15.519238 dv-cinder-789564-2-iscsi neutron-server[99027]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 25 17:46:15.519238 dv-cinder-789564-2-iscsi neutron-server[99027]:     cb(*args, **kw)
May 25 17:46:15.519238 dv-cinder-789564-2-iscsi neutron-server[99027]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 25 17:46:15.519238 dv-cinder-789564-2-iscsi neutron-server[99027]:     return func(*args, **kwargs)
May 25 17:46:15.519238 dv-cinder-789564-2-iscsi neutron-server[99027]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 25 17:46:15.519238 dv-cinder-789564-2-iscsi neutron-server[99027]:     self._notify()
May 25 17:46:15.519238 dv-cinder-789564-2-iscsi neutron-server[99027]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 25 17:46:15.519238 dv-cinder-789564-2-iscsi neutron-server[99027]:     self.callback(batched_events)
May 25 17:46:15.519238 dv-cinder-789564-2-iscsi neutron-server[99027]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 25 17:46:15.519238 dv-cinder-789564-2-iscsi neutron-server[99027]:     event.method(event)
May 25 17:46:15.519238 dv-cinder-789564-2-iscsi neutron-server[99027]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 25 17:46:15.519238 dv-cinder-789564-2-iscsi neutron-server[99027]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 25 17:46:15.519238 dv-cinder-789564-2-iscsi neutron-server[99027]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 25 17:46:15.519238 dv-cinder-789564-2-iscsi neutron-server[99027]:     aggregate_uuid = self.p_client.list_aggregates(
May 25 17:46:15.519238 dv-cinder-789564-2-iscsi neutron-server[99027]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 25 17:46:15.519238 dv-cinder-789564-2-iscsi neutron-server[99027]:     return f(self, *a, **k)
May 25 17:46:15.519238 dv-cinder-789564-2-iscsi neutron-server[99027]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 25 17:46:15.519238 dv-cinder-789564-2-iscsi neutron-server[99027]:     return self._get(url).json()
May 25 17:46:15.519238 dv-cinder-789564-2-iscsi neutron-server[99027]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 25 17:46:15.519238 dv-cinder-789564-2-iscsi neutron-server[99027]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 25 17:46:15.519238 dv-cinder-789564-2-iscsi neutron-server[99027]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 25 17:46:15.519238 dv-cinder-789564-2-iscsi neutron-server[99027]:     return self.request(url, 'GET', **kwargs)
May 25 17:46:15.519238 dv-cinder-789564-2-iscsi neutron-server[99027]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 25 17:46:15.519238 dv-cinder-789564-2-iscsi neutron-server[99027]:     base_url = self.get_endpoint(auth, allow=allow,
May 25 17:46:15.519238 dv-cinder-789564-2-iscsi neutron-server[99027]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 25 17:46:15.519238 dv-cinder-789564-2-iscsi neutron-server[99027]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 25 17:46:15.519238 dv-cinder-789564-2-iscsi neutron-server[99027]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 25 17:46:15.519238 dv-cinder-789564-2-iscsi neutron-server[99027]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 25 17:46:15.519238 dv-cinder-789564-2-iscsi neutron-server[99027]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 25 17:46:15.662228 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-6bf7aba1-c884-454f-a9e1-e813683b2277 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1470785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-459299', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551400', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-419883'] for network, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:15.668070 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-6bf7aba1-c884-454f-a9e1-e813683b2277 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for network, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:15.672179 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:46:15.698912 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6bf7aba1-c884-454f-a9e1-e813683b2277 admin admin] Pushing event deleted for resources: {'Network': ['ID=2abe381d-082b-4294-8193-c6556a56adb4,revision_number=None']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:46:15.702624 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-6bf7aba1-c884-454f-a9e1-e813683b2277 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:46:15.765641 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-6bf7aba1-c884-454f-a9e1-e813683b2277 admin admin] 10.222.0.122 "DELETE /v2.0/networks/2abe381d-082b-4294-8193-c6556a56adb4 HTTP/1.1" status: 204  len: 168 time: 0.5841730
May 25 17:46:16.197538 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 46050) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:46:16.248977 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-6aa6d564-3d2b-4981-b19d-014d4d746d0f admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=5b2f6ca8c5b94c2f8894c04f297b5f8b&name=default HTTP/1.1" status: 200  len: 2975 time: 0.0501759
May 25 17:46:16.251518 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 46054) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:46:16.311908 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-e2914d5e-7c68-4ea3-9903-718d8b4a7af9 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:16.342975 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-e2914d5e-7c68-4ea3-9903-718d8b4a7af9 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:16.484903 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-e2914d5e-7c68-4ea3-9903-718d8b4a7af9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:16.488705 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-af42f433-e478-45db-9b61-db771975eb52 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:46:16.501659 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2914d5e-7c68-4ea3-9903-718d8b4a7af9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=aec354c8-23d0-4d5f-ac17-f81c620a2f17,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:46:16.504771 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-e2914d5e-7c68-4ea3-9903-718d8b4a7af9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:46:16.569824 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-e2914d5e-7c68-4ea3-9903-718d8b4a7af9 admin admin] Notify callbacks [] for security_group, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:16.571978 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-e2914d5e-7c68-4ea3-9903-718d8b4a7af9 admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/aec354c8-23d0-4d5f-ac17-f81c620a2f17 HTTP/1.1" status: 204  len: 168 time: 0.3184023
May 25 17:46:18.154307 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4dd477dd-6501-47b6-a384-8445dffb64c6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:19.763899 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.agents_db [None req-14fae233-15dc-4576-836b-621c5f95b584 None None] Agent healthcheck: found 6 active agents {{(pid=99029) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 17:46:20.600716 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 46158) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:46:20.722761 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-29ed41b9-b67f-46fe-9982-5d305306799f admin admin] Notify callbacks [] for security_group, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:20.740283 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-29ed41b9-b67f-46fe-9982-5d305306799f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:46:20.744516 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-29ed41b9-b67f-46fe-9982-5d305306799f admin admin] Usage tracker for resource:security_group_rule and tenant:2d84230f4aef422385cdd265736b0dcf is out of sync, need to count used quota {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:46:20.748722 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-29ed41b9-b67f-46fe-9982-5d305306799f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:46:20.755053 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-29ed41b9-b67f-46fe-9982-5d305306799f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:46:20.787947 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-caaaef6e-7bb8-403d-ba51-8ffd4ed043d3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:20.840543 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-29ed41b9-b67f-46fe-9982-5d305306799f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:20.902479 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:20.930739 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-29ed41b9-b67f-46fe-9982-5d305306799f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:20.941636 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-594b39d3-5999-4bb3-a0fb-5127040e4453 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:46:20.985535 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-29ed41b9-b67f-46fe-9982-5d305306799f admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=2d84230f4aef422385cdd265736b0dcf&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3835156
May 25 17:46:20.987439 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29ed41b9-b67f-46fe-9982-5d305306799f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=69d1f907-3b8b-41c5-a357-2965c3b9a33d,revision_number=1']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:46:20.988284 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 46166) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:46:20.991705 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-29ed41b9-b67f-46fe-9982-5d305306799f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:46:21.050773 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-f1d46075-d6eb-433a-b54a-c489ab077da6 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:21.077350 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-f1d46075-d6eb-433a-b54a-c489ab077da6 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:21.199593 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-f1d46075-d6eb-433a-b54a-c489ab077da6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:21.203615 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-80b3d489-d907-4da4-bb46-3c1019967bd6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:46:21.216913 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1d46075-d6eb-433a-b54a-c489ab077da6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=69d1f907-3b8b-41c5-a357-2965c3b9a33d,revision_number=None']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:46:21.220072 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-f1d46075-d6eb-433a-b54a-c489ab077da6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:46:21.222107 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-f1d46075-d6eb-433a-b54a-c489ab077da6 admin admin] Notify callbacks [] for security_group, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:21.223188 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-f1d46075-d6eb-433a-b54a-c489ab077da6 admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/69d1f907-3b8b-41c5-a357-2965c3b9a33d HTTP/1.1" status: 204  len: 168 time: 0.2334120
May 25 17:46:21.668887 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-7e261f94-b84f-443e-be49-3bc1ac903b55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:22.009250 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 46192) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:46:22.030797 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-b8d369ed-3620-4e00-a886-678b94487eab admin admin] Notify callbacks [] for security_group, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:22.045402 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-b8d369ed-3620-4e00-a886-678b94487eab admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:46:22.049256 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-b8d369ed-3620-4e00-a886-678b94487eab admin admin] Usage tracker for resource:security_group_rule and tenant:43d87bae8a124672bb6959ec0bdd043a is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:46:22.052100 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-b8d369ed-3620-4e00-a886-678b94487eab admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:46:22.058108 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-b8d369ed-3620-4e00-a886-678b94487eab admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:46:22.161234 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-b8d369ed-3620-4e00-a886-678b94487eab admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:22.202924 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 46198) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:46:22.227804 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-b8d369ed-3620-4e00-a886-678b94487eab admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:22.236960 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-3001bd16-9689-421b-b2f5-58ee6c799f22 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:46:22.277244 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-b8d369ed-3620-4e00-a886-678b94487eab admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=43d87bae8a124672bb6959ec0bdd043a&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2666068
May 25 17:46:22.278966 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8d369ed-3620-4e00-a886-678b94487eab admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b65742fa-6304-4ca8-a556-aa4371a0e61e,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:46:22.279999 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 46204) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:46:22.282561 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-b8d369ed-3620-4e00-a886-678b94487eab admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:46:22.327769 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-d1e8200b-a884-47b8-994c-4e18939112f3 admin admin] Notify callbacks [] for security_group, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:22.342007 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-d1e8200b-a884-47b8-994c-4e18939112f3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:46:22.343616 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-cbc415d0-be12-4382-ab19-3a069ca277be admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:22.345859 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-d1e8200b-a884-47b8-994c-4e18939112f3 admin admin] Usage tracker for resource:security_group_rule and tenant:0571d9c9a5084ce390d3b2e964eae668 is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:46:22.348764 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-d1e8200b-a884-47b8-994c-4e18939112f3 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:46:22.354979 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-d1e8200b-a884-47b8-994c-4e18939112f3 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:46:22.369379 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-cbc415d0-be12-4382-ab19-3a069ca277be admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:22.439819 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-d1e8200b-a884-47b8-994c-4e18939112f3 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:22.496731 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-cbc415d0-be12-4382-ab19-3a069ca277be admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:22.500708 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-41c29a59-f6f8-424b-a235-908009210219 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:46:22.513232 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cbc415d0-be12-4382-ab19-3a069ca277be admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b65742fa-6304-4ca8-a556-aa4371a0e61e,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:46:22.516767 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-cbc415d0-be12-4382-ab19-3a069ca277be admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:46:22.519514 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-d1e8200b-a884-47b8-994c-4e18939112f3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:22.524810 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-cbc415d0-be12-4382-ab19-3a069ca277be admin admin] Notify callbacks [] for security_group, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:22.528513 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-cbc415d0-be12-4382-ab19-3a069ca277be admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/b65742fa-6304-4ca8-a556-aa4371a0e61e HTTP/1.1" status: 204  len: 168 time: 0.2449985
May 25 17:46:22.529157 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-a3f3bae6-7223-452e-964d-6c9e1c8187ca admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:46:22.572560 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-d1e8200b-a884-47b8-994c-4e18939112f3 admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=0571d9c9a5084ce390d3b2e964eae668&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3684528
May 25 17:46:22.574287 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1e8200b-a884-47b8-994c-4e18939112f3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=60e30b0b-eb83-4175-a50d-2feb3566c57a,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:46:22.575999 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 46210) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:46:22.577894 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-d1e8200b-a884-47b8-994c-4e18939112f3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:46:22.640350 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-4dbfa8cb-0419-47c0-a7a3-a9f02cfb9059 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:22.665859 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-4dbfa8cb-0419-47c0-a7a3-a9f02cfb9059 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:22.793481 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-4dbfa8cb-0419-47c0-a7a3-a9f02cfb9059 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:22.797583 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-92aa0bc3-1a23-4832-8ed7-25ad4b99d539 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:46:22.814121 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4dbfa8cb-0419-47c0-a7a3-a9f02cfb9059 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=60e30b0b-eb83-4175-a50d-2feb3566c57a,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:46:22.818948 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-4dbfa8cb-0419-47c0-a7a3-a9f02cfb9059 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:46:22.822616 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-4dbfa8cb-0419-47c0-a7a3-a9f02cfb9059 admin admin] Notify callbacks [] for security_group, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:22.823827 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-4dbfa8cb-0419-47c0-a7a3-a9f02cfb9059 admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/60e30b0b-eb83-4175-a50d-2feb3566c57a HTTP/1.1" status: 204  len: 168 time: 0.2416177
May 25 17:46:23.302007 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-6df2b2a7-a54e-4d57-9be3-033078b9d5b3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:30.976797 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 46400) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:46:31.094682 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-8aa05d80-2b99-4b84-9032-6c5f89094b25 admin admin] Notify callbacks [] for security_group, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:31.110499 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-8aa05d80-2b99-4b84-9032-6c5f89094b25 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:46:31.114359 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-8aa05d80-2b99-4b84-9032-6c5f89094b25 admin admin] Usage tracker for resource:security_group_rule and tenant:25b7ae5e7a5c48d699e38c047d770c42 is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:46:31.117279 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-8aa05d80-2b99-4b84-9032-6c5f89094b25 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:46:31.123238 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-8aa05d80-2b99-4b84-9032-6c5f89094b25 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:46:31.208471 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-8aa05d80-2b99-4b84-9032-6c5f89094b25 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:31.279213 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-8aa05d80-2b99-4b84-9032-6c5f89094b25 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:31.287549 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-7413b42a-bc46-46be-964e-bc9794601f4c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:46:31.331295 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-8aa05d80-2b99-4b84-9032-6c5f89094b25 admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=25b7ae5e7a5c48d699e38c047d770c42&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3533521
May 25 17:46:31.332053 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8aa05d80-2b99-4b84-9032-6c5f89094b25 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5f20a3d2-f79b-41d5-8aa0-041d416a5b3c,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:46:31.334032 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 46416) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:46:31.339807 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8aa05d80-2b99-4b84-9032-6c5f89094b25 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:46:31.340173 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8aa05d80-2b99-4b84-9032-6c5f89094b25 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:46:31.340527 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8aa05d80-2b99-4b84-9032-6c5f89094b25 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:46:31.340873 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8aa05d80-2b99-4b84-9032-6c5f89094b25 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:46:31.341312 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8aa05d80-2b99-4b84-9032-6c5f89094b25 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:46:31.341580 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8aa05d80-2b99-4b84-9032-6c5f89094b25 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:46:31.342048 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8aa05d80-2b99-4b84-9032-6c5f89094b25 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:46:31.342349 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8aa05d80-2b99-4b84-9032-6c5f89094b25 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:46:31.343216 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8aa05d80-2b99-4b84-9032-6c5f89094b25 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:46:31.343496 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8aa05d80-2b99-4b84-9032-6c5f89094b25 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:46:31.343831 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8aa05d80-2b99-4b84-9032-6c5f89094b25 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:46:31.344228 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8aa05d80-2b99-4b84-9032-6c5f89094b25 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:46:31.348298 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-8aa05d80-2b99-4b84-9032-6c5f89094b25 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.061s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:46:31.397873 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-0ff9b2cc-4e28-461a-bc91-7c5906191dfb admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:31.423197 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-0ff9b2cc-4e28-461a-bc91-7c5906191dfb admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:31.587880 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-0ff9b2cc-4e28-461a-bc91-7c5906191dfb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:31.592060 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-84cf2c4b-3da3-4d14-b65e-ae76cdbcdb8b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:46:31.609452 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ff9b2cc-4e28-461a-bc91-7c5906191dfb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5f20a3d2-f79b-41d5-8aa0-041d416a5b3c,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:46:31.612586 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-0ff9b2cc-4e28-461a-bc91-7c5906191dfb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:46:31.618911 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-0ff9b2cc-4e28-461a-bc91-7c5906191dfb admin admin] Notify callbacks [] for security_group, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:31.620042 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-0ff9b2cc-4e28-461a-bc91-7c5906191dfb admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/5f20a3d2-f79b-41d5-8aa0-041d416a5b3c HTTP/1.1" status: 204  len: 168 time: 0.2845509
May 25 17:46:32.254815 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 46426) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:46:32.272541 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-fb745162-f4f3-412b-809e-58d96d8e8ad6 admin admin] Notify callbacks [] for security_group, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:32.287119 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-fb745162-f4f3-412b-809e-58d96d8e8ad6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:46:32.291483 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-fb745162-f4f3-412b-809e-58d96d8e8ad6 admin admin] Usage tracker for resource:security_group_rule and tenant:1b81361ba7cf49fb8b1958b2a5313247 is out of sync, need to count used quota {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:46:32.294857 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-fb745162-f4f3-412b-809e-58d96d8e8ad6 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:46:32.301020 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-fb745162-f4f3-412b-809e-58d96d8e8ad6 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:46:32.381770 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-fb745162-f4f3-412b-809e-58d96d8e8ad6 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:32.485250 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-fb745162-f4f3-412b-809e-58d96d8e8ad6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:32.497309 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-9a071e6f-302b-481a-91b3-4019e0411465 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:46:32.536125 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb745162-f4f3-412b-809e-58d96d8e8ad6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7bae7529-c8fd-457f-b2d7-28bb3e5e4f4e,revision_number=1']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:46:32.540429 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-fb745162-f4f3-412b-809e-58d96d8e8ad6 admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=1b81361ba7cf49fb8b1958b2a5313247&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2843826
May 25 17:46:32.541335 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-fb745162-f4f3-412b-809e-58d96d8e8ad6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:46:32.543193 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 46434) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:46:32.601398 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-a2df7b4e-bd7b-4a84-b15c-8719f928a288 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:32.627669 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-a2df7b4e-bd7b-4a84-b15c-8719f928a288 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:32.753634 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-a2df7b4e-bd7b-4a84-b15c-8719f928a288 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:32.758907 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-4d4d809e-c888-473e-a330-89210a35d1f0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:46:32.771350 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2df7b4e-bd7b-4a84-b15c-8719f928a288 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7bae7529-c8fd-457f-b2d7-28bb3e5e4f4e,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:46:32.774407 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-a2df7b4e-bd7b-4a84-b15c-8719f928a288 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:46:32.776437 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-a2df7b4e-bd7b-4a84-b15c-8719f928a288 admin admin] Notify callbacks [] for security_group, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:32.777622 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-a2df7b4e-bd7b-4a84-b15c-8719f928a288 admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/7bae7529-c8fd-457f-b2d7-28bb3e5e4f4e HTTP/1.1" status: 204  len: 168 time: 0.2335436
May 25 17:46:34.444239 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 46482) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:46:34.562510 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-453db126-49ad-42a8-a7e0-cd70ff2f10c1 admin admin] Notify callbacks [] for security_group, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:34.577304 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-453db126-49ad-42a8-a7e0-cd70ff2f10c1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:46:34.581068 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-453db126-49ad-42a8-a7e0-cd70ff2f10c1 admin admin] Usage tracker for resource:security_group_rule and tenant:4ecff480e0c049d98d24017bf8d11406 is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:46:34.583817 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-453db126-49ad-42a8-a7e0-cd70ff2f10c1 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:46:34.589379 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-453db126-49ad-42a8-a7e0-cd70ff2f10c1 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:46:34.679542 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-453db126-49ad-42a8-a7e0-cd70ff2f10c1 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:34.741895 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-453db126-49ad-42a8-a7e0-cd70ff2f10c1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:34.755157 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-28e7690d-adbc-4bfa-982d-a1f183d46565 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:46:34.794239 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-453db126-49ad-42a8-a7e0-cd70ff2f10c1 admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=4ecff480e0c049d98d24017bf8d11406&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3486056
May 25 17:46:34.795875 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-453db126-49ad-42a8-a7e0-cd70ff2f10c1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=07f96aed-fa65-4ec0-b4e9-58bf68f04ad8,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:46:34.796928 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 46492) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:46:34.799143 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-453db126-49ad-42a8-a7e0-cd70ff2f10c1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:46:34.858640 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-d4ca2367-ec53-4228-b98c-bc6c3adfb2d7 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:34.885367 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-d4ca2367-ec53-4228-b98c-bc6c3adfb2d7 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:34.999923 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-d4ca2367-ec53-4228-b98c-bc6c3adfb2d7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:35.003708 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-1da02044-4d49-4bb0-81ac-5ba4c2b4a59e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:46:35.015335 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4ca2367-ec53-4228-b98c-bc6c3adfb2d7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=07f96aed-fa65-4ec0-b4e9-58bf68f04ad8,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:46:35.025355 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-d4ca2367-ec53-4228-b98c-bc6c3adfb2d7 admin admin] Notify callbacks [] for security_group, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:35.026455 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-d4ca2367-ec53-4228-b98c-bc6c3adfb2d7 admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/07f96aed-fa65-4ec0-b4e9-58bf68f04ad8 HTTP/1.1" status: 204  len: 168 time: 0.2285335
May 25 17:46:35.027867 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d4ca2367-ec53-4228-b98c-bc6c3adfb2d7 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:46:35.028234 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d4ca2367-ec53-4228-b98c-bc6c3adfb2d7 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:46:35.028598 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d4ca2367-ec53-4228-b98c-bc6c3adfb2d7 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:46:35.029023 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d4ca2367-ec53-4228-b98c-bc6c3adfb2d7 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:46:35.029400 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d4ca2367-ec53-4228-b98c-bc6c3adfb2d7 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:46:35.029815 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d4ca2367-ec53-4228-b98c-bc6c3adfb2d7 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:46:35.030173 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d4ca2367-ec53-4228-b98c-bc6c3adfb2d7 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:46:35.030893 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d4ca2367-ec53-4228-b98c-bc6c3adfb2d7 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:46:35.030893 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d4ca2367-ec53-4228-b98c-bc6c3adfb2d7 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:46:35.031171 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d4ca2367-ec53-4228-b98c-bc6c3adfb2d7 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:46:35.031524 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d4ca2367-ec53-4228-b98c-bc6c3adfb2d7 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:46:35.031905 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d4ca2367-ec53-4228-b98c-bc6c3adfb2d7 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:46:35.034890 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-d4ca2367-ec53-4228-b98c-bc6c3adfb2d7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:46:39.924817 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-c32792a1-61d4-4264-9004-32aebd520961 req-5d1b5b31-ccb8-405b-9c2e-2eca732e4997 service neutron] 10.222.0.125 "GET /v2.0/ports?device_id=446d90e5-0bef-47f6-852a-61b638d2a161&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.0722857
May 25 17:46:40.025400 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c32792a1-61d4-4264-9004-32aebd520961 req-23292d72-7687-43d7-ab73-44626b5db502 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:46:40.026989 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-c32792a1-61d4-4264-9004-32aebd520961 req-23292d72-7687-43d7-ab73-44626b5db502 service neutron] 10.222.0.125 "GET /v2.0/ports?tenant_id=b4cdc54b260f4e79b87fdf4a43b12e16&device_id=446d90e5-0bef-47f6-852a-61b638d2a161 HTTP/1.1" status: 200  len: 1099 time: 0.0753744
May 25 17:46:40.144434 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 46624) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:46:40.178254 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c32792a1-61d4-4264-9004-32aebd520961 req-51f2aff0-3262-41e9-99f0-b78f911311f7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:46:40.179699 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-c32792a1-61d4-4264-9004-32aebd520961 req-51f2aff0-3262-41e9-99f0-b78f911311f7 service neutron] 10.222.0.125 "GET /v2.0/networks?id=defaef08-c0f9-4608-b66d-b97e06e185bf HTTP/1.1" status: 200  len: 913 time: 0.1343865
May 25 17:46:40.270712 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-c5e8504f-4f7d-4108-87fc-dd9e1e6362df admin admin] Notify callbacks [] for security_group, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:40.285414 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-c32792a1-61d4-4264-9004-32aebd520961 req-46c3c93a-5a53-4c53-b34b-86a09458b5df service neutron] 10.222.0.125 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=841b2456-1a8a-47bd-a481-929b9038fe0d HTTP/1.1" status: 200  len: 1002 time: 0.1004674
May 25 17:46:40.287295 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-c5e8504f-4f7d-4108-87fc-dd9e1e6362df admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:46:40.291710 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-c5e8504f-4f7d-4108-87fc-dd9e1e6362df admin admin] Usage tracker for resource:security_group_rule and tenant:7126cde7611945849ba4e45f103af3ae is out of sync, need to count used quota {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:46:40.294795 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-c5e8504f-4f7d-4108-87fc-dd9e1e6362df admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:46:40.301842 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-c5e8504f-4f7d-4108-87fc-dd9e1e6362df admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:46:40.351872 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c32792a1-61d4-4264-9004-32aebd520961 req-d6ee3a2a-a50d-45a3-9a60-faf9e7fc5e69 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:46:40.353550 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-c32792a1-61d4-4264-9004-32aebd520961 req-d6ee3a2a-a50d-45a3-9a60-faf9e7fc5e69 service neutron] 10.222.0.125 "GET /v2.0/subnets?id=5be08358-9d04-4ee9-91ac-104e66e66e20 HTTP/1.1" status: 200  len: 850 time: 0.0633335
May 25 17:46:40.399189 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-c5e8504f-4f7d-4108-87fc-dd9e1e6362df admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:40.461335 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c32792a1-61d4-4264-9004-32aebd520961 req-8caa400f-eccc-4d77-8732-3a6dbd97a92f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:46:40.462822 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-c32792a1-61d4-4264-9004-32aebd520961 req-8caa400f-eccc-4d77-8732-3a6dbd97a92f service neutron] 10.222.0.125 "GET /v2.0/ports?network_id=defaef08-c0f9-4608-b66d-b97e06e185bf&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1008356
May 25 17:46:40.485441 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-c5e8504f-4f7d-4108-87fc-dd9e1e6362df admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:40.519483 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-d4ca2367-ec53-4228-b98c-bc6c3adfb2d7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:46:40.543105 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-c5e8504f-4f7d-4108-87fc-dd9e1e6362df admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=7126cde7611945849ba4e45f103af3ae&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3974392
May 25 17:46:40.547694 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 46640) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:46:40.585747 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5e8504f-4f7d-4108-87fc-dd9e1e6362df admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=42525690-ee76-4222-a681-8b1b63fb180f,revision_number=1']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:46:40.595923 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-c5e8504f-4f7d-4108-87fc-dd9e1e6362df admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:46:40.637558 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-63e70610-14b4-48dc-bdc6-25ee858935bc admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:40.665644 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-63e70610-14b4-48dc-bdc6-25ee858935bc admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:40.735521 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-c32792a1-61d4-4264-9004-32aebd520961 req-663e6303-bf8e-4174-96ca-7a1ec3a26461 service neutron] 10.222.0.125 "GET /v2.0/networks/defaef08-c0f9-4608-b66d-b97e06e185bf?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2624567
May 25 17:46:40.845214 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-63e70610-14b4-48dc-bdc6-25ee858935bc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:40.850096 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-c10307c2-e967-4ee0-9f83-3c8e51fbcc53 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:46:40.863145 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63e70610-14b4-48dc-bdc6-25ee858935bc admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=42525690-ee76-4222-a681-8b1b63fb180f,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:46:40.866525 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-63e70610-14b4-48dc-bdc6-25ee858935bc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:46:40.869023 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-63e70610-14b4-48dc-bdc6-25ee858935bc admin admin] Notify callbacks [] for security_group, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:40.870044 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-63e70610-14b4-48dc-bdc6-25ee858935bc admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/42525690-ee76-4222-a681-8b1b63fb180f HTTP/1.1" status: 204  len: 168 time: 0.3213634
May 25 17:46:40.873526 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-c32792a1-61d4-4264-9004-32aebd520961 req-d7d7d73c-0866-44ff-a7cf-ae07d43e34f1 service neutron] 10.222.0.125 "GET /v2.0/networks/defaef08-c0f9-4608-b66d-b97e06e185bf?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1297221
May 25 17:46:41.508502 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:41.622284 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 46662) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:46:41.639408 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-b04e8f6e-2123-42ee-a888-a82cbc9de230 admin admin] Notify callbacks [] for security_group, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:41.661115 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-b04e8f6e-2123-42ee-a888-a82cbc9de230 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:46:41.661115 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-b04e8f6e-2123-42ee-a888-a82cbc9de230 admin admin] Usage tracker for resource:security_group_rule and tenant:ab538ed18c664dc58332ea82971a74d2 is out of sync, need to count used quota {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:46:41.661732 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-b04e8f6e-2123-42ee-a888-a82cbc9de230 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:46:41.667357 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-b04e8f6e-2123-42ee-a888-a82cbc9de230 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:46:41.762790 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-b04e8f6e-2123-42ee-a888-a82cbc9de230 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:41.816606 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-b04e8f6e-2123-42ee-a888-a82cbc9de230 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:41.823770 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-e605148a-a5b1-4721-9964-6f5fba1a25cc admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:46:41.949860 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-b04e8f6e-2123-42ee-a888-a82cbc9de230 admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=ab538ed18c664dc58332ea82971a74d2&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3264875
May 25 17:46:41.950599 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b04e8f6e-2123-42ee-a888-a82cbc9de230 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=15ab3785-97a4-4db2-b953-600423ddb4dd,revision_number=1']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:46:41.953532 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 46668) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:46:41.954067 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-b04e8f6e-2123-42ee-a888-a82cbc9de230 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.130s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:46:42.075345 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-9bb85a69-2dce-4d1c-a016-fbdb95ce4e2d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:42.109112 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-9bb85a69-2dce-4d1c-a016-fbdb95ce4e2d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:42.139202 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84518ebe-c220-4165-b30b-c798c4c62707 req-f6715708-863e-4b1d-848b-e18963b5f275 tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:46:42.140693 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-84518ebe-c220-4165-b30b-c798c4c62707 req-f6715708-863e-4b1d-848b-e18963b5f275 tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] 10.222.0.122 "GET /v2.0/ports?device_id=a5f77497-cef4-469a-8e86-1f56e2b212f1 HTTP/1.1" status: 200  len: 945 time: 0.1583881
May 25 17:46:42.200134 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-84518ebe-c220-4165-b30b-c798c4c62707 req-984fbdc8-94f8-44eb-9528-ef8b289ccd43 tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] 10.222.0.122 "GET /v2.0/security-groups?id=b1cd410a-637d-478e-b9aa-ed7e2ce8bad3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0496917
May 25 17:46:42.267684 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-9bb85a69-2dce-4d1c-a016-fbdb95ce4e2d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:42.271494 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-38b5192d-bdcd-44a9-afd5-f49fcdd0ff8e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:46:42.284148 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9bb85a69-2dce-4d1c-a016-fbdb95ce4e2d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=15ab3785-97a4-4db2-b953-600423ddb4dd,revision_number=None']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:46:42.287963 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-9bb85a69-2dce-4d1c-a016-fbdb95ce4e2d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:46:42.308335 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-9bb85a69-2dce-4d1c-a016-fbdb95ce4e2d admin admin] Notify callbacks [] for security_group, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:42.309550 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-9bb85a69-2dce-4d1c-a016-fbdb95ce4e2d admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/15ab3785-97a4-4db2-b953-600423ddb4dd HTTP/1.1" status: 204  len: 168 time: 0.3539765
May 25 17:46:43.224688 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83bb0173-adb6-4f57-ac34-cb2d8286a7ff req-b582a19e-e4d4-4ee4-87c1-0ca9f74c6ad3 tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:46:43.226573 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-83bb0173-adb6-4f57-ac34-cb2d8286a7ff req-b582a19e-e4d4-4ee4-87c1-0ca9f74c6ad3 tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] 10.222.0.125 "GET /v2.0/ports?device_id=a5f77497-cef4-469a-8e86-1f56e2b212f1 HTTP/1.1" status: 200  len: 945 time: 0.0863183
May 25 17:46:43.393359 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.plugin [req-83bb0173-adb6-4f57-ac34-cb2d8286a7ff req-154be7f1-9e02-4583-be0f-3de0d4be93bd tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] Deleting port ed3a3fd8-1b1b-48b5-a172-10bb4b8b6145 {{(pid=99027) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 17:46:43.393359 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-83bb0173-adb6-4f57-ac34-cb2d8286a7ff req-154be7f1-9e02-4583-be0f-3de0d4be93bd tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781841220419'] for port, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:43.430624 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-045bb325-80b3-40a3-ad60-0dc4c10b1fcb req-0092125b-b2f8-4e25-8692-e64cb1429a17 tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:46:43.438325 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-045bb325-80b3-40a3-ad60-0dc4c10b1fcb req-0092125b-b2f8-4e25-8692-e64cb1429a17 tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] 10.222.0.122 "GET /v2.0/ports?device_id=a5f77497-cef4-469a-8e86-1f56e2b212f1 HTTP/1.1" status: 200  len: 945 time: 0.1052830
May 25 17:46:43.494437 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-045bb325-80b3-40a3-ad60-0dc4c10b1fcb req-e80c1e95-7439-40ad-9397-86d9efe4ae4f tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] 10.222.0.122 "GET /v2.0/security-groups?id=b1cd410a-637d-478e-b9aa-ed7e2ce8bad3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0550551
May 25 17:46:43.539081 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.db [req-83bb0173-adb6-4f57-ac34-cb2d8286a7ff req-154be7f1-9e02-4583-be0f-3de0d4be93bd tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] For port ed3a3fd8-1b1b-48b5-a172-10bb4b8b6145, host hv-cinder-78956, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=ed3a3fd8-1b1b-48b5-a172-10bb4b8b6145,segment=NetworkSegment(31f775e4-1843-4e6f-aa8f-371e25229749),segment_id=31f775e4-1843-4e6f-aa8f-371e25229749)] {{(pid=99027) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:46:43.539435 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-83bb0173-adb6-4f57-ac34-cb2d8286a7ff req-154be7f1-9e02-4583-be0f-3de0d4be93bd tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-418810'] for port, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:43.671955 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.plugin [req-83bb0173-adb6-4f57-ac34-cb2d8286a7ff req-154be7f1-9e02-4583-be0f-3de0d4be93bd tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] Calling delete_port for ed3a3fd8-1b1b-48b5-a172-10bb4b8b6145 owned by compute:nova {{(pid=99027) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 17:46:43.890720 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-83bb0173-adb6-4f57-ac34-cb2d8286a7ff req-154be7f1-9e02-4583-be0f-3de0d4be93bd tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781841222566', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781840788188', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15468986'] for port, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:43.897440 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-105c47ad-9000-4e81-81c0-d80bc66b3e94 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:46:43.913498 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] get_ports_and_sgs() called for port_ids ['ed3a3fd8-1b1b-48b5-a172-10bb4b8b6145'] {{(pid=99028) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 25 17:46:43.954083 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-154be7f1-9e02-4583-be0f-3de0d4be93bd tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] Pushing event deleted for resources: {'Port': ['ID=ed3a3fd8-1b1b-48b5-a172-10bb4b8b6145,revision_number=None']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:46:43.956758 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-154be7f1-9e02-4583-be0f-3de0d4be93bd tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.060s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:46:44.062050 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.l3_dvrscheduler_db [req-83bb0173-adb6-4f57-ac34-cb2d8286a7ff req-154be7f1-9e02-4583-be0f-3de0d4be93bd tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] No DVR routers for this DVR port ed3a3fd8-1b1b-48b5-a172-10bb4b8b6145 on host hv-cinder-78956 {{(pid=99027) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 25 17:46:44.064482 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-83bb0173-adb6-4f57-ac34-cb2d8286a7ff req-154be7f1-9e02-4583-be0f-3de0d4be93bd tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-239387'] for port, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:44.067071 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a5f77497-cef4-469a-8e86-1f56e2b212f1', 'name': 'network-vif-deleted', 'tag': 'ed3a3fd8-1b1b-48b5-a172-10bb4b8b6145'}] {{(pid=99027) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 17:46:44.132097 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-83bb0173-adb6-4f57-ac34-cb2d8286a7ff req-154be7f1-9e02-4583-be0f-3de0d4be93bd tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] 10.222.0.125 "DELETE /v2.0/ports/ed3a3fd8-1b1b-48b5-a172-10bb4b8b6145 HTTP/1.1" status: 204  len: 173 time: 0.8978956
May 25 17:46:44.133760 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a5f77497-cef4-469a-8e86-1f56e2b212f1', 'name': 'network-vif-deleted', 'tag': 'ed3a3fd8-1b1b-48b5-a172-10bb4b8b6145', 'status': 'completed', 'code': 200}
May 25 17:46:44.671878 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-b33531cb-9474-4695-8b77-13de90d54ded req-300e4073-4c7e-4e10-b708-46cdab2e3f56 tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] 10.222.0.122 "GET /v2.0/ports?device_id=a5f77497-cef4-469a-8e86-1f56e2b212f1 HTTP/1.1" status: 200  len: 210 time: 0.0549068
May 25 17:46:47.323215 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Device ed3a3fd8-1b1b-48b5-a172-10bb4b8b6145 no longer exists at agent hyperv_hv-cinder-78956 {{(pid=99028) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 17:46:47.358853 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.plugin [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] No Port match for: ed3a3fd8-1b1b-48b5-a172-10bb4b8b6145 {{(pid=99028) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 25 17:46:47.359203 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Device ed3a3fd8-1b1b-48b5-a172-10bb4b8b6145 not bound to the agent host hv-cinder-78956 {{(pid=99028) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 25 17:46:48.130729 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-ecd3080b-89ec-4784-be85-e6b667f50279 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:50.650835 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-7f9b2c3b-9397-429d-8ce6-9527be30907a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:50.822287 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:51.708055 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-7e261f94-b84f-443e-be49-3bc1ac903b55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:52.097324 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 46920) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:46:52.222928 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-563c19a0-57b4-47c5-a382-816ae9d1537b admin admin] Notify callbacks [] for security_group, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:52.237618 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-563c19a0-57b4-47c5-a382-816ae9d1537b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:46:52.241327 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-563c19a0-57b4-47c5-a382-816ae9d1537b admin admin] Usage tracker for resource:security_group_rule and tenant:b07d8bdd055c42c88eb223c5c6635a48 is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:46:52.244421 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-563c19a0-57b4-47c5-a382-816ae9d1537b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:46:52.250634 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-563c19a0-57b4-47c5-a382-816ae9d1537b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:46:52.332207 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-563c19a0-57b4-47c5-a382-816ae9d1537b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:52.404816 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-563c19a0-57b4-47c5-a382-816ae9d1537b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:52.411440 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-3349a420-350f-4fef-8875-ee73c7ef5b1f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:46:52.451947 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-563c19a0-57b4-47c5-a382-816ae9d1537b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1e205715-a0fa-452e-8670-58c81a1ded42,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:46:52.456048 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-563c19a0-57b4-47c5-a382-816ae9d1537b admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=b07d8bdd055c42c88eb223c5c6635a48&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3575084
May 25 17:46:52.456900 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-563c19a0-57b4-47c5-a382-816ae9d1537b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:46:52.458752 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 46926) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:46:52.518514 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-ac090b0c-e997-4532-9828-6ae8de1c86ee admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:52.548953 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-ac090b0c-e997-4532-9828-6ae8de1c86ee admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:52.696800 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-ac090b0c-e997-4532-9828-6ae8de1c86ee admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:52.701665 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-9566509f-6eb0-4716-b429-80079ba5b734 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:46:52.717847 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac090b0c-e997-4532-9828-6ae8de1c86ee admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1e205715-a0fa-452e-8670-58c81a1ded42,revision_number=None']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:46:52.720479 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-ac090b0c-e997-4532-9828-6ae8de1c86ee admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:46:52.727224 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-ac090b0c-e997-4532-9828-6ae8de1c86ee admin admin] Notify callbacks [] for security_group, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:52.728448 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-ac090b0c-e997-4532-9828-6ae8de1c86ee admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/1e205715-a0fa-452e-8670-58c81a1ded42 HTTP/1.1" status: 204  len: 168 time: 0.2688043
May 25 17:46:53.290588 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-6df2b2a7-a54e-4d57-9be3-033078b9d5b3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:54.993359 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78d323dc-4d7b-4101-b810-bf1c04d862a2 req-1790bc31-cd51-4928-beff-89adf68c26d7 tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:46:54.995280 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-78d323dc-4d7b-4101-b810-bf1c04d862a2 req-1790bc31-cd51-4928-beff-89adf68c26d7 tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] 10.222.0.122 "GET /v2.0/networks?id=6339c1bc-651f-4152-a569-5ee35d1a9bfe HTTP/1.1" status: 200  len: 814 time: 0.1533551
May 25 17:46:55.012994 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-78d323dc-4d7b-4101-b810-bf1c04d862a2 req-b42c8a12-7590-4984-bf02-4ab38f2d9207 tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] 10.222.0.122 "GET /v2.0/quotas/76807af9dbfd494e8d149bc35c086824 HTTP/1.1" status: 200  len: 375 time: 0.0105557
May 25 17:46:55.064914 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-78d323dc-4d7b-4101-b810-bf1c04d862a2 req-24425bd3-b9dd-4c87-9c51-c1f4c8ea2ff1 tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] 10.222.0.122 "GET /v2.0/ports?tenant_id=76807af9dbfd494e8d149bc35c086824&fields=id HTTP/1.1" status: 200  len: 210 time: 0.0440657
May 25 17:46:55.202646 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-78d323dc-4d7b-4101-b810-bf1c04d862a2 req-aa4b8a75-57bb-4265-bc0f-73d88f248433 service neutron] 10.222.0.122 "GET /v2.0/networks/6339c1bc-651f-4152-a569-5ee35d1a9bfe?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1309996
May 25 17:46:55.338312 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-78d323dc-4d7b-4101-b810-bf1c04d862a2 req-2146ff54-5f56-4588-ac86-aa0cedbe0890 service neutron] 10.222.0.122 "GET /v2.0/networks/6339c1bc-651f-4152-a569-5ee35d1a9bfe?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1295018
May 25 17:46:55.580335 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-798df5b8-6001-4a1a-b61f-afb61efe9629 req-90be3cd5-471f-4843-a964-4bae7e3e2614 tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] Synchronizing usage tracker for tenant:76807af9dbfd494e8d149bc35c086824 on resource:port {{(pid=99027) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 17:46:55.707750 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-798df5b8-6001-4a1a-b61f-afb61efe9629 req-90be3cd5-471f-4843-a964-4bae7e3e2614 tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] Unset dirty status for tenant:76807af9dbfd494e8d149bc35c086824 on resource:port {{(pid=99027) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 17:46:55.708923 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-798df5b8-6001-4a1a-b61f-afb61efe9629 req-90be3cd5-471f-4843-a964-4bae7e3e2614 tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] 10.222.0.122 "GET /v2.0/ports?device_id=f42e59b6-6f61-498b-bc43-86f6cb777a3e HTTP/1.1" status: 200  len: 210 time: 0.1723721
May 25 17:46:56.762856 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.agents_db [None req-14fae233-15dc-4576-836b-621c5f95b584 None None] Agent healthcheck: found 6 active agents {{(pid=99029) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 17:46:56.864283 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-aaf62649-d20c-45b7-9960-f8132292a323 req-88404817-9ac6-41bc-9024-e53e941d48d6 tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] 10.222.0.122 "GET /v2.0/ports?device_id=f42e59b6-6f61-498b-bc43-86f6cb777a3e HTTP/1.1" status: 200  len: 210 time: 0.0455480
May 25 17:46:57.546505 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78d323dc-4d7b-4101-b810-bf1c04d862a2 req-ff68c347-b2c8-4481-b203-48264e133e06 tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:46:57.548734 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-78d323dc-4d7b-4101-b810-bf1c04d862a2 req-ff68c347-b2c8-4481-b203-48264e133e06 tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] 10.222.0.125 "GET /v2.0/networks?id=6339c1bc-651f-4152-a569-5ee35d1a9bfe HTTP/1.1" status: 200  len: 814 time: 0.1512351
May 25 17:46:57.564686 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.v2.base [req-78d323dc-4d7b-4101-b810-bf1c04d862a2 req-096bbb1a-3995-4635-8e42-939b50fe5fae tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] Request body: {'port': {'device_id': 'f42e59b6-6f61-498b-bc43-86f6cb777a3e', 'network_id': '6339c1bc-651f-4152-a569-5ee35d1a9bfe', 'admin_state_up': True, 'tenant_id': '76807af9dbfd494e8d149bc35c086824'}} {{(pid=99027) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:46:57.776155 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [req-78d323dc-4d7b-4101-b810-bf1c04d862a2 req-096bbb1a-3995-4635-8e42-939b50fe5fae tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:46:57.785780 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [req-78d323dc-4d7b-4101-b810-bf1c04d862a2 req-096bbb1a-3995-4635-8e42-939b50fe5fae tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:46:57.839403 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-78d323dc-4d7b-4101-b810-bf1c04d862a2 req-096bbb1a-3995-4635-8e42-939b50fe5fae tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] Made reservation on behalf of 76807af9dbfd494e8d149bc35c086824 for: {'port': 1} {{(pid=99027) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 17:46:57.843017 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-78d323dc-4d7b-4101-b810-bf1c04d862a2 req-096bbb1a-3995-4635-8e42-939b50fe5fae tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:58.040637 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-57c3103d-03bc-46d2-8186-1397c6963e65 req-8373af1f-7382-49e9-b19e-6d1583dedff7 tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] 10.222.0.122 "GET /v2.0/ports?device_id=f42e59b6-6f61-498b-bc43-86f6cb777a3e HTTP/1.1" status: 200  len: 210 time: 0.0543692
May 25 17:46:58.062222 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.db_base_plugin_common [req-78d323dc-4d7b-4101-b810-bf1c04d862a2 req-096bbb1a-3995-4635-8e42-939b50fe5fae tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] Allocated IP 172.20.0.6 (6339c1bc-651f-4152-a569-5ee35d1a9bfe/1002a83a-fcaf-455e-9402-7a92f32b974e/41c90217-aa85-400d-a252-63cc418f42a9) {{(pid=99027) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 17:46:58.267679 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-78d323dc-4d7b-4101-b810-bf1c04d862a2 req-096bbb1a-3995-4635-8e42-939b50fe5fae tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] Notify callbacks [] for port, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:58.353969 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-78d323dc-4d7b-4101-b810-bf1c04d862a2 req-096bbb1a-3995-4635-8e42-939b50fe5fae tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781840788179', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15468986'] for port, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:58.362337 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:46:58.429051 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-78d323dc-4d7b-4101-b810-bf1c04d862a2 req-096bbb1a-3995-4635-8e42-939b50fe5fae tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] Network 6339c1bc-651f-4152-a569-5ee35d1a9bfe is already hosted by enough agents. {{(pid=99027) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 17:46:58.432361 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.base_scheduler [req-78d323dc-4d7b-4101-b810-bf1c04d862a2 req-096bbb1a-3995-4635-8e42-939b50fe5fae tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] Resources bound (agent type, host, resource id):  {{(pid=99027) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 17:46:58.435971 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.l3_dvrscheduler_db [req-78d323dc-4d7b-4101-b810-bf1c04d862a2 req-096bbb1a-3995-4635-8e42-939b50fe5fae tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] Received port after_create {{(pid=99027) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 17:46:58.480187 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-096bbb1a-3995-4635-8e42-939b50fe5fae tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] Pushing event updated for resources: {'Port': ['ID=41c90217-aa85-400d-a252-63cc418f42a9,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:46:58.488651 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-096bbb1a-3995-4635-8e42-939b50fe5fae tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.129s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:46:58.512555 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78d323dc-4d7b-4101-b810-bf1c04d862a2 req-096bbb1a-3995-4635-8e42-939b50fe5fae tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:46:58.513207 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-78d323dc-4d7b-4101-b810-bf1c04d862a2 req-096bbb1a-3995-4635-8e42-939b50fe5fae tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-239387'] for port, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:58.594919 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-78d323dc-4d7b-4101-b810-bf1c04d862a2 req-096bbb1a-3995-4635-8e42-939b50fe5fae tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] 10.222.0.125 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.0340025
May 25 17:46:58.604565 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.v2.base [req-78d323dc-4d7b-4101-b810-bf1c04d862a2 req-48208825-78cb-4c26-bcb1-acd3c173ba7c service neutron] Request body: {'port': {'device_id': 'f42e59b6-6f61-498b-bc43-86f6cb777a3e', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78956'}} {{(pid=99027) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:46:58.718349 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-78d323dc-4d7b-4101-b810-bf1c04d862a2 req-48208825-78cb-4c26-bcb1-acd3c173ba7c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:59.091994 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.notifiers.nova [req-78d323dc-4d7b-4101-b810-bf1c04d862a2 req-48208825-78cb-4c26-bcb1-acd3c173ba7c service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 41c90217-aa85-400d-a252-63cc418f42a9 {{(pid=99027) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 25 17:46:59.100106 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-78d323dc-4d7b-4101-b810-bf1c04d862a2 req-48208825-78cb-4c26-bcb1-acd3c173ba7c service neutron] Notify callbacks [] for port, precommit_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:59.117714 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.provisioning_blocks [req-78d323dc-4d7b-4101-b810-bf1c04d862a2 req-48208825-78cb-4c26-bcb1-acd3c173ba7c service neutron] Transition to ACTIVE for port object 41c90217-aa85-400d-a252-63cc418f42a9 will not be triggered until provisioned by entity L2. {{(pid=99027) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 17:46:59.188377 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-78d323dc-4d7b-4101-b810-bf1c04d862a2 req-48208825-78cb-4c26-bcb1-acd3c173ba7c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15468979'] for port, after_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:59.196278 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:46:59.246592 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bd768c8-ad1e-4863-b141-f8b552d7a64a req-8f82d9a5-b7aa-4263-bb4a-ce780ee51f9d tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:46:59.246592 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-1bd768c8-ad1e-4863-b141-f8b552d7a64a req-8f82d9a5-b7aa-4263-bb4a-ce780ee51f9d tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] 10.222.0.122 "GET /v2.0/ports?device_id=f42e59b6-6f61-498b-bc43-86f6cb777a3e HTTP/1.1" status: 200  len: 943 time: 0.0926683
May 25 17:46:59.301251 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-1bd768c8-ad1e-4863-b141-f8b552d7a64a req-c5ea97ed-98f5-4994-b609-036288a3d53f tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] 10.222.0.122 "GET /v2.0/security-groups?id=b1cd410a-637d-478e-b9aa-ed7e2ce8bad3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0492835
May 25 17:46:59.362978 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48208825-78cb-4c26-bcb1-acd3c173ba7c service neutron] Pushing event updated for resources: {'Port': ['ID=41c90217-aa85-400d-a252-63cc418f42a9,revision_number=2']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:46:59.365912 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-48208825-78cb-4c26-bcb1-acd3c173ba7c service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.170s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:46:59.441651 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.managers [req-78d323dc-4d7b-4101-b810-bf1c04d862a2 req-48208825-78cb-4c26-bcb1-acd3c173ba7c service neutron] Attempting to bind port 41c90217-aa85-400d-a252-63cc418f42a9 on host hv-cinder-78956 for vnic_type normal with profile  {{(pid=99027) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 17:46:59.441972 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.managers [req-78d323dc-4d7b-4101-b810-bf1c04d862a2 req-48208825-78cb-4c26-bcb1-acd3c173ba7c service neutron] Attempting to bind port 41c90217-aa85-400d-a252-63cc418f42a9 by drivers openvswitch,hyperv on host hv-cinder-78956 at level 0 using segments [{'id': '31f775e4-1843-4e6f-aa8f-371e25229749', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1345, 'network_id': '6339c1bc-651f-4152-a569-5ee35d1a9bfe'}] {{(pid=99027) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 17:46:59.442686 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-78d323dc-4d7b-4101-b810-bf1c04d862a2 req-48208825-78cb-4c26-bcb1-acd3c173ba7c service neutron] Attempting to bind port 41c90217-aa85-400d-a252-63cc418f42a9 on network 6339c1bc-651f-4152-a569-5ee35d1a9bfe {{(pid=99027) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 17:46:59.446922 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-78d323dc-4d7b-4101-b810-bf1c04d862a2 req-48208825-78cb-4c26-bcb1-acd3c173ba7c service neutron] Port 41c90217-aa85-400d-a252-63cc418f42a9 on network 6339c1bc-651f-4152-a569-5ee35d1a9bfe not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78956 {{(pid=99027) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 25 17:46:59.447341 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-78d323dc-4d7b-4101-b810-bf1c04d862a2 req-48208825-78cb-4c26-bcb1-acd3c173ba7c service neutron] Attempting to bind port 41c90217-aa85-400d-a252-63cc418f42a9 on network 6339c1bc-651f-4152-a569-5ee35d1a9bfe {{(pid=99027) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 17:46:59.452654 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-78d323dc-4d7b-4101-b810-bf1c04d862a2 req-48208825-78cb-4c26-bcb1-acd3c173ba7c service neutron] Checking agent: {'id': '4d02a528-6a0e-4977-985f-4bcff1ca6cb7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78956', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 17, 40, 41), 'started_at': datetime.datetime(2021, 5, 25, 17, 40, 41), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 17, 46, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=99027) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 17:46:59.452976 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-78d323dc-4d7b-4101-b810-bf1c04d862a2 req-48208825-78cb-4c26-bcb1-acd3c173ba7c service neutron] Checking segment: {'id': '31f775e4-1843-4e6f-aa8f-371e25229749', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1345, 'network_id': '6339c1bc-651f-4152-a569-5ee35d1a9bfe'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=99027) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 17:46:59.453411 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-78d323dc-4d7b-4101-b810-bf1c04d862a2 req-48208825-78cb-4c26-bcb1-acd3c173ba7c service neutron] Bound using segment: {'id': '31f775e4-1843-4e6f-aa8f-371e25229749', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1345, 'network_id': '6339c1bc-651f-4152-a569-5ee35d1a9bfe'} {{(pid=99027) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 17:46:59.453832 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.managers [req-78d323dc-4d7b-4101-b810-bf1c04d862a2 req-48208825-78cb-4c26-bcb1-acd3c173ba7c service neutron] Bound port: 41c90217-aa85-400d-a252-63cc418f42a9, host: hv-cinder-78956, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '31f775e4-1843-4e6f-aa8f-371e25229749', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1345, 'network_id': '6339c1bc-651f-4152-a569-5ee35d1a9bfe'}}] {{(pid=99027) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 17:46:59.454174 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-78d323dc-4d7b-4101-b810-bf1c04d862a2 req-48208825-78cb-4c26-bcb1-acd3c173ba7c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:59.548188 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.db [req-78d323dc-4d7b-4101-b810-bf1c04d862a2 req-48208825-78cb-4c26-bcb1-acd3c173ba7c service neutron] For port 41c90217-aa85-400d-a252-63cc418f42a9, host hv-cinder-78956, cleared binding levels {{(pid=99027) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 17:46:59.552061 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.db [req-78d323dc-4d7b-4101-b810-bf1c04d862a2 req-48208825-78cb-4c26-bcb1-acd3c173ba7c service neutron] For port 41c90217-aa85-400d-a252-63cc418f42a9, host hv-cinder-78956, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=41c90217-aa85-400d-a252-63cc418f42a9,segment=NetworkSegment(31f775e4-1843-4e6f-aa8f-371e25229749),segment_id=31f775e4-1843-4e6f-aa8f-371e25229749)] {{(pid=99027) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 17:46:59.703064 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-78d323dc-4d7b-4101-b810-bf1c04d862a2 req-48208825-78cb-4c26-bcb1-acd3c173ba7c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15468979'] for port, after_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:59.710180 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:46:59.772669 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78d323dc-4d7b-4101-b810-bf1c04d862a2 req-48208825-78cb-4c26-bcb1-acd3c173ba7c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:46:59.773648 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-78d323dc-4d7b-4101-b810-bf1c04d862a2 req-48208825-78cb-4c26-bcb1-acd3c173ba7c service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-239387'] for port, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:46:59.774714 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-78d323dc-4d7b-4101-b810-bf1c04d862a2 req-48208825-78cb-4c26-bcb1-acd3c173ba7c service neutron] 10.222.0.125 "PUT /v2.0/ports/41c90217-aa85-400d-a252-63cc418f42a9 HTTP/1.1" status: 200  len: 1093 time: 1.1742880
May 25 17:46:59.777348 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f42e59b6-6f61-498b-bc43-86f6cb777a3e', 'tag': '41c90217-aa85-400d-a252-63cc418f42a9'}] {{(pid=99027) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 17:46:59.808655 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48208825-78cb-4c26-bcb1-acd3c173ba7c service neutron] Pushing event updated for resources: {'Port': ['ID=41c90217-aa85-400d-a252-63cc418f42a9,revision_number=3']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:46:59.811810 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-48208825-78cb-4c26-bcb1-acd3c173ba7c service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.104s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:46:59.830739 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f42e59b6-6f61-498b-bc43-86f6cb777a3e', 'tag': '41c90217-aa85-400d-a252-63cc418f42a9', 'status': 'completed', 'code': 200}
May 25 17:46:59.931281 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e55af52-dcd8-485e-8062-65b644cc4012 req-d1072391-00cd-4849-8664-13e188eff4b9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:46:59.932793 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-2e55af52-dcd8-485e-8062-65b644cc4012 req-d1072391-00cd-4849-8664-13e188eff4b9 service neutron] 10.222.0.125 "GET /v2.0/ports?tenant_id=76807af9dbfd494e8d149bc35c086824&device_id=f42e59b6-6f61-498b-bc43-86f6cb777a3e HTTP/1.1" status: 200  len: 1096 time: 0.0772133
May 25 17:47:00.165181 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e55af52-dcd8-485e-8062-65b644cc4012 req-d6f30ff0-bf65-4d8c-a2d8-c9354d3646d6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:47:00.166632 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-2e55af52-dcd8-485e-8062-65b644cc4012 req-d6f30ff0-bf65-4d8c-a2d8-c9354d3646d6 service neutron] 10.222.0.125 "GET /v2.0/networks?tenant_id=76807af9dbfd494e8d149bc35c086824&shared=False HTTP/1.1" status: 200  len: 916 time: 0.2249937
May 25 17:47:00.316450 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e55af52-dcd8-485e-8062-65b644cc4012 req-d3c34dfa-3f71-48d9-afce-44a75cf18f16 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:47:00.317962 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-2e55af52-dcd8-485e-8062-65b644cc4012 req-d3c34dfa-3f71-48d9-afce-44a75cf18f16 service neutron] 10.222.0.125 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 871 time: 0.1425667
May 25 17:47:00.362767 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 47038) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:47:00.427790 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78d323dc-4d7b-4101-b810-bf1c04d862a2 req-337c89e0-3e37-4d76-98ec-0b3308590f50 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:47:00.429343 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-78d323dc-4d7b-4101-b810-bf1c04d862a2 req-337c89e0-3e37-4d76-98ec-0b3308590f50 service neutron] 10.222.0.125 "GET /v2.0/ports?tenant_id=76807af9dbfd494e8d149bc35c086824&device_id=f42e59b6-6f61-498b-bc43-86f6cb777a3e HTTP/1.1" status: 200  len: 1096 time: 0.0719700
May 25 17:47:00.496745 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-5166ae01-8b24-4c7c-90b0-f2a8d5f75247 admin admin] Notify callbacks [] for security_group, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:00.505797 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-78d323dc-4d7b-4101-b810-bf1c04d862a2 req-2b302b9e-e006-4704-8e36-c2ab596d9dee service neutron] 10.222.0.125 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=41c90217-aa85-400d-a252-63cc418f42a9 HTTP/1.1" status: 200  len: 217 time: 0.0665407
May 25 17:47:00.517890 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-5166ae01-8b24-4c7c-90b0-f2a8d5f75247 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:47:00.523119 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-5166ae01-8b24-4c7c-90b0-f2a8d5f75247 admin admin] Usage tracker for resource:security_group_rule and tenant:c9d4e587bdbd49f7857acf495be97f73 is out of sync, need to count used quota {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:47:00.527176 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-5166ae01-8b24-4c7c-90b0-f2a8d5f75247 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:47:00.535357 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-5166ae01-8b24-4c7c-90b0-f2a8d5f75247 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:47:00.554241 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5dd8c299-b711-4412-8ab8-a7275eb83c9d req-d216c17b-bcdc-4825-8527-8ba253d0423a tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:47:00.555764 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-5dd8c299-b711-4412-8ab8-a7275eb83c9d req-d216c17b-bcdc-4825-8527-8ba253d0423a tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] 10.222.0.122 "GET /v2.0/ports?device_id=f42e59b6-6f61-498b-bc43-86f6cb777a3e HTTP/1.1" status: 200  len: 943 time: 0.1316206
May 25 17:47:00.576554 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78d323dc-4d7b-4101-b810-bf1c04d862a2 req-33b032b4-1d77-4fd4-b868-ce8490b68009 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:47:00.578018 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-78d323dc-4d7b-4101-b810-bf1c04d862a2 req-33b032b4-1d77-4fd4-b868-ce8490b68009 service neutron] 10.222.0.125 "GET /v2.0/subnets?id=1002a83a-fcaf-455e-9402-7a92f32b974e HTTP/1.1" status: 200  len: 854 time: 0.0641961
May 25 17:47:00.626661 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-5dd8c299-b711-4412-8ab8-a7275eb83c9d req-a5e0ce7e-0dfd-49a6-9d92-ff0a003191c8 tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] 10.222.0.122 "GET /v2.0/security-groups?id=b1cd410a-637d-478e-b9aa-ed7e2ce8bad3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0599897
May 25 17:47:00.629702 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-78d323dc-4d7b-4101-b810-bf1c04d862a2 req-8068e6f2-66d8-4550-9f3c-d10bae740916 service neutron] 10.222.0.125 "GET /v2.0/ports?network_id=6339c1bc-651f-4152-a569-5ee35d1a9bfe&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0422466
May 25 17:47:00.685703 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-5166ae01-8b24-4c7c-90b0-f2a8d5f75247 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:00.736669 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-5166ae01-8b24-4c7c-90b0-f2a8d5f75247 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:00.745786 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-dfee87f0-3a76-4722-89a8-c9bd9c769ba2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:47:00.785446 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-78d323dc-4d7b-4101-b810-bf1c04d862a2 req-22ea50d0-a3c0-45c6-a39b-734daa1c0750 service neutron] 10.222.0.125 "GET /v2.0/networks/6339c1bc-651f-4152-a569-5ee35d1a9bfe?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1471219
May 25 17:47:00.787768 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-5166ae01-8b24-4c7c-90b0-f2a8d5f75247 admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=c9d4e587bdbd49f7857acf495be97f73&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4232950
May 25 17:47:00.789511 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5166ae01-8b24-4c7c-90b0-f2a8d5f75247 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9361bd78-6deb-4d4a-b9f8-8463fec54679,revision_number=1']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:47:00.790427 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 47048) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:47:00.792646 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-5166ae01-8b24-4c7c-90b0-f2a8d5f75247 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:47:00.950485 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-381e122d-dc7d-4e08-9b8c-64ce16f857f8 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:00.976000 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-78d323dc-4d7b-4101-b810-bf1c04d862a2 req-a14b36c2-029c-420e-bdd1-488f089baff0 service neutron] 10.222.0.125 "GET /v2.0/networks/6339c1bc-651f-4152-a569-5ee35d1a9bfe?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1733639
May 25 17:47:00.991692 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-381e122d-dc7d-4e08-9b8c-64ce16f857f8 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:01.125784 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-381e122d-dc7d-4e08-9b8c-64ce16f857f8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:01.129472 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-f1d46075-d6eb-433a-b54a-c489ab077da6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:47:01.140998 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-381e122d-dc7d-4e08-9b8c-64ce16f857f8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9361bd78-6deb-4d4a-b9f8-8463fec54679,revision_number=None']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:47:01.144576 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-381e122d-dc7d-4e08-9b8c-64ce16f857f8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:47:01.147863 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-381e122d-dc7d-4e08-9b8c-64ce16f857f8 admin admin] Notify callbacks [] for security_group, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:01.148956 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-381e122d-dc7d-4e08-9b8c-64ce16f857f8 admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/9361bd78-6deb-4d4a-b9f8-8463fec54679 HTTP/1.1" status: 204  len: 168 time: 0.3576119
May 25 17:47:01.720184 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 47060) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:47:01.741764 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-df8e975e-f8f2-458a-b1b7-a0abcef1c08e admin admin] Notify callbacks [] for security_group, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:01.801404 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-df8e975e-f8f2-458a-b1b7-a0abcef1c08e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:47:01.807681 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-df8e975e-f8f2-458a-b1b7-a0abcef1c08e admin admin] Usage tracker for resource:security_group_rule and tenant:e80b8c75875e4fcb822b004d1266290a is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:47:01.813228 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-df8e975e-f8f2-458a-b1b7-a0abcef1c08e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:47:01.820191 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-df8e975e-f8f2-458a-b1b7-a0abcef1c08e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:47:01.870218 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53906008-52c3-401d-bcb1-585be50f0514 req-bf10c228-64d7-43bf-b3c1-61d0821689ba tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:47:01.870826 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-53906008-52c3-401d-bcb1-585be50f0514 req-bf10c228-64d7-43bf-b3c1-61d0821689ba tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] Synchronizing usage tracker for tenant:76807af9dbfd494e8d149bc35c086824 on resource:port {{(pid=99027) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 17:47:01.939343 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-df8e975e-f8f2-458a-b1b7-a0abcef1c08e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:01.954255 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-53906008-52c3-401d-bcb1-585be50f0514 req-bf10c228-64d7-43bf-b3c1-61d0821689ba tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] Unset dirty status for tenant:76807af9dbfd494e8d149bc35c086824 on resource:port {{(pid=99027) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 17:47:01.955745 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-53906008-52c3-401d-bcb1-585be50f0514 req-bf10c228-64d7-43bf-b3c1-61d0821689ba tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] 10.222.0.122 "GET /v2.0/ports?device_id=f42e59b6-6f61-498b-bc43-86f6cb777a3e HTTP/1.1" status: 200  len: 943 time: 0.2041736
May 25 17:47:02.001476 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-df8e975e-f8f2-458a-b1b7-a0abcef1c08e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:02.010208 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-563c19a0-57b4-47c5-a382-816ae9d1537b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:47:02.030086 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-53906008-52c3-401d-bcb1-585be50f0514 req-8176f2a8-6c17-4a29-8521-2fee0bd03bca tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] 10.222.0.122 "GET /v2.0/security-groups?id=b1cd410a-637d-478e-b9aa-ed7e2ce8bad3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0682378
May 25 17:47:02.059540 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df8e975e-f8f2-458a-b1b7-a0abcef1c08e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1ac4f0f8-642a-422c-8066-0e8c631620d2,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:47:02.063536 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-df8e975e-f8f2-458a-b1b7-a0abcef1c08e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:47:02.065871 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-df8e975e-f8f2-458a-b1b7-a0abcef1c08e admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=e80b8c75875e4fcb822b004d1266290a&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3446887
May 25 17:47:02.068620 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 47068) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:47:02.128224 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-68e70c68-a71a-4802-856b-306baa4fabe2 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:02.156866 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-68e70c68-a71a-4802-856b-306baa4fabe2 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:02.285179 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-68e70c68-a71a-4802-856b-306baa4fabe2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:02.289028 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-63e70610-14b4-48dc-bdc6-25ee858935bc admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:47:02.304184 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68e70c68-a71a-4802-856b-306baa4fabe2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1ac4f0f8-642a-422c-8066-0e8c631620d2,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:47:02.306799 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-68e70c68-a71a-4802-856b-306baa4fabe2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:47:02.317608 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-68e70c68-a71a-4802-856b-306baa4fabe2 admin admin] Notify callbacks [] for security_group, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:02.318734 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-68e70c68-a71a-4802-856b-306baa4fabe2 admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/1ac4f0f8-642a-422c-8066-0e8c631620d2 HTTP/1.1" status: 204  len: 168 time: 0.2490857
May 25 17:47:03.007746 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 47078) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:47:03.027034 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-5962a20f-57ef-499d-99a3-8efff7ca3ae0 admin admin] Notify callbacks [] for security_group, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:03.044556 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-5962a20f-57ef-499d-99a3-8efff7ca3ae0 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:47:03.046179 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-5962a20f-57ef-499d-99a3-8efff7ca3ae0 admin admin] Usage tracker for resource:security_group_rule and tenant:8c87a94e12c048f3990049c219a9ae9e is out of sync, need to count used quota {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:47:03.049118 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-5962a20f-57ef-499d-99a3-8efff7ca3ae0 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:47:03.054903 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-5962a20f-57ef-499d-99a3-8efff7ca3ae0 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:47:03.146703 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-5962a20f-57ef-499d-99a3-8efff7ca3ae0 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:03.207428 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-5962a20f-57ef-499d-99a3-8efff7ca3ae0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:03.215997 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-279d5dc1-72ea-4393-9091-82fa985dead3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:47:03.262627 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-5962a20f-57ef-499d-99a3-8efff7ca3ae0 admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=8c87a94e12c048f3990049c219a9ae9e&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2538137
May 25 17:47:03.264148 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5962a20f-57ef-499d-99a3-8efff7ca3ae0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e9d004b9-2ec9-46b2-bc9c-8a04a59aa3d7,revision_number=1']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:47:03.265322 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 47086) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:47:03.268209 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-5962a20f-57ef-499d-99a3-8efff7ca3ae0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:47:03.283242 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff8cd55a-528b-4ffb-a7c4-63788e0a5e7e req-6d23cd92-48e4-426c-b4b8-7078211a02bc tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:47:03.284757 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-ff8cd55a-528b-4ffb-a7c4-63788e0a5e7e req-6d23cd92-48e4-426c-b4b8-7078211a02bc tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] 10.222.0.122 "GET /v2.0/ports?device_id=f42e59b6-6f61-498b-bc43-86f6cb777a3e HTTP/1.1" status: 200  len: 943 time: 0.1407249
May 25 17:47:03.330110 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-c5c95fb7-e8b8-4c6b-900f-7ac269a411f4 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:03.335160 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-ff8cd55a-528b-4ffb-a7c4-63788e0a5e7e req-81d77bbc-6c85-4871-b664-6eb56a23eb73 tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] 10.222.0.122 "GET /v2.0/security-groups?id=b1cd410a-637d-478e-b9aa-ed7e2ce8bad3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0446165
May 25 17:47:03.356363 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Device 41c90217-aa85-400d-a252-63cc418f42a9 details requested by agent hyperv_hv-cinder-78956 with host hv-cinder-78956 {{(pid=99028) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 25 17:47:03.356900 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-c5c95fb7-e8b8-4c6b-900f-7ac269a411f4 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:03.462029 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-c5c95fb7-e8b8-4c6b-900f-7ac269a411f4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:03.465868 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-fc127a89-0913-4c36-b151-d39e9f255219 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:47:03.479899 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5c95fb7-e8b8-4c6b-900f-7ac269a411f4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e9d004b9-2ec9-46b2-bc9c-8a04a59aa3d7,revision_number=None']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:47:03.485438 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-c5c95fb7-e8b8-4c6b-900f-7ac269a411f4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:47:03.489644 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-c5c95fb7-e8b8-4c6b-900f-7ac269a411f4 admin admin] Notify callbacks [] for security_group, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:03.490626 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] For port 41c90217-aa85-400d-a252-63cc418f42a9, host hv-cinder-78956, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=41c90217-aa85-400d-a252-63cc418f42a9,segment=NetworkSegment(31f775e4-1843-4e6f-aa8f-371e25229749),segment_id=31f775e4-1843-4e6f-aa8f-371e25229749)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:47:03.490778 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-c5c95fb7-e8b8-4c6b-900f-7ac269a411f4 admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/e9d004b9-2ec9-46b2-bc9c-8a04a59aa3d7 HTTP/1.1" status: 204  len: 168 time: 0.2236998
May 25 17:47:03.517992 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Returning: {'device': '41c90217-aa85-400d-a252-63cc418f42a9', 'network_id': '6339c1bc-651f-4152-a569-5ee35d1a9bfe', 'port_id': '41c90217-aa85-400d-a252-63cc418f42a9', 'mac_address': 'fa:16:3e:35:2a:15', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1345, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '1002a83a-fcaf-455e-9402-7a92f32b974e', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=99028) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 25 17:47:03.573597 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:03.591414 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.notifiers.nova [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 41c90217-aa85-400d-a252-63cc418f42a9 {{(pid=99028) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 25 17:47:03.607806 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] For port 41c90217-aa85-400d-a252-63cc418f42a9, host hv-cinder-78956, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=41c90217-aa85-400d-a252-63cc418f42a9,segment=NetworkSegment(31f775e4-1843-4e6f-aa8f-371e25229749),segment_id=31f775e4-1843-4e6f-aa8f-371e25229749)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:47:03.656885 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:03.659765 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:47:03.725382 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Pushing event updated for resources: {'Port': ['ID=41c90217-aa85-400d-a252-63cc418f42a9,revision_number=4']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:47:03.734061 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:47:03.734410 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:47:03.735262 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:47:03.735633 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:47:03.736005 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:47:03.736336 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:47:03.736662 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:47:03.736989 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:47:03.737360 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:47:03.737686 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:47:03.738006 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:47:03.738342 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:47:03.742189 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:47:03.913909 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] get_ports_and_sgs() called for port_ids ['41c90217-aa85-400d-a252-63cc418f42a9'] {{(pid=99028) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 25 17:47:04.528391 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-351d95a1-655d-4bbb-9f23-91a372685c77 req-d1cab6f4-7583-49af-be1e-30e8044ab40b tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:47:04.529974 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-351d95a1-655d-4bbb-9f23-91a372685c77 req-d1cab6f4-7583-49af-be1e-30e8044ab40b tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] 10.222.0.122 "GET /v2.0/ports?device_id=f42e59b6-6f61-498b-bc43-86f6cb777a3e HTTP/1.1" status: 200  len: 944 time: 0.0840952
May 25 17:47:04.574455 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-351d95a1-655d-4bbb-9f23-91a372685c77 req-ee279b3f-6c50-4fe6-a310-997d16010bcb tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] 10.222.0.122 "GET /v2.0/security-groups?id=b1cd410a-637d-478e-b9aa-ed7e2ce8bad3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0380914
May 25 17:47:04.587498 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 47116) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:47:04.695073 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.v2.base [None req-29159b5c-3599-4493-b465-bbf36028fd93 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-821368570-network', 'tenant_id': '31575405cf7140c6a5448a30f1589a45'}} {{(pid=99027) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:47:04.699720 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-29159b5c-3599-4493-b465-bbf36028fd93 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:47:04.704157 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-29159b5c-3599-4493-b465-bbf36028fd93 admin admin] Usage tracker for resource:network and tenant:31575405cf7140c6a5448a30f1589a45 is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:47:04.707163 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-29159b5c-3599-4493-b465-bbf36028fd93 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:47:04.713122 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-29159b5c-3599-4493-b465-bbf36028fd93 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:47:04.787467 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-29159b5c-3599-4493-b465-bbf36028fd93 admin admin] Made reservation on behalf of 31575405cf7140c6a5448a30f1589a45 for: {'network': 1} {{(pid=99027) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 17:47:04.789823 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-29159b5c-3599-4493-b465-bbf36028fd93 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-1465344'] for network, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:04.801837 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-29159b5c-3599-4493-b465-bbf36028fd93 admin admin] Notify callbacks [] for security_group, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:04.816505 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-29159b5c-3599-4493-b465-bbf36028fd93 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:47:04.820315 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-29159b5c-3599-4493-b465-bbf36028fd93 admin admin] Usage tracker for resource:security_group_rule and tenant:31575405cf7140c6a5448a30f1589a45 is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:47:04.823121 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-29159b5c-3599-4493-b465-bbf36028fd93 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:47:04.829684 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-29159b5c-3599-4493-b465-bbf36028fd93 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:47:04.909253 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-29159b5c-3599-4493-b465-bbf36028fd93 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:04.958976 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-29159b5c-3599-4493-b465-bbf36028fd93 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:04.961930 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-59e6551a-fa2d-4cc0-a817-9ccf8ec28ec3 tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:47:04.987532 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-29159b5c-3599-4493-b465-bbf36028fd93 admin admin] vlan segment allocate from pool success with {'vlan_id': 1329, 'physical_network': 'physnet1'}  {{(pid=99027) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 25 17:47:05.000800 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29159b5c-3599-4493-b465-bbf36028fd93 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=73fbb4e5-9a45-4cd0-99f5-59c192121e24,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:47:05.004637 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-29159b5c-3599-4493-b465-bbf36028fd93 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:47:05.005544 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-29159b5c-3599-4493-b465-bbf36028fd93 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1469168'] for segment, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:05.005870 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.db.segments_db [None req-29159b5c-3599-4493-b465-bbf36028fd93 admin admin] Added segment 1323aad8-d1c9-4bd0-8e4a-61e81873fe6a of type vlan for network 52b8fb59-59b6-417c-8c39-5c86fec7b69f
May 25 17:47:05.030506 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-29159b5c-3599-4493-b465-bbf36028fd93 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8781840806997'] for network, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:05.102379 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-29159b5c-3599-4493-b465-bbf36028fd93 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-459299', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551400'] for network, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:05.103701 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-29159b5c-3599-4493-b465-bbf36028fd93 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:47:05.104286 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-29159b5c-3599-4493-b465-bbf36028fd93 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for network, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:05.107789 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:47:05.210183 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29159b5c-3599-4493-b465-bbf36028fd93 admin admin] Pushing event updated for resources: {'Network': ['ID=52b8fb59-59b6-417c-8c39-5c86fec7b69f,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:47:05.212807 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-29159b5c-3599-4493-b465-bbf36028fd93 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.105s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:47:05.220304 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Network 52b8fb59-59b6-417c-8c39-5c86fec7b69f details requested by agent ovs-agent-dv-cinder-789564-2-iscsi with host dv-cinder-789564-2-iscsi {{(pid=99028) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 25 17:47:05.282684 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-29159b5c-3599-4493-b465-bbf36028fd93 admin admin] 10.222.0.122 "POST /v2.0/networks HTTP/1.1" status: 201  len: 882 time: 0.6914127
May 25 17:47:05.282953 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 47124) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:47:05.288753 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.v2.base [None req-a7abc5b9-d0c4-4b12-93d8-0c402f30c5ac admin admin] Request body: {'subnet': {'network_id': '52b8fb59-59b6-417c-8c39-5c86fec7b69f', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-821368570-subnet', 'tenant_id': '31575405cf7140c6a5448a30f1589a45', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=99027) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:47:05.304756 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-a7abc5b9-d0c4-4b12-93d8-0c402f30c5ac admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:47:05.311824 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-a7abc5b9-d0c4-4b12-93d8-0c402f30c5ac admin admin] Usage tracker for resource:subnet and tenant:31575405cf7140c6a5448a30f1589a45 is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:47:05.319617 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-a7abc5b9-d0c4-4b12-93d8-0c402f30c5ac admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:47:05.327355 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-a7abc5b9-d0c4-4b12-93d8-0c402f30c5ac admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:47:05.360345 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Device 41c90217-aa85-400d-a252-63cc418f42a9 up at agent hyperv_hv-cinder-78956 {{(pid=99028) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 17:47:05.427573 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a7abc5b9-d0c4-4b12-93d8-0c402f30c5ac admin admin] Made reservation on behalf of 31575405cf7140c6a5448a30f1589a45 for: {'subnet': 1} {{(pid=99027) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 17:47:05.429973 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-a7abc5b9-d0c4-4b12-93d8-0c402f30c5ac admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-14778112'] for subnet, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:05.519094 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Provisioning for port 41c90217-aa85-400d-a252-63cc418f42a9 completed by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 17:47:05.525208 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Provisioning complete for port 41c90217-aa85-400d-a252-63cc418f42a9 triggered by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 17:47:05.525860 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:05.646838 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:05.687963 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f42e59b6-6f61-498b-bc43-86f6cb777a3e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '41c90217-aa85-400d-a252-63cc418f42a9'}] {{(pid=99028) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 17:47:05.699047 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] For port 41c90217-aa85-400d-a252-63cc418f42a9, host hv-cinder-78956, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=41c90217-aa85-400d-a252-63cc418f42a9,segment=NetworkSegment(31f775e4-1843-4e6f-aa8f-371e25229749),segment_id=31f775e4-1843-4e6f-aa8f-371e25229749)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:47:05.740239 dv-cinder-789564-2-iscsi neutron-server[99028]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f42e59b6-6f61-498b-bc43-86f6cb777a3e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '41c90217-aa85-400d-a252-63cc418f42a9', 'code': 200}
May 25 17:47:05.764948 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:05.768299 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:47:05.786009 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-756e4a5c-0a22-440c-a5fa-6d18dd65c868 req-7b88b8d0-7542-4f36-ab08-e3c238ba68cd tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:47:05.787483 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-756e4a5c-0a22-440c-a5fa-6d18dd65c868 req-7b88b8d0-7542-4f36-ab08-e3c238ba68cd tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] 10.222.0.122 "GET /v2.0/ports?device_id=f42e59b6-6f61-498b-bc43-86f6cb777a3e HTTP/1.1" status: 200  len: 944 time: 0.0891752
May 25 17:47:05.845380 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Pushing event updated for resources: {'Port': ['ID=41c90217-aa85-400d-a252-63cc418f42a9,revision_number=5']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:47:05.849156 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:47:05.863202 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-756e4a5c-0a22-440c-a5fa-6d18dd65c868 req-18071102-e105-4079-b29c-3acc6b3be435 tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] 10.222.0.122 "GET /v2.0/security-groups?id=b1cd410a-637d-478e-b9aa-ed7e2ce8bad3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0635777
May 25 17:47:06.006435 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-a7abc5b9-d0c4-4b12-93d8-0c402f30c5ac admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114466', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-15467018', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-14778134'] for subnet, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:06.011222 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:47:06.132218 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7abc5b9-d0c4-4b12-93d8-0c402f30c5ac admin admin] Pushing event updated for resources: {'Subnet': ['ID=a952a599-bb09-498d-a5d6-c6b017435958,revision_number=0']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:47:06.140356 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-a7abc5b9-d0c4-4b12-93d8-0c402f30c5ac admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.129s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:47:06.144069 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a7abc5b9-d0c4-4b12-93d8-0c402f30c5ac admin admin] Checking segment: {'id': '1323aad8-d1c9-4bd0-8e4a-61e81873fe6a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1329, 'network_id': '52b8fb59-59b6-417c-8c39-5c86fec7b69f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=99027) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 17:47:06.144417 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a7abc5b9-d0c4-4b12-93d8-0c402f30c5ac admin admin] Network hostable DHCP agents. Network: 52b8fb59-59b6-417c-8c39-5c86fec7b69f, hostable agents: ['c8b0a350-254b-4562-874b-120ecdef0e25'], hosted agents: [] {{(pid=99027) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 25 17:47:06.170233 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afb533d8-5bec-4ed2-b9a4-8cd428aa33f9 req-951f477f-fe6a-4ff0-9976-22a7fbb2166c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:47:06.171708 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-afb533d8-5bec-4ed2-b9a4-8cd428aa33f9 req-951f477f-fe6a-4ff0-9976-22a7fbb2166c service neutron] 10.222.0.125 "GET /v2.0/ports?device_id=f42e59b6-6f61-498b-bc43-86f6cb777a3e HTTP/1.1" status: 200  len: 1098 time: 0.1354396
May 25 17:47:06.214660 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-afb533d8-5bec-4ed2-b9a4-8cd428aa33f9 req-2f38dc70-15bf-4866-8a5d-6223f36ef1b4 service neutron] 10.222.0.125 "GET /v2.0/security-groups?id=b1cd410a-637d-478e-b9aa-ed7e2ce8bad3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0350220
May 25 17:47:06.227358 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a7abc5b9-d0c4-4b12-93d8-0c402f30c5ac admin admin] Network 52b8fb59-59b6-417c-8c39-5c86fec7b69f is scheduled to be hosted by DHCP agent c8b0a350-254b-4562-874b-120ecdef0e25 with binding_index 1 {{(pid=99027) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 25 17:47:06.297127 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.base_scheduler [None req-a7abc5b9-d0c4-4b12-93d8-0c402f30c5ac admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-789564-2-iscsi, 52b8fb59-59b6-417c-8c39-5c86fec7b69f) {{(pid=99027) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 17:47:06.312182 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a7abc5b9-d0c4-4b12-93d8-0c402f30c5ac admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:47:06.313302 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-a7abc5b9-d0c4-4b12-93d8-0c402f30c5ac admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for subnet, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:06.320734 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1665214f-cb9e-4111-93fa-581540e3636d None None] Network 52b8fb59-59b6-417c-8c39-5c86fec7b69f requested from dv-cinder-789564-2-iscsi {{(pid=99028) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 17:47:06.438545 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-a7abc5b9-d0c4-4b12-93d8-0c402f30c5ac admin admin] 10.222.0.122 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 845 time: 1.1538253
May 25 17:47:06.535819 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8e00f535-8b9b-4ec1-8d4b-4ba00c3bbf7d None None] Network 52b8fb59-59b6-417c-8c39-5c86fec7b69f requested from dv-cinder-789564-2-iscsi {{(pid=99028) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 17:47:07.066661 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72132c3a-04fe-490b-a077-91b0ea1be447 req-a05d2d30-afc8-41e0-aaf2-c54a0ec864c3 tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:47:07.068099 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-72132c3a-04fe-490b-a077-91b0ea1be447 req-a05d2d30-afc8-41e0-aaf2-c54a0ec864c3 tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] 10.222.0.122 "GET /v2.0/ports?device_id=f42e59b6-6f61-498b-bc43-86f6cb777a3e HTTP/1.1" status: 200  len: 945 time: 0.0883732
May 25 17:47:07.118242 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-72132c3a-04fe-490b-a077-91b0ea1be447 req-af0b6342-12b4-4f75-8165-3b09370538e7 tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] 10.222.0.122 "GET /v2.0/security-groups?id=b1cd410a-637d-478e-b9aa-ed7e2ce8bad3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0440931
May 25 17:47:07.216840 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 47154) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:47:07.223174 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.v2.base [None req-01a27391-d495-4089-af3c-0b785c8e2da4 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-1073339046-network', 'tenant_id': '8c9122250a6446f38aeee09e6f53b953'}} {{(pid=99027) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:47:07.227918 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-01a27391-d495-4089-af3c-0b785c8e2da4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:47:07.234179 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-01a27391-d495-4089-af3c-0b785c8e2da4 admin admin] Usage tracker for resource:network and tenant:8c9122250a6446f38aeee09e6f53b953 is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:47:07.235182 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-01a27391-d495-4089-af3c-0b785c8e2da4 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:47:07.243704 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-01a27391-d495-4089-af3c-0b785c8e2da4 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:47:07.331389 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-01a27391-d495-4089-af3c-0b785c8e2da4 admin admin] Made reservation on behalf of 8c9122250a6446f38aeee09e6f53b953 for: {'network': 1} {{(pid=99027) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 17:47:07.333714 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-01a27391-d495-4089-af3c-0b785c8e2da4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-1465344'] for network, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:07.346751 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-01a27391-d495-4089-af3c-0b785c8e2da4 admin admin] Notify callbacks [] for security_group, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:07.361801 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-01a27391-d495-4089-af3c-0b785c8e2da4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:47:07.365564 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-01a27391-d495-4089-af3c-0b785c8e2da4 admin admin] Usage tracker for resource:security_group_rule and tenant:8c9122250a6446f38aeee09e6f53b953 is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:47:07.368317 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-01a27391-d495-4089-af3c-0b785c8e2da4 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:47:07.374222 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-01a27391-d495-4089-af3c-0b785c8e2da4 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:47:07.453097 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-01a27391-d495-4089-af3c-0b785c8e2da4 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:07.536440 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-01a27391-d495-4089-af3c-0b785c8e2da4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:07.541351 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-d0c7e7a2-5e03-42ba-abbc-702df09c7632 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:47:07.564908 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-01a27391-d495-4089-af3c-0b785c8e2da4 admin admin] vlan segment allocate from pool success with {'vlan_id': 1326, 'physical_network': 'physnet1'}  {{(pid=99027) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 25 17:47:07.580702 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01a27391-d495-4089-af3c-0b785c8e2da4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=207798af-6946-4aa9-91e8-ac4a9e3952fe,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:47:07.584677 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-01a27391-d495-4089-af3c-0b785c8e2da4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:47:07.586113 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-01a27391-d495-4089-af3c-0b785c8e2da4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1469168'] for segment, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:07.586113 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.db.segments_db [None req-01a27391-d495-4089-af3c-0b785c8e2da4 admin admin] Added segment 924d9acf-d84c-4582-ba11-75b3df5c20c4 of type vlan for network f135fb7d-d2ad-4be7-86c8-ce349d202985
May 25 17:47:07.612868 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-01a27391-d495-4089-af3c-0b785c8e2da4 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8781840806997'] for network, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:07.690280 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-01a27391-d495-4089-af3c-0b785c8e2da4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-459299', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551400'] for network, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:07.691572 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-01a27391-d495-4089-af3c-0b785c8e2da4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:47:07.692170 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-01a27391-d495-4089-af3c-0b785c8e2da4 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for network, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:07.695429 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:47:07.794438 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01a27391-d495-4089-af3c-0b785c8e2da4 admin admin] Pushing event updated for resources: {'Network': ['ID=f135fb7d-d2ad-4be7-86c8-ce349d202985,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:47:07.797249 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-01a27391-d495-4089-af3c-0b785c8e2da4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.102s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:47:07.804660 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Network f135fb7d-d2ad-4be7-86c8-ce349d202985 details requested by agent ovs-agent-dv-cinder-789564-2-iscsi with host dv-cinder-789564-2-iscsi {{(pid=99028) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 25 17:47:07.839856 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-01a27391-d495-4089-af3c-0b785c8e2da4 admin admin] 10.222.0.122 "POST /v2.0/networks HTTP/1.1" status: 201  len: 883 time: 0.6218889
May 25 17:47:07.842555 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 47162) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:47:07.848530 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.v2.base [None req-63c29d22-0e4f-4fa1-b319-ae8c2ce3a93b admin admin] Request body: {'subnet': {'network_id': 'f135fb7d-d2ad-4be7-86c8-ce349d202985', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-1073339046-subnet', 'tenant_id': '8c9122250a6446f38aeee09e6f53b953', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=99027) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:47:07.854263 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-63c29d22-0e4f-4fa1-b319-ae8c2ce3a93b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:47:07.858459 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-63c29d22-0e4f-4fa1-b319-ae8c2ce3a93b admin admin] Usage tracker for resource:subnet and tenant:8c9122250a6446f38aeee09e6f53b953 is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:47:07.861928 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-63c29d22-0e4f-4fa1-b319-ae8c2ce3a93b admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:47:07.870662 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-63c29d22-0e4f-4fa1-b319-ae8c2ce3a93b admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:47:07.941858 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-63c29d22-0e4f-4fa1-b319-ae8c2ce3a93b admin admin] Made reservation on behalf of 8c9122250a6446f38aeee09e6f53b953 for: {'subnet': 1} {{(pid=99027) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 17:47:07.944228 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-63c29d22-0e4f-4fa1-b319-ae8c2ce3a93b admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-14778112'] for subnet, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:08.427378 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-63c29d22-0e4f-4fa1-b319-ae8c2ce3a93b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114466', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-15467018', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-14778134'] for subnet, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:08.431976 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:47:08.446972 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f76e07f-a5b7-4c8a-883f-512ada2d4309 req-1a8f259d-0071-4f2c-9548-f45324016389 tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:47:08.448425 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-4f76e07f-a5b7-4c8a-883f-512ada2d4309 req-1a8f259d-0071-4f2c-9548-f45324016389 tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] 10.222.0.122 "GET /v2.0/ports?device_id=f42e59b6-6f61-498b-bc43-86f6cb777a3e HTTP/1.1" status: 200  len: 945 time: 0.0792749
May 25 17:47:08.493105 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-4f76e07f-a5b7-4c8a-883f-512ada2d4309 req-ddcf68b5-0a8d-4919-a771-7c02f9222967 tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] 10.222.0.122 "GET /v2.0/security-groups?id=b1cd410a-637d-478e-b9aa-ed7e2ce8bad3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0377254
May 25 17:47:08.508905 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63c29d22-0e4f-4fa1-b319-ae8c2ce3a93b admin admin] Pushing event updated for resources: {'Subnet': ['ID=e9b910ef-1e49-4552-a124-3e771fbaf1bf,revision_number=0']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:47:08.512426 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-63c29d22-0e4f-4fa1-b319-ae8c2ce3a93b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.080s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:47:08.515095 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-63c29d22-0e4f-4fa1-b319-ae8c2ce3a93b admin admin] Checking segment: {'id': '924d9acf-d84c-4582-ba11-75b3df5c20c4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1326, 'network_id': 'f135fb7d-d2ad-4be7-86c8-ce349d202985'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=99027) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 17:47:08.516733 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-63c29d22-0e4f-4fa1-b319-ae8c2ce3a93b admin admin] Network hostable DHCP agents. Network: f135fb7d-d2ad-4be7-86c8-ce349d202985, hostable agents: ['c8b0a350-254b-4562-874b-120ecdef0e25'], hosted agents: [] {{(pid=99027) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 25 17:47:08.616465 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-63c29d22-0e4f-4fa1-b319-ae8c2ce3a93b admin admin] Network f135fb7d-d2ad-4be7-86c8-ce349d202985 is scheduled to be hosted by DHCP agent c8b0a350-254b-4562-874b-120ecdef0e25 with binding_index 1 {{(pid=99027) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 25 17:47:08.730799 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.base_scheduler [None req-63c29d22-0e4f-4fa1-b319-ae8c2ce3a93b admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-789564-2-iscsi, f135fb7d-d2ad-4be7-86c8-ce349d202985) {{(pid=99027) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 17:47:08.739892 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-63c29d22-0e4f-4fa1-b319-ae8c2ce3a93b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:47:08.740505 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-63c29d22-0e4f-4fa1-b319-ae8c2ce3a93b admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for subnet, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:08.740608 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8a0fbfd7-12cb-4d9b-9251-10eee8f42f14 None None] Network f135fb7d-d2ad-4be7-86c8-ce349d202985 requested from dv-cinder-789564-2-iscsi {{(pid=99028) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 17:47:08.868556 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-63c29d22-0e4f-4fa1-b319-ae8c2ce3a93b admin admin] 10.222.0.122 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 846 time: 1.0249238
May 25 17:47:08.933506 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-aca1eb99-e230-4397-ab4d-f4240527ce04 None None] Network f135fb7d-d2ad-4be7-86c8-ce349d202985 requested from dv-cinder-789564-2-iscsi {{(pid=99028) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 17:47:11.508586 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:18.153771 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-dd2a4e13-2c4c-4f58-803e-5f5093317a01 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:20.627578 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-b760f0e1-5dbd-4d0e-a824-a578cc836ad9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:20.856605 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:21.747725 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-7e261f94-b84f-443e-be49-3bc1ac903b55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:23.245358 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-6df2b2a7-a54e-4d57-9be3-033078b9d5b3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:31.436389 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 47442) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:47:31.496528 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.db_base_plugin_v2 [None req-ae90d068-018b-4ba0-8d87-009e142918e2 admin admin] Deleting subnet a952a599-bb09-498d-a5d6-c6b017435958 {{(pid=99027) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 25 17:47:31.499740 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-ae90d068-018b-4ba0-8d87-009e142918e2 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:31.552997 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-ae90d068-018b-4ba0-8d87-009e142918e2 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-15628865'] for subnet, precommit_delete_associations {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:31.609558 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-ae90d068-018b-4ba0-8d87-009e142918e2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1474503'] for subnet, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:32.000114 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-ae90d068-018b-4ba0-8d87-009e142918e2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1473138', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114466', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-15467081', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-14778143'] for subnet, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:32.005363 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:47:32.039175 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-ae90d068-018b-4ba0-8d87-009e142918e2 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for subnet, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:32.047658 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae90d068-018b-4ba0-8d87-009e142918e2 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=a952a599-bb09-498d-a5d6-c6b017435958,revision_number=None']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:47:32.055698 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae90d068-018b-4ba0-8d87-009e142918e2 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:47:32.056057 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae90d068-018b-4ba0-8d87-009e142918e2 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:47:32.056408 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae90d068-018b-4ba0-8d87-009e142918e2 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:47:32.056793 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae90d068-018b-4ba0-8d87-009e142918e2 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:47:32.057157 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae90d068-018b-4ba0-8d87-009e142918e2 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:47:32.057592 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae90d068-018b-4ba0-8d87-009e142918e2 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:47:32.057929 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae90d068-018b-4ba0-8d87-009e142918e2 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:47:32.058267 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae90d068-018b-4ba0-8d87-009e142918e2 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:47:32.058605 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae90d068-018b-4ba0-8d87-009e142918e2 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:47:32.058961 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae90d068-018b-4ba0-8d87-009e142918e2 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:47:32.059296 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae90d068-018b-4ba0-8d87-009e142918e2 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:47:32.059647 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae90d068-018b-4ba0-8d87-009e142918e2 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:47:32.063195 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-ae90d068-018b-4ba0-8d87-009e142918e2 admin admin] 10.222.0.122 "DELETE /v2.0/subnets/a952a599-bb09-498d-a5d6-c6b017435958 HTTP/1.1" status: 204  len: 168 time: 0.6257446
May 25 17:47:32.064180 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-ae90d068-018b-4ba0-8d87-009e142918e2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.059s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:47:32.066269 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 47450) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:47:32.287764 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-07fdd2a5-c7b8-406a-ab3e-2c880faccdf1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1492659'] for network, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:32.309213 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-659c1ac6-1d98-4e4f-8ca9-27661e222911 req-c4bc9857-645a-47ee-b233-846bc8e71d20 tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:47:32.310645 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-659c1ac6-1d98-4e4f-8ca9-27661e222911 req-c4bc9857-645a-47ee-b233-846bc8e71d20 tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] 10.222.0.122 "GET /v2.0/ports?device_id=f42e59b6-6f61-498b-bc43-86f6cb777a3e HTTP/1.1" status: 200  len: 945 time: 0.2906678
May 25 17:47:32.454298 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-07fdd2a5-c7b8-406a-ab3e-2c880faccdf1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1470792', 'neutron.services.segments.db._delete_segments_for_network-8781841233116'] for network, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:32.466856 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-659c1ac6-1d98-4e4f-8ca9-27661e222911 req-020fc484-89ff-4362-9280-7e8501a2d36f tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] 10.222.0.122 "GET /v2.0/security-groups?id=b1cd410a-637d-478e-b9aa-ed7e2ce8bad3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1289198
May 25 17:47:32.471046 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.services.segments.db [None req-07fdd2a5-c7b8-406a-ab3e-2c880faccdf1 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fcae5b83670>,) {'filters': {'network_id': ['52b8fb59-59b6-417c-8c39-5c86fec7b69f']}} {{(pid=99026) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:47:32.483563 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.services.segments.db [None req-07fdd2a5-c7b8-406a-ab3e-2c880faccdf1 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fcae5b83670>, '1323aad8-d1c9-4bd0-8e4a-61e81873fe6a') {'for_net_delete': True} {{(pid=99026) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:47:32.484417 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.services.segments.db [None req-07fdd2a5-c7b8-406a-ab3e-2c880faccdf1 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fcae5b83670>, '1323aad8-d1c9-4bd0-8e4a-61e81873fe6a') {} {{(pid=99026) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:47:32.496461 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-07fdd2a5-c7b8-406a-ab3e-2c880faccdf1 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8781841242525', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-14735041'] for segment, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:32.512955 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-07fdd2a5-c7b8-406a-ab3e-2c880faccdf1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1469168'] for segment, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:32.519648 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-07fdd2a5-c7b8-406a-ab3e-2c880faccdf1 admin admin] Releasing vlan 1329 on physical network physnet1 to pool {{(pid=99026) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 25 17:47:32.520028 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-07fdd2a5-c7b8-406a-ab3e-2c880faccdf1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1469168', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-15476589'] for segment, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:32.533809 dv-cinder-789564-2-iscsi neutron-server[99026]: Traceback (most recent call last):
May 25 17:47:32.533809 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 25 17:47:32.533809 dv-cinder-789564-2-iscsi neutron-server[99026]:     timer()
May 25 17:47:32.533809 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 25 17:47:32.533809 dv-cinder-789564-2-iscsi neutron-server[99026]:     cb(*args, **kw)
May 25 17:47:32.533809 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 25 17:47:32.533809 dv-cinder-789564-2-iscsi neutron-server[99026]:     return func(*args, **kwargs)
May 25 17:47:32.533809 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 25 17:47:32.533809 dv-cinder-789564-2-iscsi neutron-server[99026]:     self._notify()
May 25 17:47:32.533809 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 25 17:47:32.533809 dv-cinder-789564-2-iscsi neutron-server[99026]:     self.callback(batched_events)
May 25 17:47:32.533809 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 25 17:47:32.533809 dv-cinder-789564-2-iscsi neutron-server[99026]:     event.method(event)
May 25 17:47:32.533809 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 25 17:47:32.533809 dv-cinder-789564-2-iscsi neutron-server[99026]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 25 17:47:32.533809 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 25 17:47:32.533809 dv-cinder-789564-2-iscsi neutron-server[99026]:     aggregate_uuid = self.p_client.list_aggregates(
May 25 17:47:32.533809 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 25 17:47:32.533809 dv-cinder-789564-2-iscsi neutron-server[99026]:     return f(self, *a, **k)
May 25 17:47:32.533809 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 25 17:47:32.533809 dv-cinder-789564-2-iscsi neutron-server[99026]:     return self._get(url).json()
May 25 17:47:32.533809 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 25 17:47:32.533809 dv-cinder-789564-2-iscsi neutron-server[99026]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 25 17:47:32.533809 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 25 17:47:32.533809 dv-cinder-789564-2-iscsi neutron-server[99026]:     return self.request(url, 'GET', **kwargs)
May 25 17:47:32.533809 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 25 17:47:32.533809 dv-cinder-789564-2-iscsi neutron-server[99026]:     base_url = self.get_endpoint(auth, allow=allow,
May 25 17:47:32.533809 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 25 17:47:32.533809 dv-cinder-789564-2-iscsi neutron-server[99026]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 25 17:47:32.533809 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 25 17:47:32.533809 dv-cinder-789564-2-iscsi neutron-server[99026]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 25 17:47:32.533809 dv-cinder-789564-2-iscsi neutron-server[99026]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 25 17:47:32.690805 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-07fdd2a5-c7b8-406a-ab3e-2c880faccdf1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1470785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-459299', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551400', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-419883'] for network, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:32.694904 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-55488421-bcf8-4368-a8e2-5f63dbd30e21 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:47:32.710932 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-07fdd2a5-c7b8-406a-ab3e-2c880faccdf1 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for network, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:32.716865 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07fdd2a5-c7b8-406a-ab3e-2c880faccdf1 admin admin] Pushing event deleted for resources: {'Network': ['ID=52b8fb59-59b6-417c-8c39-5c86fec7b69f,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:47:32.721567 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-07fdd2a5-c7b8-406a-ab3e-2c880faccdf1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:47:32.726357 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-07fdd2a5-c7b8-406a-ab3e-2c880faccdf1 admin admin] 10.222.0.122 "DELETE /v2.0/networks/52b8fb59-59b6-417c-8c39-5c86fec7b69f HTTP/1.1" status: 204  len: 168 time: 0.6591232
May 25 17:47:32.729210 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 47458) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:47:32.789981 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.db_base_plugin_v2 [None req-71a8817a-ade3-4d4a-9bc4-539b94483ea7 admin admin] Deleting subnet e9b910ef-1e49-4552-a124-3e771fbaf1bf {{(pid=99026) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 25 17:47:32.797465 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-71a8817a-ade3-4d4a-9bc4-539b94483ea7 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:32.850891 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-71a8817a-ade3-4d4a-9bc4-539b94483ea7 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-14735050'] for subnet, precommit_delete_associations {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:32.906986 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-71a8817a-ade3-4d4a-9bc4-539b94483ea7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1474503'] for subnet, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:33.247196 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a756ed65-a7bf-4758-86d0-9dbb1331187f req-15a78845-b52b-4cb0-a106-819289f06a7d tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:47:33.248611 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-a756ed65-a7bf-4758-86d0-9dbb1331187f req-15a78845-b52b-4cb0-a106-819289f06a7d tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] 10.222.0.125 "GET /v2.0/ports?device_id=f42e59b6-6f61-498b-bc43-86f6cb777a3e HTTP/1.1" status: 200  len: 945 time: 0.0811696
May 25 17:47:33.320301 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-71a8817a-ade3-4d4a-9bc4-539b94483ea7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1473138', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114466', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-15477963', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-14794250'] for subnet, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:33.324596 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:47:33.368201 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71a8817a-ade3-4d4a-9bc4-539b94483ea7 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=e9b910ef-1e49-4552-a124-3e771fbaf1bf,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:47:33.372310 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-71a8817a-ade3-4d4a-9bc4-539b94483ea7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:47:33.373553 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-71a8817a-ade3-4d4a-9bc4-539b94483ea7 admin admin] Notify callbacks [] for subnet, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:33.381130 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-71a8817a-ade3-4d4a-9bc4-539b94483ea7 admin admin] 10.222.0.122 "DELETE /v2.0/subnets/e9b910ef-1e49-4552-a124-3e771fbaf1bf HTTP/1.1" status: 204  len: 168 time: 0.6508708
May 25 17:47:33.383617 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 47464) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:47:33.416069 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.plugin [req-a756ed65-a7bf-4758-86d0-9dbb1331187f req-577dbb22-05d6-4722-be01-34214c371a84 tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] Deleting port 41c90217-aa85-400d-a252-63cc418f42a9 {{(pid=99027) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 17:47:33.416412 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-a756ed65-a7bf-4758-86d0-9dbb1331187f req-577dbb22-05d6-4722-be01-34214c371a84 tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781841220419'] for port, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:33.510557 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-7832f7b0-d209-4546-903e-9502047aeab3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1492659'] for network, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:33.560062 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.db [req-a756ed65-a7bf-4758-86d0-9dbb1331187f req-577dbb22-05d6-4722-be01-34214c371a84 tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] For port 41c90217-aa85-400d-a252-63cc418f42a9, host hv-cinder-78956, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=41c90217-aa85-400d-a252-63cc418f42a9,segment=NetworkSegment(31f775e4-1843-4e6f-aa8f-371e25229749),segment_id=31f775e4-1843-4e6f-aa8f-371e25229749)] {{(pid=99027) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:47:33.560455 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-a756ed65-a7bf-4758-86d0-9dbb1331187f req-577dbb22-05d6-4722-be01-34214c371a84 tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-418810'] for port, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:33.645025 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-7832f7b0-d209-4546-903e-9502047aeab3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1470792', 'neutron.services.segments.db._delete_segments_for_network-8781841233116'] for network, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:33.658381 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.services.segments.db [None req-7832f7b0-d209-4546-903e-9502047aeab3 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fcae6f30790>,) {'filters': {'network_id': ['f135fb7d-d2ad-4be7-86c8-ce349d202985']}} {{(pid=99026) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:47:33.672505 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.services.segments.db [None req-7832f7b0-d209-4546-903e-9502047aeab3 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fcae6f30790>, '924d9acf-d84c-4582-ba11-75b3df5c20c4') {'for_net_delete': True} {{(pid=99026) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:47:33.672801 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.services.segments.db [None req-7832f7b0-d209-4546-903e-9502047aeab3 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fcae6f30790>, '924d9acf-d84c-4582-ba11-75b3df5c20c4') {} {{(pid=99026) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:47:33.684979 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-7832f7b0-d209-4546-903e-9502047aeab3 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8781841242525', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-14735041'] for segment, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:33.696717 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.plugin [req-a756ed65-a7bf-4758-86d0-9dbb1331187f req-577dbb22-05d6-4722-be01-34214c371a84 tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] Calling delete_port for 41c90217-aa85-400d-a252-63cc418f42a9 owned by compute:nova {{(pid=99027) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 17:47:33.702464 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-7832f7b0-d209-4546-903e-9502047aeab3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1469168'] for segment, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:33.714450 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-7832f7b0-d209-4546-903e-9502047aeab3 admin admin] Releasing vlan 1326 on physical network physnet1 to pool {{(pid=99026) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 25 17:47:33.714974 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-7832f7b0-d209-4546-903e-9502047aeab3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1469168', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-15476589'] for segment, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:33.730920 dv-cinder-789564-2-iscsi neutron-server[99026]: Traceback (most recent call last):
May 25 17:47:33.730920 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 25 17:47:33.730920 dv-cinder-789564-2-iscsi neutron-server[99026]:     timer()
May 25 17:47:33.730920 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 25 17:47:33.730920 dv-cinder-789564-2-iscsi neutron-server[99026]:     cb(*args, **kw)
May 25 17:47:33.730920 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 25 17:47:33.730920 dv-cinder-789564-2-iscsi neutron-server[99026]:     return func(*args, **kwargs)
May 25 17:47:33.730920 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 25 17:47:33.730920 dv-cinder-789564-2-iscsi neutron-server[99026]:     self._notify()
May 25 17:47:33.730920 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 25 17:47:33.730920 dv-cinder-789564-2-iscsi neutron-server[99026]:     self.callback(batched_events)
May 25 17:47:33.730920 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 25 17:47:33.730920 dv-cinder-789564-2-iscsi neutron-server[99026]:     event.method(event)
May 25 17:47:33.730920 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 25 17:47:33.730920 dv-cinder-789564-2-iscsi neutron-server[99026]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 25 17:47:33.730920 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 25 17:47:33.730920 dv-cinder-789564-2-iscsi neutron-server[99026]:     aggregate_uuid = self.p_client.list_aggregates(
May 25 17:47:33.730920 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 25 17:47:33.730920 dv-cinder-789564-2-iscsi neutron-server[99026]:     return f(self, *a, **k)
May 25 17:47:33.730920 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 25 17:47:33.730920 dv-cinder-789564-2-iscsi neutron-server[99026]:     return self._get(url).json()
May 25 17:47:33.730920 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 25 17:47:33.730920 dv-cinder-789564-2-iscsi neutron-server[99026]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 25 17:47:33.730920 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 25 17:47:33.730920 dv-cinder-789564-2-iscsi neutron-server[99026]:     return self.request(url, 'GET', **kwargs)
May 25 17:47:33.730920 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 25 17:47:33.730920 dv-cinder-789564-2-iscsi neutron-server[99026]:     base_url = self.get_endpoint(auth, allow=allow,
May 25 17:47:33.730920 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 25 17:47:33.730920 dv-cinder-789564-2-iscsi neutron-server[99026]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 25 17:47:33.730920 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 25 17:47:33.730920 dv-cinder-789564-2-iscsi neutron-server[99026]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 25 17:47:33.730920 dv-cinder-789564-2-iscsi neutron-server[99026]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 25 17:47:33.768757 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.agents_db [None req-14fae233-15dc-4576-836b-621c5f95b584 None None] Agent healthcheck: found 6 active agents {{(pid=99029) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 17:47:33.897050 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-7832f7b0-d209-4546-903e-9502047aeab3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1470785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-459299', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551400', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-419883'] for network, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:33.901558 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-8172b226-382c-417f-9669-fc758838ac67 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:47:33.916643 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2bec964-b308-42d8-93f2-11f7fb0ce8ce req-668e6f3c-6db2-4734-aa5a-42e6f19927fd tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:47:33.918657 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-c2bec964-b308-42d8-93f2-11f7fb0ce8ce req-668e6f3c-6db2-4734-aa5a-42e6f19927fd tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] 10.222.0.122 "GET /v2.0/ports?device_id=f42e59b6-6f61-498b-bc43-86f6cb777a3e HTTP/1.1" status: 200  len: 945 time: 0.2909939
May 25 17:47:33.919155 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-7832f7b0-d209-4546-903e-9502047aeab3 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for network, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:33.927427 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7832f7b0-d209-4546-903e-9502047aeab3 admin admin] Pushing event deleted for resources: {'Network': ['ID=f135fb7d-d2ad-4be7-86c8-ce349d202985,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:47:33.932371 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-7832f7b0-d209-4546-903e-9502047aeab3 admin admin] 10.222.0.122 "DELETE /v2.0/networks/f135fb7d-d2ad-4be7-86c8-ce349d202985 HTTP/1.1" status: 204  len: 168 time: 0.5452540
May 25 17:47:33.932371 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-7832f7b0-d209-4546-903e-9502047aeab3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:47:33.972716 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-c2bec964-b308-42d8-93f2-11f7fb0ce8ce req-266c49c8-5440-4ade-ba99-07fc96af0ae4 tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] 10.222.0.122 "GET /v2.0/security-groups?id=b1cd410a-637d-478e-b9aa-ed7e2ce8bad3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0468624
May 25 17:47:33.988261 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-a756ed65-a7bf-4758-86d0-9dbb1331187f req-577dbb22-05d6-4722-be01-34214c371a84 tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781841222566', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781840788188', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15468986'] for port, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:33.995885 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-2a900670-3f64-4a65-9262-2bc9c145145b tempest-DeleteServersTestJSON-1433461198 tempest-DeleteServersTestJSON-1433461198-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:47:34.075127 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-577dbb22-05d6-4722-be01-34214c371a84 tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] Pushing event deleted for resources: {'Port': ['ID=41c90217-aa85-400d-a252-63cc418f42a9,revision_number=None']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:47:34.077854 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-577dbb22-05d6-4722-be01-34214c371a84 tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:47:34.121374 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.l3_dvrscheduler_db [req-a756ed65-a7bf-4758-86d0-9dbb1331187f req-577dbb22-05d6-4722-be01-34214c371a84 tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] No DVR routers for this DVR port 41c90217-aa85-400d-a252-63cc418f42a9 on host hv-cinder-78956 {{(pid=99027) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 25 17:47:34.123965 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-a756ed65-a7bf-4758-86d0-9dbb1331187f req-577dbb22-05d6-4722-be01-34214c371a84 tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-239387'] for port, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:34.126858 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f42e59b6-6f61-498b-bc43-86f6cb777a3e', 'name': 'network-vif-deleted', 'tag': '41c90217-aa85-400d-a252-63cc418f42a9'}] {{(pid=99027) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 17:47:34.175221 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f42e59b6-6f61-498b-bc43-86f6cb777a3e', 'name': 'network-vif-deleted', 'tag': '41c90217-aa85-400d-a252-63cc418f42a9', 'status': 'completed', 'code': 200}
May 25 17:47:34.205757 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-a756ed65-a7bf-4758-86d0-9dbb1331187f req-577dbb22-05d6-4722-be01-34214c371a84 tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] 10.222.0.125 "DELETE /v2.0/ports/41c90217-aa85-400d-a252-63cc418f42a9 HTTP/1.1" status: 204  len: 173 time: 0.9500711
May 25 17:47:34.261260 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 47478) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:47:34.314712 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-800b7b8c-c08e-407b-b646-be6c70c4944e admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=31575405cf7140c6a5448a30f1589a45&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0521204
May 25 17:47:34.317704 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 47482) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:47:34.389319 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-236dde84-c929-4505-9df8-41f0524922b3 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:34.416779 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-236dde84-c929-4505-9df8-41f0524922b3 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:34.553950 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-236dde84-c929-4505-9df8-41f0524922b3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:34.560780 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-0ff9b2cc-4e28-461a-bc91-7c5906191dfb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:47:34.571380 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-236dde84-c929-4505-9df8-41f0524922b3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=73fbb4e5-9a45-4cd0-99f5-59c192121e24,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:47:34.573763 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-236dde84-c929-4505-9df8-41f0524922b3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:47:34.578315 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-236dde84-c929-4505-9df8-41f0524922b3 admin admin] Notify callbacks [] for security_group, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:34.580596 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-236dde84-c929-4505-9df8-41f0524922b3 admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/73fbb4e5-9a45-4cd0-99f5-59c192121e24 HTTP/1.1" status: 204  len: 168 time: 0.2617302
May 25 17:47:35.144850 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-5b4997d4-5039-4607-8c78-a765f3f8fa73 req-2e8e7970-e430-482d-a54a-dc6dd51f2ff8 tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] Synchronizing usage tracker for tenant:76807af9dbfd494e8d149bc35c086824 on resource:port {{(pid=99027) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 17:47:35.239388 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-5b4997d4-5039-4607-8c78-a765f3f8fa73 req-2e8e7970-e430-482d-a54a-dc6dd51f2ff8 tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] Unset dirty status for tenant:76807af9dbfd494e8d149bc35c086824 on resource:port {{(pid=99027) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 17:47:35.240580 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-5b4997d4-5039-4607-8c78-a765f3f8fa73 req-2e8e7970-e430-482d-a54a-dc6dd51f2ff8 tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] 10.222.0.122 "GET /v2.0/ports?device_id=f42e59b6-6f61-498b-bc43-86f6cb777a3e HTTP/1.1" status: 200  len: 210 time: 0.1402960
May 25 17:47:35.403505 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 47496) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:47:35.451825 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-54fcdc62-d2a8-4c83-a0ef-d1f12d9c0751 admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=8c9122250a6446f38aeee09e6f53b953&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0471327
May 25 17:47:35.454278 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 47500) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:47:35.480691 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Device 41c90217-aa85-400d-a252-63cc418f42a9 no longer exists at agent hyperv_hv-cinder-78956 {{(pid=99028) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 17:47:35.512127 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-f9f0f007-0a5b-4cfe-a2b8-b37eb8195a52 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:35.515851 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.plugin [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] No Port match for: 41c90217-aa85-400d-a252-63cc418f42a9 {{(pid=99028) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 25 17:47:35.516211 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Device 41c90217-aa85-400d-a252-63cc418f42a9 not bound to the agent host hv-cinder-78956 {{(pid=99028) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 25 17:47:35.538004 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-f9f0f007-0a5b-4cfe-a2b8-b37eb8195a52 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:35.720037 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-f9f0f007-0a5b-4cfe-a2b8-b37eb8195a52 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:35.725300 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-29159b5c-3599-4493-b465-bbf36028fd93 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:47:35.736413 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9f0f007-0a5b-4cfe-a2b8-b37eb8195a52 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=207798af-6946-4aa9-91e8-ac4a9e3952fe,revision_number=None']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:47:35.744964 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-f9f0f007-0a5b-4cfe-a2b8-b37eb8195a52 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:47:35.744964 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-f9f0f007-0a5b-4cfe-a2b8-b37eb8195a52 admin admin] Notify callbacks [] for security_group, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:35.745908 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-f9f0f007-0a5b-4cfe-a2b8-b37eb8195a52 admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/207798af-6946-4aa9-91e8-ac4a9e3952fe HTTP/1.1" status: 204  len: 168 time: 0.2901728
May 25 17:47:41.542500 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:42.014669 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-e6e64db2-97cf-47e2-849e-91e2a3b38d02 req-18bc076b-1a03-4dae-9bb1-1725f5401103 service neutron] 10.222.0.125 "GET /v2.0/ports?device_id=446d90e5-0bef-47f6-852a-61b638d2a161&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.1978726
May 25 17:47:42.163783 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6e64db2-97cf-47e2-849e-91e2a3b38d02 req-4593f075-1398-4e3c-976c-ec7a7209b9db service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:47:42.165235 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-e6e64db2-97cf-47e2-849e-91e2a3b38d02 req-4593f075-1398-4e3c-976c-ec7a7209b9db service neutron] 10.222.0.125 "GET /v2.0/ports?tenant_id=b4cdc54b260f4e79b87fdf4a43b12e16&device_id=446d90e5-0bef-47f6-852a-61b638d2a161 HTTP/1.1" status: 200  len: 1099 time: 0.0823586
May 25 17:47:42.359681 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6e64db2-97cf-47e2-849e-91e2a3b38d02 req-146e1161-feac-4f8e-95f2-1fcff3b9ee69 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:47:42.361891 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-e6e64db2-97cf-47e2-849e-91e2a3b38d02 req-146e1161-feac-4f8e-95f2-1fcff3b9ee69 service neutron] 10.222.0.125 "GET /v2.0/networks?id=defaef08-c0f9-4608-b66d-b97e06e185bf HTTP/1.1" status: 200  len: 913 time: 0.1701779
May 25 17:47:42.470601 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-e6e64db2-97cf-47e2-849e-91e2a3b38d02 req-7e9b84ee-d663-4c5b-b596-fd2596620d47 service neutron] 10.222.0.125 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=841b2456-1a8a-47bd-a481-929b9038fe0d HTTP/1.1" status: 200  len: 1002 time: 0.0992825
May 25 17:47:42.546229 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6e64db2-97cf-47e2-849e-91e2a3b38d02 req-c492c6a9-3186-43da-8191-23a561f3a7fa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:47:42.548392 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-e6e64db2-97cf-47e2-849e-91e2a3b38d02 req-c492c6a9-3186-43da-8191-23a561f3a7fa service neutron] 10.222.0.125 "GET /v2.0/subnets?id=5be08358-9d04-4ee9-91ac-104e66e66e20 HTTP/1.1" status: 200  len: 850 time: 0.0695653
May 25 17:47:42.642428 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6e64db2-97cf-47e2-849e-91e2a3b38d02 req-efb28499-9dfa-4c61-9982-062310d914ab service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:47:42.643888 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-e6e64db2-97cf-47e2-849e-91e2a3b38d02 req-efb28499-9dfa-4c61-9982-062310d914ab service neutron] 10.222.0.125 "GET /v2.0/ports?network_id=defaef08-c0f9-4608-b66d-b97e06e185bf&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0857339
May 25 17:47:42.868482 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-e6e64db2-97cf-47e2-849e-91e2a3b38d02 req-2cf4ff89-7e74-4fe9-a3ac-5b9065b2ee0e service neutron] 10.222.0.125 "GET /v2.0/networks/defaef08-c0f9-4608-b66d-b97e06e185bf?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2143083
May 25 17:47:43.017356 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-e6e64db2-97cf-47e2-849e-91e2a3b38d02 req-eca21e0f-775c-4f33-9652-cbfe7cda8419 service neutron] 10.222.0.125 "GET /v2.0/networks/defaef08-c0f9-4608-b66d-b97e06e185bf?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1465104
May 25 17:47:48.165232 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4c2e3d89-ccc2-4a25-838e-8d2c4b309516 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:50.627594 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-3fd31d1f-7c9d-465a-84d6-5843c0d89f5e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:50.850709 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:51.690395 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-7e261f94-b84f-443e-be49-3bc1ac903b55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:47:53.267860 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-6df2b2a7-a54e-4d57-9be3-033078b9d5b3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:01.938787 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 47850) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:48:02.064245 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-36c66d51-e4cb-4a57-911d-0ef3b7654c27 admin admin] Notify callbacks [] for security_group, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:02.080044 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-36c66d51-e4cb-4a57-911d-0ef3b7654c27 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:48:02.083854 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-36c66d51-e4cb-4a57-911d-0ef3b7654c27 admin admin] Usage tracker for resource:security_group_rule and tenant:079397e39b8c4cb2861acca451fec91e is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:48:02.086675 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-36c66d51-e4cb-4a57-911d-0ef3b7654c27 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:48:02.093204 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-36c66d51-e4cb-4a57-911d-0ef3b7654c27 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:48:02.187877 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-36c66d51-e4cb-4a57-911d-0ef3b7654c27 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:02.273841 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-36c66d51-e4cb-4a57-911d-0ef3b7654c27 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:02.282791 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:48:02.326628 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-36c66d51-e4cb-4a57-911d-0ef3b7654c27 admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=079397e39b8c4cb2861acca451fec91e&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3867841
May 25 17:48:02.328236 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36c66d51-e4cb-4a57-911d-0ef3b7654c27 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=94692def-65ef-4c51-b868-ea077091e459,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:48:02.329828 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 47860) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:48:02.335014 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-36c66d51-e4cb-4a57-911d-0ef3b7654c27 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:48:02.393601 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-6355b5de-e413-40e7-a277-fe70bbe6b268 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:02.419158 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-6355b5de-e413-40e7-a277-fe70bbe6b268 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:02.536801 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-6355b5de-e413-40e7-a277-fe70bbe6b268 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:02.540470 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-c5e8504f-4f7d-4108-87fc-dd9e1e6362df admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:48:02.554089 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6355b5de-e413-40e7-a277-fe70bbe6b268 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=94692def-65ef-4c51-b868-ea077091e459,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:48:02.562745 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-6355b5de-e413-40e7-a277-fe70bbe6b268 admin admin] Notify callbacks [] for security_group, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:02.563861 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-6355b5de-e413-40e7-a277-fe70bbe6b268 admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/94692def-65ef-4c51-b868-ea077091e459 HTTP/1.1" status: 204  len: 168 time: 0.2329655
May 25 17:48:02.565306 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6355b5de-e413-40e7-a277-fe70bbe6b268 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:48:02.565674 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6355b5de-e413-40e7-a277-fe70bbe6b268 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:48:02.566154 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6355b5de-e413-40e7-a277-fe70bbe6b268 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:48:02.566479 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6355b5de-e413-40e7-a277-fe70bbe6b268 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:48:02.566830 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6355b5de-e413-40e7-a277-fe70bbe6b268 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:48:02.567179 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6355b5de-e413-40e7-a277-fe70bbe6b268 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:48:02.567600 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6355b5de-e413-40e7-a277-fe70bbe6b268 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:48:02.567855 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6355b5de-e413-40e7-a277-fe70bbe6b268 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:48:02.568200 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6355b5de-e413-40e7-a277-fe70bbe6b268 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:48:02.568535 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6355b5de-e413-40e7-a277-fe70bbe6b268 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:48:02.568979 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6355b5de-e413-40e7-a277-fe70bbe6b268 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:48:02.569229 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6355b5de-e413-40e7-a277-fe70bbe6b268 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:48:02.572345 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-6355b5de-e413-40e7-a277-fe70bbe6b268 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.032s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:48:04.270173 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 47900) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:48:04.330940 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.db_base_plugin_v2 [None req-1d34d909-c1a2-4dde-9c8a-e54adec4f8ab admin admin] Deleting subnet 1002a83a-fcaf-455e-9402-7a92f32b974e {{(pid=99026) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 25 17:48:04.334044 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-1d34d909-c1a2-4dde-9c8a-e54adec4f8ab admin admin] Notify callbacks [] for subnet, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:04.385336 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-1d34d909-c1a2-4dde-9c8a-e54adec4f8ab admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-14735050'] for subnet, precommit_delete_associations {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:04.553032 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-1d34d909-c1a2-4dde-9c8a-e54adec4f8ab admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1474503'] for subnet, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:04.907640 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-1d34d909-c1a2-4dde-9c8a-e54adec4f8ab admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1473138', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114466', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-15477963', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-14794250'] for subnet, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:04.912020 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-17467e1d-2627-4c9b-9ed2-22cc0ebd7e5b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:48:04.946954 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d34d909-c1a2-4dde-9c8a-e54adec4f8ab admin admin] Pushing event deleted for resources: {'Subnet': ['ID=1002a83a-fcaf-455e-9402-7a92f32b974e,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:48:04.949797 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-1d34d909-c1a2-4dde-9c8a-e54adec4f8ab admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:48:04.950767 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-1d34d909-c1a2-4dde-9c8a-e54adec4f8ab admin admin] Notify callbacks [] for subnet, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:04.957663 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-1d34d909-c1a2-4dde-9c8a-e54adec4f8ab admin admin] 10.222.0.122 "DELETE /v2.0/subnets/1002a83a-fcaf-455e-9402-7a92f32b974e HTTP/1.1" status: 204  len: 168 time: 0.6861985
May 25 17:48:04.960096 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 47912) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:48:05.067025 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-b472e52d-0fa7-4fb7-9368-3e2bd40ed7fa admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1492659'] for network, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:05.200202 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-b472e52d-0fa7-4fb7-9368-3e2bd40ed7fa admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1470792', 'neutron.services.segments.db._delete_segments_for_network-8781841233116'] for network, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:05.213878 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.services.segments.db [None req-b472e52d-0fa7-4fb7-9368-3e2bd40ed7fa admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fcae5caa550>,) {'filters': {'network_id': ['6339c1bc-651f-4152-a569-5ee35d1a9bfe']}} {{(pid=99026) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:48:05.229061 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.services.segments.db [None req-b472e52d-0fa7-4fb7-9368-3e2bd40ed7fa admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fcae5caa550>, '31f775e4-1843-4e6f-aa8f-371e25229749') {'for_net_delete': True} {{(pid=99026) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:48:05.229410 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.services.segments.db [None req-b472e52d-0fa7-4fb7-9368-3e2bd40ed7fa admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fcae5caa550>, '31f775e4-1843-4e6f-aa8f-371e25229749') {} {{(pid=99026) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:48:05.247732 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-b472e52d-0fa7-4fb7-9368-3e2bd40ed7fa admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8781841242525', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-14735041'] for segment, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:05.266190 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-b472e52d-0fa7-4fb7-9368-3e2bd40ed7fa admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1469168'] for segment, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:05.272716 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-b472e52d-0fa7-4fb7-9368-3e2bd40ed7fa admin admin] Releasing vlan 1345 on physical network physnet1 to pool {{(pid=99026) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 25 17:48:05.273325 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-b472e52d-0fa7-4fb7-9368-3e2bd40ed7fa admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1469168', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-15476589'] for segment, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:05.286408 dv-cinder-789564-2-iscsi neutron-server[99026]: Traceback (most recent call last):
May 25 17:48:05.286408 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 25 17:48:05.286408 dv-cinder-789564-2-iscsi neutron-server[99026]:     timer()
May 25 17:48:05.286408 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 25 17:48:05.286408 dv-cinder-789564-2-iscsi neutron-server[99026]:     cb(*args, **kw)
May 25 17:48:05.286408 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 25 17:48:05.286408 dv-cinder-789564-2-iscsi neutron-server[99026]:     return func(*args, **kwargs)
May 25 17:48:05.286408 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 25 17:48:05.286408 dv-cinder-789564-2-iscsi neutron-server[99026]:     self._notify()
May 25 17:48:05.286408 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 25 17:48:05.286408 dv-cinder-789564-2-iscsi neutron-server[99026]:     self.callback(batched_events)
May 25 17:48:05.286408 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 25 17:48:05.286408 dv-cinder-789564-2-iscsi neutron-server[99026]:     event.method(event)
May 25 17:48:05.286408 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 25 17:48:05.286408 dv-cinder-789564-2-iscsi neutron-server[99026]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 25 17:48:05.286408 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 25 17:48:05.286408 dv-cinder-789564-2-iscsi neutron-server[99026]:     aggregate_uuid = self.p_client.list_aggregates(
May 25 17:48:05.286408 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 25 17:48:05.286408 dv-cinder-789564-2-iscsi neutron-server[99026]:     return f(self, *a, **k)
May 25 17:48:05.286408 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 25 17:48:05.286408 dv-cinder-789564-2-iscsi neutron-server[99026]:     return self._get(url).json()
May 25 17:48:05.286408 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 25 17:48:05.286408 dv-cinder-789564-2-iscsi neutron-server[99026]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 25 17:48:05.286408 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 25 17:48:05.286408 dv-cinder-789564-2-iscsi neutron-server[99026]:     return self.request(url, 'GET', **kwargs)
May 25 17:48:05.286408 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 25 17:48:05.286408 dv-cinder-789564-2-iscsi neutron-server[99026]:     base_url = self.get_endpoint(auth, allow=allow,
May 25 17:48:05.286408 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 25 17:48:05.286408 dv-cinder-789564-2-iscsi neutron-server[99026]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 25 17:48:05.286408 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 25 17:48:05.286408 dv-cinder-789564-2-iscsi neutron-server[99026]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 25 17:48:05.286408 dv-cinder-789564-2-iscsi neutron-server[99026]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 25 17:48:05.416925 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-b472e52d-0fa7-4fb7-9368-3e2bd40ed7fa admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1470785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-459299', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551400', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-419883'] for network, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:05.422317 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-b472e52d-0fa7-4fb7-9368-3e2bd40ed7fa admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for network, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:05.424834 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-4d4d809e-c888-473e-a330-89210a35d1f0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:48:05.446676 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b472e52d-0fa7-4fb7-9368-3e2bd40ed7fa admin admin] Pushing event deleted for resources: {'Network': ['ID=6339c1bc-651f-4152-a569-5ee35d1a9bfe,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:48:05.449182 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-b472e52d-0fa7-4fb7-9368-3e2bd40ed7fa admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:48:05.519706 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-b472e52d-0fa7-4fb7-9368-3e2bd40ed7fa admin admin] 10.222.0.122 "DELETE /v2.0/networks/6339c1bc-651f-4152-a569-5ee35d1a9bfe HTTP/1.1" status: 204  len: 168 time: 0.5585151
May 25 17:48:05.918862 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 47926) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:48:05.972478 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-2909a11e-7613-42a9-b7a2-97083b97c118 admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=76807af9dbfd494e8d149bc35c086824&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0523806
May 25 17:48:05.975082 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 47930) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:48:06.040423 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-9be563d8-b717-4486-8ec8-05d96f14ae3b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:06.069708 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-9be563d8-b717-4486-8ec8-05d96f14ae3b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:06.204857 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-9be563d8-b717-4486-8ec8-05d96f14ae3b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:06.208858 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-f3e5d526-dbd9-429d-84b8-8f5bad712577 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:48:06.226492 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9be563d8-b717-4486-8ec8-05d96f14ae3b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b1cd410a-637d-478e-b9aa-ed7e2ce8bad3,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:48:06.229719 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-9be563d8-b717-4486-8ec8-05d96f14ae3b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:48:06.295390 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-9be563d8-b717-4486-8ec8-05d96f14ae3b admin admin] Notify callbacks [] for security_group, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:06.296560 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-9be563d8-b717-4486-8ec8-05d96f14ae3b admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/b1cd410a-637d-478e-b9aa-ed7e2ce8bad3 HTTP/1.1" status: 204  len: 168 time: 0.3205831
May 25 17:48:07.489629 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 47962) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:48:07.595827 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.v2.base [None req-e6f4e897-3d60-4a0a-b6f0-c79a838deaf6 admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-1304633943-network', 'tenant_id': '79ce7e80f85a4c57896263e5974c8df8'}} {{(pid=99027) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:48:07.601604 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-e6f4e897-3d60-4a0a-b6f0-c79a838deaf6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:48:07.605800 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-e6f4e897-3d60-4a0a-b6f0-c79a838deaf6 admin admin] Usage tracker for resource:network and tenant:79ce7e80f85a4c57896263e5974c8df8 is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:48:07.609066 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-e6f4e897-3d60-4a0a-b6f0-c79a838deaf6 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:48:07.617355 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-e6f4e897-3d60-4a0a-b6f0-c79a838deaf6 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:48:07.742108 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e6f4e897-3d60-4a0a-b6f0-c79a838deaf6 admin admin] Made reservation on behalf of 79ce7e80f85a4c57896263e5974c8df8 for: {'network': 1} {{(pid=99027) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 17:48:07.744446 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-e6f4e897-3d60-4a0a-b6f0-c79a838deaf6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-1465344'] for network, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:07.757674 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-e6f4e897-3d60-4a0a-b6f0-c79a838deaf6 admin admin] Notify callbacks [] for security_group, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:07.772415 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-e6f4e897-3d60-4a0a-b6f0-c79a838deaf6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:48:07.776158 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-e6f4e897-3d60-4a0a-b6f0-c79a838deaf6 admin admin] Usage tracker for resource:security_group_rule and tenant:79ce7e80f85a4c57896263e5974c8df8 is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:48:07.778984 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-e6f4e897-3d60-4a0a-b6f0-c79a838deaf6 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:48:07.785066 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-e6f4e897-3d60-4a0a-b6f0-c79a838deaf6 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:48:07.865419 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-e6f4e897-3d60-4a0a-b6f0-c79a838deaf6 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:07.913702 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-e6f4e897-3d60-4a0a-b6f0-c79a838deaf6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:07.916696 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-accf3087-4ddd-4b62-8fde-1c2e92ba59ff admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:48:07.946040 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e6f4e897-3d60-4a0a-b6f0-c79a838deaf6 admin admin] vlan segment allocate from pool success with {'vlan_id': 1319, 'physical_network': 'physnet1'}  {{(pid=99027) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 25 17:48:07.955518 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6f4e897-3d60-4a0a-b6f0-c79a838deaf6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f36e68fc-4038-4509-8aec-f49be290aa8b,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:48:07.959140 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-e6f4e897-3d60-4a0a-b6f0-c79a838deaf6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:48:07.961704 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-e6f4e897-3d60-4a0a-b6f0-c79a838deaf6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1469168'] for segment, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:07.962066 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.db.segments_db [None req-e6f4e897-3d60-4a0a-b6f0-c79a838deaf6 admin admin] Added segment 343b7bea-3acc-4c9d-939f-d8bc9eea2e5e of type vlan for network 7904a86e-e373-4117-97cd-a894d782e3e5
May 25 17:48:07.991972 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-e6f4e897-3d60-4a0a-b6f0-c79a838deaf6 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8781840806997'] for network, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:08.073114 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-e6f4e897-3d60-4a0a-b6f0-c79a838deaf6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-459299', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551400'] for network, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:08.074415 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e6f4e897-3d60-4a0a-b6f0-c79a838deaf6 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:48:08.074984 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-e6f4e897-3d60-4a0a-b6f0-c79a838deaf6 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for network, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:08.078567 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:48:08.178836 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6f4e897-3d60-4a0a-b6f0-c79a838deaf6 admin admin] Pushing event updated for resources: {'Network': ['ID=7904a86e-e373-4117-97cd-a894d782e3e5,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:48:08.181514 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-e6f4e897-3d60-4a0a-b6f0-c79a838deaf6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.103s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:48:08.189183 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Network 7904a86e-e373-4117-97cd-a894d782e3e5 details requested by agent ovs-agent-dv-cinder-789564-2-iscsi with host dv-cinder-789564-2-iscsi {{(pid=99028) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 25 17:48:08.257269 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-e6f4e897-3d60-4a0a-b6f0-c79a838deaf6 admin admin] 10.222.0.122 "POST /v2.0/networks HTTP/1.1" status: 201  len: 889 time: 0.7664707
May 25 17:48:08.260033 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 47968) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:48:08.265852 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.v2.base [None req-8b3ad8b2-6078-4e30-8ed9-54ccca181f13 admin admin] Request body: {'subnet': {'network_id': '7904a86e-e373-4117-97cd-a894d782e3e5', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-1304633943-subnet', 'tenant_id': '79ce7e80f85a4c57896263e5974c8df8', 'ip_version': 4}} {{(pid=99027) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:48:08.271001 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-8b3ad8b2-6078-4e30-8ed9-54ccca181f13 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:48:08.275141 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-8b3ad8b2-6078-4e30-8ed9-54ccca181f13 admin admin] Usage tracker for resource:subnet and tenant:79ce7e80f85a4c57896263e5974c8df8 is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:48:08.277987 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-8b3ad8b2-6078-4e30-8ed9-54ccca181f13 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:48:08.284056 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-8b3ad8b2-6078-4e30-8ed9-54ccca181f13 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:48:08.370955 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8b3ad8b2-6078-4e30-8ed9-54ccca181f13 admin admin] Made reservation on behalf of 79ce7e80f85a4c57896263e5974c8df8 for: {'subnet': 1} {{(pid=99027) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 17:48:08.373314 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-8b3ad8b2-6078-4e30-8ed9-54ccca181f13 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-14778112'] for subnet, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:08.827973 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-8b3ad8b2-6078-4e30-8ed9-54ccca181f13 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114466', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-15467018', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-14778134'] for subnet, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:08.832539 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-aadab2b8-7c8b-42bb-b423-75530f010fce admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:48:08.905404 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b3ad8b2-6078-4e30-8ed9-54ccca181f13 admin admin] Pushing event updated for resources: {'Subnet': ['ID=200f371a-f534-452e-9426-951e43bcffe5,revision_number=0']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:48:08.908760 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-8b3ad8b2-6078-4e30-8ed9-54ccca181f13 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:48:08.914643 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8b3ad8b2-6078-4e30-8ed9-54ccca181f13 admin admin] Checking segment: {'id': '343b7bea-3acc-4c9d-939f-d8bc9eea2e5e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1319, 'network_id': '7904a86e-e373-4117-97cd-a894d782e3e5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=99027) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 17:48:08.914989 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8b3ad8b2-6078-4e30-8ed9-54ccca181f13 admin admin] Network hostable DHCP agents. Network: 7904a86e-e373-4117-97cd-a894d782e3e5, hostable agents: ['c8b0a350-254b-4562-874b-120ecdef0e25'], hosted agents: [] {{(pid=99027) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 25 17:48:09.004679 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8b3ad8b2-6078-4e30-8ed9-54ccca181f13 admin admin] Network 7904a86e-e373-4117-97cd-a894d782e3e5 is scheduled to be hosted by DHCP agent c8b0a350-254b-4562-874b-120ecdef0e25 with binding_index 1 {{(pid=99027) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 25 17:48:09.050715 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.base_scheduler [None req-8b3ad8b2-6078-4e30-8ed9-54ccca181f13 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-789564-2-iscsi, 7904a86e-e373-4117-97cd-a894d782e3e5) {{(pid=99027) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 17:48:09.059676 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-145417e6-9718-4ca1-b00f-7164453001c5 None None] Network 7904a86e-e373-4117-97cd-a894d782e3e5 requested from dv-cinder-789564-2-iscsi {{(pid=99028) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 17:48:09.059837 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8b3ad8b2-6078-4e30-8ed9-54ccca181f13 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:48:09.060337 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-8b3ad8b2-6078-4e30-8ed9-54ccca181f13 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for subnet, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:09.114445 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-8b3ad8b2-6078-4e30-8ed9-54ccca181f13 admin admin] 10.222.0.122 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 851 time: 0.8533552
May 25 17:48:09.117065 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 47974) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:48:09.122448 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.v2.base [None req-0ebbd0f5-6944-4853-9286-5bc45d7bb720 admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-1304633943-router', 'tenant_id': '79ce7e80f85a4c57896263e5974c8df8', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb'}}} {{(pid=99027) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:48:09.128264 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-0ebbd0f5-6944-4853-9286-5bc45d7bb720 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:48:09.132991 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-0ebbd0f5-6944-4853-9286-5bc45d7bb720 admin admin] Usage tracker for resource:router and tenant:79ce7e80f85a4c57896263e5974c8df8 is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:48:09.135942 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-0ebbd0f5-6944-4853-9286-5bc45d7bb720 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:48:09.143394 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-0ebbd0f5-6944-4853-9286-5bc45d7bb720 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:48:09.199554 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-0ebbd0f5-6944-4853-9286-5bc45d7bb720 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-415064', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-6983'] for router, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:09.200615 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-0ebbd0f5-6944-4853-9286-5bc45d7bb720 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-414296', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-419975', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-491114', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-6988'] for router, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:09.216703 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-0ebbd0f5-6944-4853-9286-5bc45d7bb720 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:09.296013 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cf99e660-9af1-46cc-87aa-177a195e457e None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpe415bc4a-81ee-5198-a7be-1f5e4adc5586-7904a86e-e373-4117-97cd-a894d782e3e5', 'network_id': '7904a86e-e373-4117-97cd-a894d782e3e5', 'tenant_id': '79ce7e80f85a4c57896263e5974c8df8', 'fixed_ips': [{'subnet_id': '200f371a-f534-452e-9426-951e43bcffe5'}]}} from dv-cinder-789564-2-iscsi. {{(pid=99028) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
May 25 17:48:09.296781 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-cf99e660-9af1-46cc-87aa-177a195e457e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_create {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:09.458926 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.db_base_plugin_common [None req-cf99e660-9af1-46cc-87aa-177a195e457e None None] Allocated IP 172.20.0.2 (7904a86e-e373-4117-97cd-a894d782e3e5/200f371a-f534-452e-9426-951e43bcffe5/32dce052-f792-42ff-94f7-ee823910dc0b) {{(pid=99028) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 17:48:09.614694 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-0ebbd0f5-6944-4853-9286-5bc45d7bb720 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-420002', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-415082', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-6970'] for router, precommit_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:09.675476 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-cf99e660-9af1-46cc-87aa-177a195e457e None None] Notify callbacks [] for port, precommit_create {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:09.685595 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-cf99e660-9af1-46cc-87aa-177a195e457e None None] Transition to ACTIVE for port object 32dce052-f792-42ff-94f7-ee823910dc0b will not be triggered until provisioned by entity L2. {{(pid=99028) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 17:48:09.704312 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-cf99e660-9af1-46cc-87aa-177a195e457e None None] Transition to ACTIVE for port object 32dce052-f792-42ff-94f7-ee823910dc0b will not be triggered until provisioned by entity DHCP. {{(pid=99028) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 17:48:09.797669 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-cf99e660-9af1-46cc-87aa-177a195e457e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781840788179'] for port, after_create {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:09.806248 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:48:09.908499 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cf99e660-9af1-46cc-87aa-177a195e457e None None] Network 7904a86e-e373-4117-97cd-a894d782e3e5 is already hosted by enough agents. {{(pid=99028) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 17:48:09.911531 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.scheduler.base_scheduler [None req-cf99e660-9af1-46cc-87aa-177a195e457e None None] Resources bound (agent type, host, resource id):  {{(pid=99028) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 17:48:09.914493 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cf99e660-9af1-46cc-87aa-177a195e457e None None] Received port after_create {{(pid=99028) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 17:48:09.952396 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf99e660-9af1-46cc-87aa-177a195e457e None None] Pushing event updated for resources: {'Port': ['ID=32dce052-f792-42ff-94f7-ee823910dc0b,revision_number=1']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:48:09.998696 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf99e660-9af1-46cc-87aa-177a195e457e None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:48:09.999116 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf99e660-9af1-46cc-87aa-177a195e457e None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:48:09.999631 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf99e660-9af1-46cc-87aa-177a195e457e None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:48:09.999969 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf99e660-9af1-46cc-87aa-177a195e457e None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:48:10.000299 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf99e660-9af1-46cc-87aa-177a195e457e None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:48:10.000632 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf99e660-9af1-46cc-87aa-177a195e457e None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:48:10.000957 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf99e660-9af1-46cc-87aa-177a195e457e None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:48:10.001328 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf99e660-9af1-46cc-87aa-177a195e457e None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:48:10.001688 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf99e660-9af1-46cc-87aa-177a195e457e None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:48:10.002009 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf99e660-9af1-46cc-87aa-177a195e457e None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:48:10.002326 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf99e660-9af1-46cc-87aa-177a195e457e None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:48:10.002641 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf99e660-9af1-46cc-87aa-177a195e457e None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:48:10.010126 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-cf99e660-9af1-46cc-87aa-177a195e457e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.204s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:48:10.026280 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.managers [None req-cf99e660-9af1-46cc-87aa-177a195e457e None None] Attempting to bind port 32dce052-f792-42ff-94f7-ee823910dc0b on host dv-cinder-789564-2-iscsi for vnic_type normal with profile  {{(pid=99028) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 17:48:10.026647 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.managers [None req-cf99e660-9af1-46cc-87aa-177a195e457e None None] Attempting to bind port 32dce052-f792-42ff-94f7-ee823910dc0b by drivers openvswitch,hyperv on host dv-cinder-789564-2-iscsi at level 0 using segments [{'id': '343b7bea-3acc-4c9d-939f-d8bc9eea2e5e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1319, 'network_id': '7904a86e-e373-4117-97cd-a894d782e3e5'}] {{(pid=99028) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 17:48:10.027010 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cf99e660-9af1-46cc-87aa-177a195e457e None None] Attempting to bind port 32dce052-f792-42ff-94f7-ee823910dc0b on network 7904a86e-e373-4117-97cd-a894d782e3e5 {{(pid=99028) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 17:48:10.033392 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cf99e660-9af1-46cc-87aa-177a195e457e None None] Checking agent: {'id': '7bb67520-1e97-4ad9-9b97-101068bbe1a3', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-789564-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 17, 34, 21), 'started_at': datetime.datetime(2021, 5, 25, 17, 34, 51), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 17, 47, 51), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-789564-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=99028) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 17:48:10.035282 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cf99e660-9af1-46cc-87aa-177a195e457e None None] Checking segment: {'id': '343b7bea-3acc-4c9d-939f-d8bc9eea2e5e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1319, 'network_id': '7904a86e-e373-4117-97cd-a894d782e3e5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=99028) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 17:48:10.035282 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-cf99e660-9af1-46cc-87aa-177a195e457e None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:10.035282 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cf99e660-9af1-46cc-87aa-177a195e457e None None] Bound using segment: {'id': '343b7bea-3acc-4c9d-939f-d8bc9eea2e5e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1319, 'network_id': '7904a86e-e373-4117-97cd-a894d782e3e5'} {{(pid=99028) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 17:48:10.035282 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.managers [None req-cf99e660-9af1-46cc-87aa-177a195e457e None None] Bound port: 32dce052-f792-42ff-94f7-ee823910dc0b, host: dv-cinder-789564-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '343b7bea-3acc-4c9d-939f-d8bc9eea2e5e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1319, 'network_id': '7904a86e-e373-4117-97cd-a894d782e3e5'}}] {{(pid=99028) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 17:48:10.035658 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-cf99e660-9af1-46cc-87aa-177a195e457e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:10.132079 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-cf99e660-9af1-46cc-87aa-177a195e457e None None] For port 32dce052-f792-42ff-94f7-ee823910dc0b, host dv-cinder-789564-2-iscsi, cleared binding levels {{(pid=99028) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 17:48:10.135103 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-cf99e660-9af1-46cc-87aa-177a195e457e None None] For port 32dce052-f792-42ff-94f7-ee823910dc0b, host dv-cinder-789564-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=32dce052-f792-42ff-94f7-ee823910dc0b,segment=NetworkSegment(343b7bea-3acc-4c9d-939f-d8bc9eea2e5e),segment_id=343b7bea-3acc-4c9d-939f-d8bc9eea2e5e)] {{(pid=99028) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 17:48:10.145211 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-0ebbd0f5-6944-4853-9286-5bc45d7bb720 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:10.176009 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-0ebbd0f5-6944-4853-9286-5bc45d7bb720 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:10.182685 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-cf99e660-9af1-46cc-87aa-177a195e457e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:10.187434 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:48:10.268418 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf99e660-9af1-46cc-87aa-177a195e457e None None] Pushing event updated for resources: {'Port': ['ID=32dce052-f792-42ff-94f7-ee823910dc0b,revision_number=2']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:48:10.271666 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-cf99e660-9af1-46cc-87aa-177a195e457e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:48:10.329491 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.db_base_plugin_common [None req-0ebbd0f5-6944-4853-9286-5bc45d7bb720 admin admin] Allocated IP 172.27.3.80 (eb7ec72b-a691-481b-8d7e-42c05e13a8cb/d6898f5f-da0b-4428-97b4-4cbe3e83caaa/6c066f26-0761-4bef-b612-661f04382074) {{(pid=99027) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 17:48:10.502551 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-0ebbd0f5-6944-4853-9286-5bc45d7bb720 admin admin] Notify callbacks [] for port, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:10.611657 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-0ebbd0f5-6944-4853-9286-5bc45d7bb720 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781840788179', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15468986'] for port, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:10.616986 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-68cc1310-b1dd-450f-aaf6-f6a3464f6496 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:48:10.694574 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0ebbd0f5-6944-4853-9286-5bc45d7bb720 admin admin] Network eb7ec72b-a691-481b-8d7e-42c05e13a8cb is already hosted by enough agents. {{(pid=99027) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 17:48:10.697112 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.base_scheduler [None req-0ebbd0f5-6944-4853-9286-5bc45d7bb720 admin admin] Resources bound (agent type, host, resource id):  {{(pid=99027) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 17:48:10.700925 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0ebbd0f5-6944-4853-9286-5bc45d7bb720 admin admin] Received port after_create {{(pid=99027) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 17:48:10.739116 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ebbd0f5-6944-4853-9286-5bc45d7bb720 admin admin] Pushing event updated for resources: {'Port': ['ID=6c066f26-0761-4bef-b612-661f04382074,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:48:10.745138 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-0ebbd0f5-6944-4853-9286-5bc45d7bb720 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.128s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:48:10.765795 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.agents_db [None req-14fae233-15dc-4576-836b-621c5f95b584 None None] Agent healthcheck: found 6 active agents {{(pid=99029) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 17:48:11.175584 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7cf5d12b-46b9-4479-810c-b7dc6e652cb3 None None] Network 7904a86e-e373-4117-97cd-a894d782e3e5 requested from dv-cinder-789564-2-iscsi {{(pid=99028) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 17:48:11.288659 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-0ebbd0f5-6944-4853-9286-5bc45d7bb720 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:11.362164 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device 32dce052-f792-42ff-94f7-ee823910dc0b up at agent ovs-agent-dv-cinder-789564-2-iscsi {{(pid=99028) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 17:48:11.420104 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-480c4e58-b306-44e1-8600-598387204237 None None] Provisioning for port 32dce052-f792-42ff-94f7-ee823910dc0b completed by entity DHCP. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 17:48:11.577520 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:11.657467 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Provisioning for port 32dce052-f792-42ff-94f7-ee823910dc0b completed by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 17:48:11.662992 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Provisioning complete for port 32dce052-f792-42ff-94f7-ee823910dc0b triggered by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 17:48:11.663376 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:11.760124 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-0ebbd0f5-6944-4853-9286-5bc45d7bb720 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-415057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-420065'] for router, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:11.829589 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:11.838104 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-6642c1d7-3893-4287-8941-94ce2a9804ab None None] Provisioning complete for port 32dce052-f792-42ff-94f7-ee823910dc0b triggered by entity DHCP. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 17:48:11.838480 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-6642c1d7-3893-4287-8941-94ce2a9804ab None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:11.913892 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] For port 32dce052-f792-42ff-94f7-ee823910dc0b, host dv-cinder-789564-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=32dce052-f792-42ff-94f7-ee823910dc0b,segment=NetworkSegment(343b7bea-3acc-4c9d-939f-d8bc9eea2e5e),segment_id=343b7bea-3acc-4c9d-939f-d8bc9eea2e5e)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:48:11.982966 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-6642c1d7-3893-4287-8941-94ce2a9804ab None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:12.000427 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:12.002434 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:48:12.081556 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0ebbd0f5-6944-4853-9286-5bc45d7bb720 admin admin] Router ed6451cf-7a08-48a6-b823-dd9d01bcee79 is scheduled to L3 agent eaeb6875-c4ed-43b6-8658-aa4e52324fdf with binding_index 1 {{(pid=99027) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
May 25 17:48:12.125505 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.db.api [None req-6642c1d7-3893-4287-8941-94ce2a9804ab None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=99028) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}}
May 25 17:48:12.125858 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_db.api [None req-6642c1d7-3893-4287-8941-94ce2a9804ab None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}}
May 25 17:48:12.126344 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Pushing event updated for resources: {'Port': ['ID=32dce052-f792-42ff-94f7-ee823910dc0b,revision_number=3']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:48:12.129454 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.127s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:48:12.266021 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0ebbd0f5-6944-4853-9286-5bc45d7bb720 admin admin] Notify agent at l3_agent.dv-cinder-789564-2-iscsi the message routers_updated {{(pid=99027) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 25 17:48:12.276202 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4cde862d-fecb-4c23-ac2b-2724d7e813c4 None None] Sync routers for ids ['ed6451cf-7a08-48a6-b823-dd9d01bcee79'] in dv-cinder-789564-2-iscsi {{(pid=99028) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 25 17:48:12.285927 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4cde862d-fecb-4c23-ac2b-2724d7e813c4 None None] Routers {'ed6451cf-7a08-48a6-b823-dd9d01bcee79'} bound to L3 agent in host dv-cinder-789564-2-iscsi {{(pid=99028) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 17:48:12.286640 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-4cde862d-fecb-4c23-ac2b-2724d7e813c4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcae6c8e130>, 'dv-cinder-789564-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-25T17:34:21Z,description=<?>,heartbeat_timestamp=2021-05-25T17:47:51Z,host='dv-cinder-789564-2-iscsi',id=eaeb6875-c4ed-43b6-8658-aa4e52324fdf,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T17:34:21Z,topic='l3_agent')) {'router_ids': ['ed6451cf-7a08-48a6-b823-dd9d01bcee79'], 'active': True} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:48:12.359772 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-0ebbd0f5-6944-4853-9286-5bc45d7bb720 admin admin] Notify callbacks [] for router, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:12.360938 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-0ebbd0f5-6944-4853-9286-5bc45d7bb720 admin admin] 10.222.0.122 "POST /v2.0/routers HTTP/1.1" status: 201  len: 926 time: 3.2428882
May 25 17:48:12.363555 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 47996) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:48:12.465499 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvr_db [None req-4cde862d-fecb-4c23-ac2b-2724d7e813c4 None None] Set router ed6451cf-7a08-48a6-b823-dd9d01bcee79 gateway port host: dv-cinder-789564-2-iscsi {{(pid=99028) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 17:48:12.806498 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-4cde862d-fecb-4c23-ac2b-2724d7e813c4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcae6c8e130>, [{'id': 'ed6451cf-7a08-48a6-b823-dd9d01bcee79', 'name': 'tempest-TestMinimumBasicScenario-1304633943-router', 'tenant_id': '79ce7e80f85a4c57896263e5974c8df8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.80'}], 'enable_snat': True}, 'gw_port_id': '6c066f26-0761-4bef-b612-661f04382074', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:48:09Z', 'updated_at': '2021-05-25T17:48:10Z', 'revision_number': 3, 'project_id': '79ce7e80f85a4c57896263e5974c8df8', 'gw_port': {'id': '6c066f26-0761-4bef-b612-661f04382074', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:0c:b5:ed', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ed6451cf-7a08-48a6-b823-dd9d01bcee79', 'device_owner': 'network:router_gateway', 'standard_attr_id': 478, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.80', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:48:10Z', 'updated_at': '2021-05-25T17:48:10Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi'}], 'dv-cinder-789564-2-iscsi', False) {} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:48:12.810718 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4cde862d-fecb-4c23-ac2b-2724d7e813c4 None None] Checking router: ed6451cf-7a08-48a6-b823-dd9d01bcee79 for host: dv-cinder-789564-2-iscsi {{(pid=99028) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 25 17:48:12.811754 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4cde862d-fecb-4c23-ac2b-2724d7e813c4 None None] Updating router ed6451cf-7a08-48a6-b823-dd9d01bcee79 port 6c066f26-0761-4bef-b612-661f04382074 binding host dv-cinder-789564-2-iscsi {{(pid=99028) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 25 17:48:12.869160 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4cde862d-fecb-4c23-ac2b-2724d7e813c4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:13.073923 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-bb173b33-f9c4-4b17-8d72-6e9babb2e272 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:13.205707 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4cde862d-fecb-4c23-ac2b-2724d7e813c4 None None] Notify callbacks [] for port, precommit_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:13.218175 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-4cde862d-fecb-4c23-ac2b-2724d7e813c4 None None] Transition to ACTIVE for port object 6c066f26-0761-4bef-b612-661f04382074 will not be triggered until provisioned by entity L2. {{(pid=99028) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 17:48:13.289690 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device 32dce052-f792-42ff-94f7-ee823910dc0b up at agent ovs-agent-dv-cinder-789564-2-iscsi {{(pid=99028) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 17:48:13.308734 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.db_base_plugin_common [None req-bb173b33-f9c4-4b17-8d72-6e9babb2e272 admin admin] Allocated IP 172.20.0.1 (7904a86e-e373-4117-97cd-a894d782e3e5/200f371a-f534-452e-9426-951e43bcffe5/1d7a4034-86b0-49fb-bf45-68dda95544c2) {{(pid=99027) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 17:48:13.320672 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4cde862d-fecb-4c23-ac2b-2724d7e813c4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:13.339537 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:48:13.443305 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.managers [None req-4cde862d-fecb-4c23-ac2b-2724d7e813c4 None None] Attempting to bind port 6c066f26-0761-4bef-b612-661f04382074 on host dv-cinder-789564-2-iscsi for vnic_type normal with profile  {{(pid=99028) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 17:48:13.451254 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.managers [None req-4cde862d-fecb-4c23-ac2b-2724d7e813c4 None None] Attempting to bind port 6c066f26-0761-4bef-b612-661f04382074 by drivers openvswitch,hyperv on host dv-cinder-789564-2-iscsi at level 0 using segments [{'id': '471771f9-c462-4865-800d-0d5029e9eb3e', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb'}] {{(pid=99028) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 17:48:13.451254 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4cde862d-fecb-4c23-ac2b-2724d7e813c4 None None] Attempting to bind port 6c066f26-0761-4bef-b612-661f04382074 on network eb7ec72b-a691-481b-8d7e-42c05e13a8cb {{(pid=99028) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 17:48:13.464568 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d35ebac-72d2-4683-8434-7c10cdd203cb None None] Pushing event updated for resources: {'Port': ['ID=6c066f26-0761-4bef-b612-661f04382074,revision_number=2']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:48:13.469623 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4cde862d-fecb-4c23-ac2b-2724d7e813c4 None None] Checking agent: {'id': '7bb67520-1e97-4ad9-9b97-101068bbe1a3', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-789564-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 17, 34, 21), 'started_at': datetime.datetime(2021, 5, 25, 17, 34, 51), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 17, 47, 51), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-789564-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=99028) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 17:48:13.470258 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4cde862d-fecb-4c23-ac2b-2724d7e813c4 None None] Checking segment: {'id': '471771f9-c462-4865-800d-0d5029e9eb3e', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=99028) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 17:48:13.470844 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4cde862d-fecb-4c23-ac2b-2724d7e813c4 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:13.471400 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4cde862d-fecb-4c23-ac2b-2724d7e813c4 None None] Bound using segment: {'id': '471771f9-c462-4865-800d-0d5029e9eb3e', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb'} {{(pid=99028) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 17:48:13.472062 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.managers [None req-4cde862d-fecb-4c23-ac2b-2724d7e813c4 None None] Bound port: 6c066f26-0761-4bef-b612-661f04382074, host: dv-cinder-789564-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '471771f9-c462-4865-800d-0d5029e9eb3e', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb'}}] {{(pid=99028) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 17:48:13.472613 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4cde862d-fecb-4c23-ac2b-2724d7e813c4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:13.537485 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-3d35ebac-72d2-4683-8434-7c10cdd203cb None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.198s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:48:13.590812 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-4cde862d-fecb-4c23-ac2b-2724d7e813c4 None None] For port 6c066f26-0761-4bef-b612-661f04382074, host dv-cinder-789564-2-iscsi, cleared binding levels {{(pid=99028) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 17:48:13.596383 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-4cde862d-fecb-4c23-ac2b-2724d7e813c4 None None] For port 6c066f26-0761-4bef-b612-661f04382074, host dv-cinder-789564-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=6c066f26-0761-4bef-b612-661f04382074,segment=NetworkSegment(471771f9-c462-4865-800d-0d5029e9eb3e),segment_id=471771f9-c462-4865-800d-0d5029e9eb3e)] {{(pid=99028) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 17:48:13.614777 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Provisioning complete for port 32dce052-f792-42ff-94f7-ee823910dc0b triggered by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 17:48:13.615338 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:13.685183 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-bb173b33-f9c4-4b17-8d72-6e9babb2e272 admin admin] Notify callbacks [] for port, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:13.704414 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.provisioning_blocks [None req-bb173b33-f9c4-4b17-8d72-6e9babb2e272 admin admin] Transition to ACTIVE for port object 1d7a4034-86b0-49fb-bf45-68dda95544c2 will not be triggered until provisioned by entity DHCP. {{(pid=99027) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 17:48:13.768837 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4cde862d-fecb-4c23-ac2b-2724d7e813c4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:13.783921 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:48:13.824411 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-bb173b33-f9c4-4b17-8d72-6e9babb2e272 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781840788179', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15468986'] for port, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:13.832274 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:48:13.880777 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4cde862d-fecb-4c23-ac2b-2724d7e813c4 None None] Routers {'ed6451cf-7a08-48a6-b823-dd9d01bcee79'} bound to L3 agent in host dv-cinder-789564-2-iscsi {{(pid=99028) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 17:48:13.881071 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-4cde862d-fecb-4c23-ac2b-2724d7e813c4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcae6c8e130>, 'dv-cinder-789564-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-25T17:34:21Z,description=<?>,heartbeat_timestamp=2021-05-25T17:47:51Z,host='dv-cinder-789564-2-iscsi',id=eaeb6875-c4ed-43b6-8658-aa4e52324fdf,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T17:34:21Z,topic='l3_agent')) {'router_ids': ['ed6451cf-7a08-48a6-b823-dd9d01bcee79'], 'active': True} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:48:13.915964 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bb173b33-f9c4-4b17-8d72-6e9babb2e272 admin admin] Network 7904a86e-e373-4117-97cd-a894d782e3e5 is already hosted by enough agents. {{(pid=99027) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 17:48:13.919764 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.base_scheduler [None req-bb173b33-f9c4-4b17-8d72-6e9babb2e272 admin admin] Resources bound (agent type, host, resource id):  {{(pid=99027) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 17:48:13.926096 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bb173b33-f9c4-4b17-8d72-6e9babb2e272 admin admin] Received port after_create {{(pid=99027) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 17:48:13.952750 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d35ebac-72d2-4683-8434-7c10cdd203cb None None] Pushing event updated for resources: {'Port': ['ID=6c066f26-0761-4bef-b612-661f04382074,revision_number=3']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:48:13.957004 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-3d35ebac-72d2-4683-8434-7c10cdd203cb None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.172s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:48:13.959938 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb173b33-f9c4-4b17-8d72-6e9babb2e272 admin admin] Pushing event updated for resources: {'Port': ['ID=1d7a4034-86b0-49fb-bf45-68dda95544c2,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:48:13.966656 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-bb173b33-f9c4-4b17-8d72-6e9babb2e272 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.135s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:48:13.996701 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-bb173b33-f9c4-4b17-8d72-6e9babb2e272 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-421008'] for router_interface, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:14.094033 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvr_db [None req-4cde862d-fecb-4c23-ac2b-2724d7e813c4 None None] Set router ed6451cf-7a08-48a6-b823-dd9d01bcee79 gateway port host: dv-cinder-789564-2-iscsi {{(pid=99028) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 17:48:14.237737 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-bb173b33-f9c4-4b17-8d72-6e9babb2e272 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:14.399808 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-b7a1e278-3e3d-4bbc-b552-fc88317cf76d None None] Provisioning for port 1d7a4034-86b0-49fb-bf45-68dda95544c2 completed by entity DHCP. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 17:48:14.405406 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-b7a1e278-3e3d-4bbc-b552-fc88317cf76d None None] Provisioning complete for port 1d7a4034-86b0-49fb-bf45-68dda95544c2 triggered by entity DHCP. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 17:48:14.405788 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-b7a1e278-3e3d-4bbc-b552-fc88317cf76d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:14.465721 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.plugin [None req-b7a1e278-3e3d-4bbc-b552-fc88317cf76d None None] Port 1d7a4034-86b0-49fb-bf45-68dda95544c2 cannot update to ACTIVE because it is not bound. {{(pid=99028) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 25 17:48:14.477189 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-4cde862d-fecb-4c23-ac2b-2724d7e813c4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcae6c8e130>, [{'id': 'ed6451cf-7a08-48a6-b823-dd9d01bcee79', 'name': 'tempest-TestMinimumBasicScenario-1304633943-router', 'tenant_id': '79ce7e80f85a4c57896263e5974c8df8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.80'}], 'enable_snat': True}, 'gw_port_id': '6c066f26-0761-4bef-b612-661f04382074', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:48:09Z', 'updated_at': '2021-05-25T17:48:10Z', 'revision_number': 3, 'project_id': '79ce7e80f85a4c57896263e5974c8df8', 'gw_port': {'id': '6c066f26-0761-4bef-b612-661f04382074', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:0c:b5:ed', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ed6451cf-7a08-48a6-b823-dd9d01bcee79', 'device_owner': 'network:router_gateway', 'standard_attr_id': 478, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.80', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:48:10Z', 'updated_at': '2021-05-25T17:48:13Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi'}], 'dv-cinder-789564-2-iscsi', False) {} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:48:14.478300 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-bb173b33-f9c4-4b17-8d72-6e9babb2e272 admin admin] Notify callbacks [] for port, precommit_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:14.484492 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4cde862d-fecb-4c23-ac2b-2724d7e813c4 None None] The sync data for ids ['ed6451cf-7a08-48a6-b823-dd9d01bcee79'] in dv-cinder-789564-2-iscsi is: [{'id': 'ed6451cf-7a08-48a6-b823-dd9d01bcee79', 'name': 'tempest-TestMinimumBasicScenario-1304633943-router', 'tenant_id': '79ce7e80f85a4c57896263e5974c8df8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.80'}], 'enable_snat': True}, 'gw_port_id': '6c066f26-0761-4bef-b612-661f04382074', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:48:09Z', 'updated_at': '2021-05-25T17:48:10Z', 'revision_number': 3, 'project_id': '79ce7e80f85a4c57896263e5974c8df8', 'gw_port': {'id': '6c066f26-0761-4bef-b612-661f04382074', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:0c:b5:ed', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ed6451cf-7a08-48a6-b823-dd9d01bcee79', 'device_owner': 'network:router_gateway', 'standard_attr_id': 478, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.80', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:48:10Z', 'updated_at': '2021-05-25T17:48:13Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi'}] {{(pid=99028) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 25 17:48:14.542069 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-bb173b33-f9c4-4b17-8d72-6e9babb2e272 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15468979'] for port, after_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:14.567961 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-e389e06a-4d6c-4aa0-a0ec-24818b85cd45 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:48:14.648446 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb173b33-f9c4-4b17-8d72-6e9babb2e272 admin admin] Pushing event updated for resources: {'Port': ['ID=1d7a4034-86b0-49fb-bf45-68dda95544c2,revision_number=2']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:48:14.671597 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-bb173b33-f9c4-4b17-8d72-6e9babb2e272 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.104s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:48:14.679747 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-bb173b33-f9c4-4b17-8d72-6e9babb2e272 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-549394', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-420925'] for router_interface, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:14.866163 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bb173b33-f9c4-4b17-8d72-6e9babb2e272 admin admin] Network 7904a86e-e373-4117-97cd-a894d782e3e5 is already hosted by enough agents. {{(pid=99027) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 17:48:14.867410 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.base_scheduler [None req-bb173b33-f9c4-4b17-8d72-6e9babb2e272 admin admin] Resources bound (agent type, host, resource id):  {{(pid=99027) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 17:48:15.070112 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-bb173b33-f9c4-4b17-8d72-6e9babb2e272 admin admin] Router ed6451cf-7a08-48a6-b823-dd9d01bcee79 has already been hosted by L3 agent eaeb6875-c4ed-43b6-8658-aa4e52324fdf {{(pid=99027) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 25 17:48:15.091821 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-6eccbba1-c397-44cc-82b7-3a0fc4daee60 None None] Provisioning complete for port 1d7a4034-86b0-49fb-bf45-68dda95544c2 triggered by entity DHCP. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 17:48:15.092958 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-6eccbba1-c397-44cc-82b7-3a0fc4daee60 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:15.161415 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.plugin [None req-6eccbba1-c397-44cc-82b7-3a0fc4daee60 None None] Port 1d7a4034-86b0-49fb-bf45-68dda95544c2 cannot update to ACTIVE because it is not bound. {{(pid=99028) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 25 17:48:15.272983 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bb173b33-f9c4-4b17-8d72-6e9babb2e272 admin admin] Notify agent at l3_agent.dv-cinder-789564-2-iscsi the message routers_updated {{(pid=99027) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 25 17:48:15.283826 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-bb173b33-f9c4-4b17-8d72-6e9babb2e272 admin admin] 10.222.0.122 "PUT /v2.0/routers/ed6451cf-7a08-48a6-b823-dd9d01bcee79/add_router_interface HTTP/1.1" status: 200  len: 503 time: 2.9192138
May 25 17:48:15.309934 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device 6c066f26-0761-4bef-b612-661f04382074 up at agent ovs-agent-dv-cinder-789564-2-iscsi {{(pid=99028) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 17:48:15.496653 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Provisioning for port 6c066f26-0761-4bef-b612-661f04382074 completed by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 17:48:15.502409 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Provisioning complete for port 6c066f26-0761-4bef-b612-661f04382074 triggered by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 17:48:15.515420 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:15.623447 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:15.640779 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] For port 6c066f26-0761-4bef-b612-661f04382074, host dv-cinder-789564-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=6c066f26-0761-4bef-b612-661f04382074,segment=NetworkSegment(471771f9-c462-4865-800d-0d5029e9eb3e),segment_id=471771f9-c462-4865-800d-0d5029e9eb3e)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:48:15.755484 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:15.758044 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:48:15.826074 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Pushing event updated for resources: {'Port': ['ID=6c066f26-0761-4bef-b612-661f04382074,revision_number=4']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:48:15.829647 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:48:16.086650 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d250b3ec-c179-4604-9ed4-e0ef434640ed None None] Sync routers for ids ['ed6451cf-7a08-48a6-b823-dd9d01bcee79'] in dv-cinder-789564-2-iscsi {{(pid=99029) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 25 17:48:16.096966 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d250b3ec-c179-4604-9ed4-e0ef434640ed None None] Routers {'ed6451cf-7a08-48a6-b823-dd9d01bcee79'} bound to L3 agent in host dv-cinder-789564-2-iscsi {{(pid=99029) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 17:48:16.097615 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_hamode_db [None req-d250b3ec-c179-4604-9ed4-e0ef434640ed None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcae7004370>, 'dv-cinder-789564-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-25T17:34:21Z,description=<?>,heartbeat_timestamp=2021-05-25T17:47:51Z,host='dv-cinder-789564-2-iscsi',id=eaeb6875-c4ed-43b6-8658-aa4e52324fdf,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T17:34:21Z,topic='l3_agent')) {'router_ids': ['ed6451cf-7a08-48a6-b823-dd9d01bcee79'], 'active': True} {{(pid=99029) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:48:16.176742 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 48032) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:48:16.182243 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.v2.base [None req-51411427-e32c-4fa0-aa42-2757a72972e3 admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-1194480117-network', 'tenant_id': '97633fb362914841abbdf8ac783702ad'}} {{(pid=99027) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:48:16.186883 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-51411427-e32c-4fa0-aa42-2757a72972e3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:48:16.190618 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-51411427-e32c-4fa0-aa42-2757a72972e3 admin admin] Usage tracker for resource:network and tenant:97633fb362914841abbdf8ac783702ad is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:48:16.193421 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-51411427-e32c-4fa0-aa42-2757a72972e3 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:48:16.199013 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-51411427-e32c-4fa0-aa42-2757a72972e3 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:48:16.279424 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_dvr_db [None req-d250b3ec-c179-4604-9ed4-e0ef434640ed None None] Set router ed6451cf-7a08-48a6-b823-dd9d01bcee79 gateway port host: dv-cinder-789564-2-iscsi {{(pid=99029) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 17:48:16.348012 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-51411427-e32c-4fa0-aa42-2757a72972e3 admin admin] Made reservation on behalf of 97633fb362914841abbdf8ac783702ad for: {'network': 1} {{(pid=99027) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 17:48:16.350361 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-51411427-e32c-4fa0-aa42-2757a72972e3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-1465344'] for network, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:16.362642 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-51411427-e32c-4fa0-aa42-2757a72972e3 admin admin] Notify callbacks [] for security_group, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:16.377361 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-51411427-e32c-4fa0-aa42-2757a72972e3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:48:16.381227 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-51411427-e32c-4fa0-aa42-2757a72972e3 admin admin] Usage tracker for resource:security_group_rule and tenant:97633fb362914841abbdf8ac783702ad is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:48:16.384072 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-51411427-e32c-4fa0-aa42-2757a72972e3 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:48:16.390474 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-51411427-e32c-4fa0-aa42-2757a72972e3 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:48:16.477781 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-51411427-e32c-4fa0-aa42-2757a72972e3 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:16.593669 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_hamode_db [None req-d250b3ec-c179-4604-9ed4-e0ef434640ed None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcae7004370>, [{'id': 'ed6451cf-7a08-48a6-b823-dd9d01bcee79', 'name': 'tempest-TestMinimumBasicScenario-1304633943-router', 'tenant_id': '79ce7e80f85a4c57896263e5974c8df8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.80'}], 'enable_snat': True}, 'gw_port_id': '6c066f26-0761-4bef-b612-661f04382074', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:48:09Z', 'updated_at': '2021-05-25T17:48:14Z', 'revision_number': 4, 'project_id': '79ce7e80f85a4c57896263e5974c8df8', 'gw_port': {'id': '6c066f26-0761-4bef-b612-661f04382074', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:0c:b5:ed', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ed6451cf-7a08-48a6-b823-dd9d01bcee79', 'device_owner': 'network:router_gateway', 'standard_attr_id': 478, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.80', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:48:10Z', 'updated_at': '2021-05-25T17:48:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi', '_interfaces': [{'id': '1d7a4034-86b0-49fb-bf45-68dda95544c2', 'name': '', 'network_id': '7904a86e-e373-4117-97cd-a894d782e3e5', 'tenant_id': '79ce7e80f85a4c57896263e5974c8df8', 'mac_address': 'fa:16:3e:46:21:20', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ed6451cf-7a08-48a6-b823-dd9d01bcee79', 'device_owner': 'network:router_interface', 'standard_attr_id': 479, 'fixed_ips': [{'subnet_id': '200f371a-f534-452e-9426-951e43bcffe5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:48:13Z', 'updated_at': '2021-05-25T17:48:14Z', 'revision_number': 2, 'project_id': '79ce7e80f85a4c57896263e5974c8df8', 'subnets': [{'id': '200f371a-f534-452e-9426-951e43bcffe5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-789564-2-iscsi', False) {} {{(pid=99029) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:48:16.597488 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d250b3ec-c179-4604-9ed4-e0ef434640ed None None] Checking router: ed6451cf-7a08-48a6-b823-dd9d01bcee79 for host: dv-cinder-789564-2-iscsi {{(pid=99029) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 25 17:48:16.597846 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d250b3ec-c179-4604-9ed4-e0ef434640ed None None] Updating router ed6451cf-7a08-48a6-b823-dd9d01bcee79 port 1d7a4034-86b0-49fb-bf45-68dda95544c2 binding host dv-cinder-789564-2-iscsi {{(pid=99029) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 25 17:48:16.627154 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-51411427-e32c-4fa0-aa42-2757a72972e3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:16.631318 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-13c47f88-42d1-4f19-9d90-2931dc540419 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:48:16.650935 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron_lib.callbacks.manager [None req-d250b3ec-c179-4604-9ed4-e0ef434640ed None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99029) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:16.655570 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-51411427-e32c-4fa0-aa42-2757a72972e3 admin admin] vlan segment allocate from pool success with {'vlan_id': 1322, 'physical_network': 'physnet1'}  {{(pid=99027) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 25 17:48:16.667835 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51411427-e32c-4fa0-aa42-2757a72972e3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=384beb6e-ce7f-4b38-a839-d2e81038fc88,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:48:16.671816 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-51411427-e32c-4fa0-aa42-2757a72972e3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.041s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:48:16.672726 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-51411427-e32c-4fa0-aa42-2757a72972e3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1469168'] for segment, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:16.673050 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.db.segments_db [None req-51411427-e32c-4fa0-aa42-2757a72972e3 admin admin] Added segment 5489ccf8-d699-4f3b-b799-d731b364f968 of type vlan for network 0c323e60-9fa9-440d-b8b6-7d4cb3856e61
May 25 17:48:16.699174 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-51411427-e32c-4fa0-aa42-2757a72972e3 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8781840806997'] for network, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:16.875018 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-51411427-e32c-4fa0-aa42-2757a72972e3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-459299', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551400'] for network, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:16.876359 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-51411427-e32c-4fa0-aa42-2757a72972e3 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:48:16.876961 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-51411427-e32c-4fa0-aa42-2757a72972e3 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for network, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:16.889854 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-144068ab-ac0d-4c3a-a29a-838c35f0f378 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:48:16.984154 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51411427-e32c-4fa0-aa42-2757a72972e3 admin admin] Pushing event updated for resources: {'Network': ['ID=0c323e60-9fa9-440d-b8b6-7d4cb3856e61,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:48:16.986674 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-51411427-e32c-4fa0-aa42-2757a72972e3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.104s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:48:16.994019 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Network 0c323e60-9fa9-440d-b8b6-7d4cb3856e61 details requested by agent ovs-agent-dv-cinder-789564-2-iscsi with host dv-cinder-789564-2-iscsi {{(pid=99028) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 25 17:48:17.016999 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron_lib.callbacks.manager [None req-d250b3ec-c179-4604-9ed4-e0ef434640ed None None] Notify callbacks [] for port, precommit_update {{(pid=99029) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:17.028311 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.provisioning_blocks [None req-d250b3ec-c179-4604-9ed4-e0ef434640ed None None] Transition to ACTIVE for port object 1d7a4034-86b0-49fb-bf45-68dda95544c2 will not be triggered until provisioned by entity L2. {{(pid=99029) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 17:48:17.103685 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-51411427-e32c-4fa0-aa42-2757a72972e3 admin admin] 10.222.0.122 "POST /v2.0/networks HTTP/1.1" status: 201  len: 889 time: 0.9255965
May 25 17:48:17.106112 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 48056) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:48:17.112740 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.v2.base [None req-eb16727b-5f17-44f3-b148-cd5258708758 admin admin] Request body: {'subnet': {'network_id': '0c323e60-9fa9-440d-b8b6-7d4cb3856e61', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-1194480117-subnet', 'tenant_id': '97633fb362914841abbdf8ac783702ad', 'ip_version': 4}} {{(pid=99027) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:48:17.117624 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-eb16727b-5f17-44f3-b148-cd5258708758 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:48:17.121689 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-eb16727b-5f17-44f3-b148-cd5258708758 admin admin] Usage tracker for resource:subnet and tenant:97633fb362914841abbdf8ac783702ad is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:48:17.125407 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-eb16727b-5f17-44f3-b148-cd5258708758 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:48:17.131294 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-eb16727b-5f17-44f3-b148-cd5258708758 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:48:17.136425 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron_lib.callbacks.manager [None req-d250b3ec-c179-4604-9ed4-e0ef434640ed None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99029) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:17.141549 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG oslo_concurrency.lockutils [None req-dbeb910a-808d-4310-a1b7-0890a74557fc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:48:17.235038 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-eb16727b-5f17-44f3-b148-cd5258708758 admin admin] Made reservation on behalf of 97633fb362914841abbdf8ac783702ad for: {'subnet': 1} {{(pid=99027) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 17:48:17.239285 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-eb16727b-5f17-44f3-b148-cd5258708758 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-14778112'] for subnet, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:17.274348 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee6bfbab-b432-47be-ac64-8a014a796be8 None None] Pushing event updated for resources: {'Port': ['ID=1d7a4034-86b0-49fb-bf45-68dda95544c2,revision_number=3']} {{(pid=99029) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:48:17.325234 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee6bfbab-b432-47be-ac64-8a014a796be8 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99029) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:48:17.325575 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee6bfbab-b432-47be-ac64-8a014a796be8 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99029) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:48:17.325906 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee6bfbab-b432-47be-ac64-8a014a796be8 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99029) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:48:17.326232 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee6bfbab-b432-47be-ac64-8a014a796be8 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99029) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:48:17.326569 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee6bfbab-b432-47be-ac64-8a014a796be8 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99029) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:48:17.326896 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee6bfbab-b432-47be-ac64-8a014a796be8 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99029) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:48:17.327206 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee6bfbab-b432-47be-ac64-8a014a796be8 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99029) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:48:17.327671 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee6bfbab-b432-47be-ac64-8a014a796be8 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99029) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:48:17.328010 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee6bfbab-b432-47be-ac64-8a014a796be8 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99029) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:48:17.328330 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee6bfbab-b432-47be-ac64-8a014a796be8 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99029) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:48:17.328649 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee6bfbab-b432-47be-ac64-8a014a796be8 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99029) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:48:17.328958 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee6bfbab-b432-47be-ac64-8a014a796be8 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99029) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:48:17.334750 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG oslo_concurrency.lockutils [None req-ee6bfbab-b432-47be-ac64-8a014a796be8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.193s {{(pid=99029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:48:17.356398 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device 6c066f26-0761-4bef-b612-661f04382074 up at agent ovs-agent-dv-cinder-789564-2-iscsi {{(pid=99028) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 17:48:17.537111 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Provisioning complete for port 6c066f26-0761-4bef-b612-661f04382074 triggered by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 17:48:17.537987 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:17.542900 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.plugins.ml2.managers [None req-d250b3ec-c179-4604-9ed4-e0ef434640ed None None] Attempting to bind port 1d7a4034-86b0-49fb-bf45-68dda95544c2 on host dv-cinder-789564-2-iscsi for vnic_type normal with profile  {{(pid=99029) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 17:48:17.543435 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.plugins.ml2.managers [None req-d250b3ec-c179-4604-9ed4-e0ef434640ed None None] Attempting to bind port 1d7a4034-86b0-49fb-bf45-68dda95544c2 by drivers openvswitch,hyperv on host dv-cinder-789564-2-iscsi at level 0 using segments [{'id': '343b7bea-3acc-4c9d-939f-d8bc9eea2e5e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1319, 'network_id': '7904a86e-e373-4117-97cd-a894d782e3e5'}] {{(pid=99029) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 17:48:17.543904 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d250b3ec-c179-4604-9ed4-e0ef434640ed None None] Attempting to bind port 1d7a4034-86b0-49fb-bf45-68dda95544c2 on network 7904a86e-e373-4117-97cd-a894d782e3e5 {{(pid=99029) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 17:48:17.559050 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d250b3ec-c179-4604-9ed4-e0ef434640ed None None] Checking agent: {'id': '7bb67520-1e97-4ad9-9b97-101068bbe1a3', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-789564-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 17, 34, 21), 'started_at': datetime.datetime(2021, 5, 25, 17, 34, 51), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 17, 47, 51), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-789564-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=99029) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 17:48:17.559050 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d250b3ec-c179-4604-9ed4-e0ef434640ed None None] Checking segment: {'id': '343b7bea-3acc-4c9d-939f-d8bc9eea2e5e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1319, 'network_id': '7904a86e-e373-4117-97cd-a894d782e3e5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=99029) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 17:48:17.559050 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron_lib.callbacks.manager [None req-d250b3ec-c179-4604-9ed4-e0ef434640ed None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=99029) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:17.559050 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d250b3ec-c179-4604-9ed4-e0ef434640ed None None] Bound using segment: {'id': '343b7bea-3acc-4c9d-939f-d8bc9eea2e5e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1319, 'network_id': '7904a86e-e373-4117-97cd-a894d782e3e5'} {{(pid=99029) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 17:48:17.559050 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.plugins.ml2.managers [None req-d250b3ec-c179-4604-9ed4-e0ef434640ed None None] Bound port: 1d7a4034-86b0-49fb-bf45-68dda95544c2, host: dv-cinder-789564-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '343b7bea-3acc-4c9d-939f-d8bc9eea2e5e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1319, 'network_id': '7904a86e-e373-4117-97cd-a894d782e3e5'}}] {{(pid=99029) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 17:48:17.559050 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron_lib.callbacks.manager [None req-d250b3ec-c179-4604-9ed4-e0ef434640ed None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99029) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:17.685009 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.plugins.ml2.db [None req-d250b3ec-c179-4604-9ed4-e0ef434640ed None None] For port 1d7a4034-86b0-49fb-bf45-68dda95544c2, host dv-cinder-789564-2-iscsi, cleared binding levels {{(pid=99029) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 17:48:17.690201 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.plugins.ml2.db [None req-d250b3ec-c179-4604-9ed4-e0ef434640ed None None] For port 1d7a4034-86b0-49fb-bf45-68dda95544c2, host dv-cinder-789564-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=1d7a4034-86b0-49fb-bf45-68dda95544c2,segment=NetworkSegment(343b7bea-3acc-4c9d-939f-d8bc9eea2e5e),segment_id=343b7bea-3acc-4c9d-939f-d8bc9eea2e5e)] {{(pid=99029) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 17:48:17.760190 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron_lib.callbacks.manager [None req-d250b3ec-c179-4604-9ed4-e0ef434640ed None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99029) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:17.764828 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:48:17.849805 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d250b3ec-c179-4604-9ed4-e0ef434640ed None None] Routers {'ed6451cf-7a08-48a6-b823-dd9d01bcee79'} bound to L3 agent in host dv-cinder-789564-2-iscsi {{(pid=99029) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 17:48:17.850453 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_hamode_db [None req-d250b3ec-c179-4604-9ed4-e0ef434640ed None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcae7004370>, 'dv-cinder-789564-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-25T17:34:21Z,description=<?>,heartbeat_timestamp=2021-05-25T17:47:51Z,host='dv-cinder-789564-2-iscsi',id=eaeb6875-c4ed-43b6-8658-aa4e52324fdf,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T17:34:21Z,topic='l3_agent')) {'router_ids': ['ed6451cf-7a08-48a6-b823-dd9d01bcee79'], 'active': True} {{(pid=99029) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:48:17.919034 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee6bfbab-b432-47be-ac64-8a014a796be8 None None] Pushing event updated for resources: {'Port': ['ID=1d7a4034-86b0-49fb-bf45-68dda95544c2,revision_number=4']} {{(pid=99029) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:48:17.929987 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG oslo_concurrency.lockutils [None req-ee6bfbab-b432-47be-ac64-8a014a796be8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.166s {{(pid=99029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:48:18.039591 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-eb16727b-5f17-44f3-b148-cd5258708758 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114466', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-15467018', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-14778134'] for subnet, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:18.045541 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-966321f0-95c5-4e99-810c-e26892c7ef39 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:48:18.052840 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_dvr_db [None req-d250b3ec-c179-4604-9ed4-e0ef434640ed None None] Set router ed6451cf-7a08-48a6-b823-dd9d01bcee79 gateway port host: dv-cinder-789564-2-iscsi {{(pid=99029) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 17:48:18.130321 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb16727b-5f17-44f3-b148-cd5258708758 admin admin] Pushing event updated for resources: {'Subnet': ['ID=f9276786-22d3-46c6-86c0-89de64dcd673,revision_number=0']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:48:18.136526 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-eb16727b-5f17-44f3-b148-cd5258708758 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.090s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:48:18.145850 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eb16727b-5f17-44f3-b148-cd5258708758 admin admin] Checking segment: {'id': '5489ccf8-d699-4f3b-b799-d731b364f968', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1322, 'network_id': '0c323e60-9fa9-440d-b8b6-7d4cb3856e61'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=99027) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 17:48:18.146333 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-eb16727b-5f17-44f3-b148-cd5258708758 admin admin] Network hostable DHCP agents. Network: 0c323e60-9fa9-440d-b8b6-7d4cb3856e61, hostable agents: ['c8b0a350-254b-4562-874b-120ecdef0e25'], hosted agents: [] {{(pid=99027) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 25 17:48:18.148923 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-89cce599-c43b-406f-b112-99489c06d714 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:18.250892 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-eb16727b-5f17-44f3-b148-cd5258708758 admin admin] Network 0c323e60-9fa9-440d-b8b6-7d4cb3856e61 is scheduled to be hosted by DHCP agent c8b0a350-254b-4562-874b-120ecdef0e25 with binding_index 1 {{(pid=99027) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 25 17:48:18.336453 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.base_scheduler [None req-eb16727b-5f17-44f3-b148-cd5258708758 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-789564-2-iscsi, 0c323e60-9fa9-440d-b8b6-7d4cb3856e61) {{(pid=99027) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 17:48:18.346231 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2c26cd43-7040-473e-bc68-e73032defd2e None None] Network 0c323e60-9fa9-440d-b8b6-7d4cb3856e61 requested from dv-cinder-789564-2-iscsi {{(pid=99028) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 17:48:18.350469 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eb16727b-5f17-44f3-b148-cd5258708758 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:48:18.351069 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-eb16727b-5f17-44f3-b148-cd5258708758 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for subnet, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:18.387370 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_hamode_db [None req-d250b3ec-c179-4604-9ed4-e0ef434640ed None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcae7004370>, [{'id': 'ed6451cf-7a08-48a6-b823-dd9d01bcee79', 'name': 'tempest-TestMinimumBasicScenario-1304633943-router', 'tenant_id': '79ce7e80f85a4c57896263e5974c8df8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.80'}], 'enable_snat': True}, 'gw_port_id': '6c066f26-0761-4bef-b612-661f04382074', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:48:09Z', 'updated_at': '2021-05-25T17:48:14Z', 'revision_number': 4, 'project_id': '79ce7e80f85a4c57896263e5974c8df8', 'gw_port': {'id': '6c066f26-0761-4bef-b612-661f04382074', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:0c:b5:ed', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ed6451cf-7a08-48a6-b823-dd9d01bcee79', 'device_owner': 'network:router_gateway', 'standard_attr_id': 478, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.80', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:48:10Z', 'updated_at': '2021-05-25T17:48:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi', '_interfaces': [{'id': '1d7a4034-86b0-49fb-bf45-68dda95544c2', 'name': '', 'network_id': '7904a86e-e373-4117-97cd-a894d782e3e5', 'tenant_id': '79ce7e80f85a4c57896263e5974c8df8', 'mac_address': 'fa:16:3e:46:21:20', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ed6451cf-7a08-48a6-b823-dd9d01bcee79', 'device_owner': 'network:router_interface', 'standard_attr_id': 479, 'fixed_ips': [{'subnet_id': '200f371a-f534-452e-9426-951e43bcffe5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:48:13Z', 'updated_at': '2021-05-25T17:48:17Z', 'revision_number': 4, 'project_id': '79ce7e80f85a4c57896263e5974c8df8', 'subnets': [{'id': '200f371a-f534-452e-9426-951e43bcffe5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-789564-2-iscsi', False) {} {{(pid=99029) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:48:18.392011 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d250b3ec-c179-4604-9ed4-e0ef434640ed None None] The sync data for ids ['ed6451cf-7a08-48a6-b823-dd9d01bcee79'] in dv-cinder-789564-2-iscsi is: [{'id': 'ed6451cf-7a08-48a6-b823-dd9d01bcee79', 'name': 'tempest-TestMinimumBasicScenario-1304633943-router', 'tenant_id': '79ce7e80f85a4c57896263e5974c8df8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.80'}], 'enable_snat': True}, 'gw_port_id': '6c066f26-0761-4bef-b612-661f04382074', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:48:09Z', 'updated_at': '2021-05-25T17:48:14Z', 'revision_number': 4, 'project_id': '79ce7e80f85a4c57896263e5974c8df8', 'gw_port': {'id': '6c066f26-0761-4bef-b612-661f04382074', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:0c:b5:ed', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ed6451cf-7a08-48a6-b823-dd9d01bcee79', 'device_owner': 'network:router_gateway', 'standard_attr_id': 478, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.80', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:48:10Z', 'updated_at': '2021-05-25T17:48:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi', '_interfaces': [{'id': '1d7a4034-86b0-49fb-bf45-68dda95544c2', 'name': '', 'network_id': '7904a86e-e373-4117-97cd-a894d782e3e5', 'tenant_id': '79ce7e80f85a4c57896263e5974c8df8', 'mac_address': 'fa:16:3e:46:21:20', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ed6451cf-7a08-48a6-b823-dd9d01bcee79', 'device_owner': 'network:router_interface', 'standard_attr_id': 479, 'fixed_ips': [{'subnet_id': '200f371a-f534-452e-9426-951e43bcffe5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:48:13Z', 'updated_at': '2021-05-25T17:48:17Z', 'revision_number': 4, 'project_id': '79ce7e80f85a4c57896263e5974c8df8', 'subnets': [{'id': '200f371a-f534-452e-9426-951e43bcffe5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=99029) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 25 17:48:18.480310 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-eb16727b-5f17-44f3-b148-cd5258708758 admin admin] 10.222.0.122 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 851 time: 1.3730304
May 25 17:48:18.483496 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 48090) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:48:18.488611 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.v2.base [None req-88b4d983-9f8e-472f-a9f0-d5a9bfe95ed4 admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-1194480117-router', 'tenant_id': '97633fb362914841abbdf8ac783702ad', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb'}}} {{(pid=99027) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:48:18.493421 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-88b4d983-9f8e-472f-a9f0-d5a9bfe95ed4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:48:18.502214 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-88b4d983-9f8e-472f-a9f0-d5a9bfe95ed4 admin admin] Usage tracker for resource:router and tenant:97633fb362914841abbdf8ac783702ad is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:48:18.505660 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-88b4d983-9f8e-472f-a9f0-d5a9bfe95ed4 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:48:18.515441 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-88b4d983-9f8e-472f-a9f0-d5a9bfe95ed4 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:48:18.676137 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-22651512-fc64-4305-995b-985ad1d3d588 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpe415bc4a-81ee-5198-a7be-1f5e4adc5586-0c323e60-9fa9-440d-b8b6-7d4cb3856e61', 'network_id': '0c323e60-9fa9-440d-b8b6-7d4cb3856e61', 'tenant_id': '97633fb362914841abbdf8ac783702ad', 'fixed_ips': [{'subnet_id': 'f9276786-22d3-46c6-86c0-89de64dcd673'}]}} from dv-cinder-789564-2-iscsi. {{(pid=99028) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
May 25 17:48:18.677343 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-22651512-fc64-4305-995b-985ad1d3d588 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_create {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:18.685766 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-88b4d983-9f8e-472f-a9f0-d5a9bfe95ed4 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-415064', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-6983'] for router, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:18.688296 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-88b4d983-9f8e-472f-a9f0-d5a9bfe95ed4 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-414296', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-419975', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-491114', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-6988'] for router, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:18.709854 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-88b4d983-9f8e-472f-a9f0-d5a9bfe95ed4 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:18.872141 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.db_base_plugin_common [None req-22651512-fc64-4305-995b-985ad1d3d588 None None] Allocated IP 172.20.0.2 (0c323e60-9fa9-440d-b8b6-7d4cb3856e61/f9276786-22d3-46c6-86c0-89de64dcd673/32d152f0-cc43-4ae9-97e2-62ce1b0f21cf) {{(pid=99028) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 17:48:19.119307 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-22651512-fc64-4305-995b-985ad1d3d588 None None] Notify callbacks [] for port, precommit_create {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:19.130769 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-22651512-fc64-4305-995b-985ad1d3d588 None None] Transition to ACTIVE for port object 32d152f0-cc43-4ae9-97e2-62ce1b0f21cf will not be triggered until provisioned by entity L2. {{(pid=99028) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 17:48:19.140049 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-88b4d983-9f8e-472f-a9f0-d5a9bfe95ed4 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-420002', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-415082', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-6970'] for router, precommit_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:19.152117 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-22651512-fc64-4305-995b-985ad1d3d588 None None] Transition to ACTIVE for port object 32d152f0-cc43-4ae9-97e2-62ce1b0f21cf will not be triggered until provisioned by entity DHCP. {{(pid=99028) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 17:48:19.223285 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-22651512-fc64-4305-995b-985ad1d3d588 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781840788179'] for port, after_create {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:19.230066 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:48:19.312155 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-22651512-fc64-4305-995b-985ad1d3d588 None None] Network 0c323e60-9fa9-440d-b8b6-7d4cb3856e61 is already hosted by enough agents. {{(pid=99028) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 17:48:19.315857 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.scheduler.base_scheduler [None req-22651512-fc64-4305-995b-985ad1d3d588 None None] Resources bound (agent type, host, resource id):  {{(pid=99028) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 17:48:19.321352 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvrscheduler_db [None req-22651512-fc64-4305-995b-985ad1d3d588 None None] Received port after_create {{(pid=99028) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 17:48:19.341940 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22651512-fc64-4305-995b-985ad1d3d588 None None] Pushing event updated for resources: {'Port': ['ID=32d152f0-cc43-4ae9-97e2-62ce1b0f21cf,revision_number=1']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:48:19.374892 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-22651512-fc64-4305-995b-985ad1d3d588 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.144s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:48:19.418791 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device 1d7a4034-86b0-49fb-bf45-68dda95544c2 up at agent ovs-agent-dv-cinder-789564-2-iscsi {{(pid=99028) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 17:48:19.491933 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.managers [None req-22651512-fc64-4305-995b-985ad1d3d588 None None] Attempting to bind port 32d152f0-cc43-4ae9-97e2-62ce1b0f21cf on host dv-cinder-789564-2-iscsi for vnic_type normal with profile  {{(pid=99028) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 17:48:19.492584 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.managers [None req-22651512-fc64-4305-995b-985ad1d3d588 None None] Attempting to bind port 32d152f0-cc43-4ae9-97e2-62ce1b0f21cf by drivers openvswitch,hyperv on host dv-cinder-789564-2-iscsi at level 0 using segments [{'id': '5489ccf8-d699-4f3b-b799-d731b364f968', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1322, 'network_id': '0c323e60-9fa9-440d-b8b6-7d4cb3856e61'}] {{(pid=99028) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 17:48:19.492757 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-22651512-fc64-4305-995b-985ad1d3d588 None None] Attempting to bind port 32d152f0-cc43-4ae9-97e2-62ce1b0f21cf on network 0c323e60-9fa9-440d-b8b6-7d4cb3856e61 {{(pid=99028) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 17:48:19.503038 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-22651512-fc64-4305-995b-985ad1d3d588 None None] Checking agent: {'id': '7bb67520-1e97-4ad9-9b97-101068bbe1a3', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-789564-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 17, 34, 21), 'started_at': datetime.datetime(2021, 5, 25, 17, 34, 51), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 17, 47, 51), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-789564-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=99028) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 17:48:19.503421 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-22651512-fc64-4305-995b-985ad1d3d588 None None] Checking segment: {'id': '5489ccf8-d699-4f3b-b799-d731b364f968', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1322, 'network_id': '0c323e60-9fa9-440d-b8b6-7d4cb3856e61'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=99028) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 17:48:19.503842 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-22651512-fc64-4305-995b-985ad1d3d588 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:19.504246 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-22651512-fc64-4305-995b-985ad1d3d588 None None] Bound using segment: {'id': '5489ccf8-d699-4f3b-b799-d731b364f968', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1322, 'network_id': '0c323e60-9fa9-440d-b8b6-7d4cb3856e61'} {{(pid=99028) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 17:48:19.504725 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.managers [None req-22651512-fc64-4305-995b-985ad1d3d588 None None] Bound port: 32d152f0-cc43-4ae9-97e2-62ce1b0f21cf, host: dv-cinder-789564-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5489ccf8-d699-4f3b-b799-d731b364f968', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1322, 'network_id': '0c323e60-9fa9-440d-b8b6-7d4cb3856e61'}}] {{(pid=99028) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 17:48:19.505121 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-22651512-fc64-4305-995b-985ad1d3d588 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:19.602756 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-88b4d983-9f8e-472f-a9f0-d5a9bfe95ed4 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:19.611924 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-22651512-fc64-4305-995b-985ad1d3d588 None None] For port 32d152f0-cc43-4ae9-97e2-62ce1b0f21cf, host dv-cinder-789564-2-iscsi, cleared binding levels {{(pid=99028) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 17:48:19.615354 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-22651512-fc64-4305-995b-985ad1d3d588 None None] For port 32d152f0-cc43-4ae9-97e2-62ce1b0f21cf, host dv-cinder-789564-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=32d152f0-cc43-4ae9-97e2-62ce1b0f21cf,segment=NetworkSegment(5489ccf8-d699-4f3b-b799-d731b364f968),segment_id=5489ccf8-d699-4f3b-b799-d731b364f968)] {{(pid=99028) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 17:48:19.639454 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-88b4d983-9f8e-472f-a9f0-d5a9bfe95ed4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:19.669190 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Provisioning for port 1d7a4034-86b0-49fb-bf45-68dda95544c2 completed by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 17:48:19.674473 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Provisioning complete for port 1d7a4034-86b0-49fb-bf45-68dda95544c2 triggered by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 17:48:19.674856 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:19.706223 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-22651512-fc64-4305-995b-985ad1d3d588 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:19.721044 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-d0032186-1802-49e4-b250-bca64ed38313 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:48:19.787900 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.db_base_plugin_common [None req-88b4d983-9f8e-472f-a9f0-d5a9bfe95ed4 admin admin] Allocated IP 172.27.3.96 (eb7ec72b-a691-481b-8d7e-42c05e13a8cb/d6898f5f-da0b-4428-97b4-4cbe3e83caaa/d0e14de1-78ba-4be4-ab01-9637fae4743c) {{(pid=99027) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 17:48:19.827411 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22651512-fc64-4305-995b-985ad1d3d588 None None] Pushing event updated for resources: {'Port': ['ID=32d152f0-cc43-4ae9-97e2-62ce1b0f21cf,revision_number=2']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:48:19.835629 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-22651512-fc64-4305-995b-985ad1d3d588 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.110s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:48:19.898375 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:19.939531 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] For port 1d7a4034-86b0-49fb-bf45-68dda95544c2, host dv-cinder-789564-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=1d7a4034-86b0-49fb-bf45-68dda95544c2,segment=NetworkSegment(343b7bea-3acc-4c9d-939f-d8bc9eea2e5e),segment_id=343b7bea-3acc-4c9d-939f-d8bc9eea2e5e)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:48:19.972181 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-88b4d983-9f8e-472f-a9f0-d5a9bfe95ed4 admin admin] Notify callbacks [] for port, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:20.011982 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:20.015090 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:48:20.049469 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-88b4d983-9f8e-472f-a9f0-d5a9bfe95ed4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781840788179', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15468986'] for port, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:20.054902 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-84305375-ff97-42ab-a947-ebb5cf02e461 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:48:20.100076 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Pushing event updated for resources: {'Port': ['ID=1d7a4034-86b0-49fb-bf45-68dda95544c2,revision_number=5']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:48:20.103266 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:48:20.125583 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-88b4d983-9f8e-472f-a9f0-d5a9bfe95ed4 admin admin] Network eb7ec72b-a691-481b-8d7e-42c05e13a8cb is already hosted by enough agents. {{(pid=99027) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 17:48:20.128610 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.base_scheduler [None req-88b4d983-9f8e-472f-a9f0-d5a9bfe95ed4 admin admin] Resources bound (agent type, host, resource id):  {{(pid=99027) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 17:48:20.131094 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.l3_dvrscheduler_db [None req-88b4d983-9f8e-472f-a9f0-d5a9bfe95ed4 admin admin] Received port after_create {{(pid=99027) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 17:48:20.167373 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88b4d983-9f8e-472f-a9f0-d5a9bfe95ed4 admin admin] Pushing event updated for resources: {'Port': ['ID=d0e14de1-78ba-4be4-ab01-9637fae4743c,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:48:20.170044 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-88b4d983-9f8e-472f-a9f0-d5a9bfe95ed4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.115s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:48:20.679486 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-aaff5bbc-ba1a-4cdb-88a7-989aa27783a6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:20.715611 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ba40039f-840a-4962-9a3b-2d92ca936081 None None] Network 0c323e60-9fa9-440d-b8b6-7d4cb3856e61 requested from dv-cinder-789564-2-iscsi {{(pid=99028) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 17:48:20.756762 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-88b4d983-9f8e-472f-a9f0-d5a9bfe95ed4 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:20.897501 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:20.921337 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-8b84adc0-e840-438d-8fa4-bd4f6858c9f7 None None] Provisioning for port 32d152f0-cc43-4ae9-97e2-62ce1b0f21cf completed by entity DHCP. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 17:48:21.138107 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-88b4d983-9f8e-472f-a9f0-d5a9bfe95ed4 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-415057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-420065'] for router, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:21.375304 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device 1d7a4034-86b0-49fb-bf45-68dda95544c2 up at agent ovs-agent-dv-cinder-789564-2-iscsi {{(pid=99028) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 17:48:21.445683 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Provisioning complete for port 1d7a4034-86b0-49fb-bf45-68dda95544c2 triggered by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 17:48:21.446056 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:21.453599 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-88b4d983-9f8e-472f-a9f0-d5a9bfe95ed4 admin admin] Router f5989ab6-97cf-4e25-b382-1dbcb19a08fa is scheduled to L3 agent eaeb6875-c4ed-43b6-8658-aa4e52324fdf with binding_index 1 {{(pid=99027) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
May 25 17:48:21.573616 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device 32d152f0-cc43-4ae9-97e2-62ce1b0f21cf up at agent ovs-agent-dv-cinder-789564-2-iscsi {{(pid=99028) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 17:48:21.642860 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-88b4d983-9f8e-472f-a9f0-d5a9bfe95ed4 admin admin] Notify agent at l3_agent.dv-cinder-789564-2-iscsi the message routers_updated {{(pid=99027) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 25 17:48:21.651934 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-92e83cab-df20-42f2-adaa-fc63d355330f None None] Sync routers for ids ['f5989ab6-97cf-4e25-b382-1dbcb19a08fa'] in dv-cinder-789564-2-iscsi {{(pid=99028) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 25 17:48:21.661896 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvrscheduler_db [None req-92e83cab-df20-42f2-adaa-fc63d355330f None None] Routers {'f5989ab6-97cf-4e25-b382-1dbcb19a08fa'} bound to L3 agent in host dv-cinder-789564-2-iscsi {{(pid=99028) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 17:48:21.662612 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-92e83cab-df20-42f2-adaa-fc63d355330f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcae6d51ca0>, 'dv-cinder-789564-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-25T17:34:21Z,description=<?>,heartbeat_timestamp=2021-05-25T17:48:21Z,host='dv-cinder-789564-2-iscsi',id=eaeb6875-c4ed-43b6-8658-aa4e52324fdf,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T17:34:21Z,topic='l3_agent')) {'router_ids': ['f5989ab6-97cf-4e25-b382-1dbcb19a08fa'], 'active': True} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:48:21.719765 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-7e261f94-b84f-443e-be49-3bc1ac903b55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:21.759063 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Provisioning for port 32d152f0-cc43-4ae9-97e2-62ce1b0f21cf completed by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 17:48:21.760944 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-88b4d983-9f8e-472f-a9f0-d5a9bfe95ed4 admin admin] Notify callbacks [] for router, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:21.762519 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-88b4d983-9f8e-472f-a9f0-d5a9bfe95ed4 admin admin] 10.222.0.122 "POST /v2.0/routers HTTP/1.1" status: 201  len: 926 time: 3.2779813
May 25 17:48:21.777968 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 48124) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:48:21.778207 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Provisioning complete for port 32d152f0-cc43-4ae9-97e2-62ce1b0f21cf triggered by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 17:48:21.778207 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:21.958128 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvr_db [None req-92e83cab-df20-42f2-adaa-fc63d355330f None None] Set router f5989ab6-97cf-4e25-b382-1dbcb19a08fa gateway port host: dv-cinder-789564-2-iscsi {{(pid=99028) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 17:48:22.169676 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:22.231900 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] For port 32d152f0-cc43-4ae9-97e2-62ce1b0f21cf, host dv-cinder-789564-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=32d152f0-cc43-4ae9-97e2-62ce1b0f21cf,segment=NetworkSegment(5489ccf8-d699-4f3b-b799-d731b364f968),segment_id=5489ccf8-d699-4f3b-b799-d731b364f968)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:48:22.304183 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-92e83cab-df20-42f2-adaa-fc63d355330f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcae6d51ca0>, [{'id': 'f5989ab6-97cf-4e25-b382-1dbcb19a08fa', 'name': 'tempest-TestMinimumBasicScenario-1194480117-router', 'tenant_id': '97633fb362914841abbdf8ac783702ad', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.96'}], 'enable_snat': True}, 'gw_port_id': 'd0e14de1-78ba-4be4-ab01-9637fae4743c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:48:18Z', 'updated_at': '2021-05-25T17:48:20Z', 'revision_number': 3, 'project_id': '97633fb362914841abbdf8ac783702ad', 'gw_port': {'id': 'd0e14de1-78ba-4be4-ab01-9637fae4743c', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:71:d4:5b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f5989ab6-97cf-4e25-b382-1dbcb19a08fa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 490, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.96', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:48:19Z', 'updated_at': '2021-05-25T17:48:19Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi'}], 'dv-cinder-789564-2-iscsi', False) {} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:48:22.307651 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-92e83cab-df20-42f2-adaa-fc63d355330f None None] Checking router: f5989ab6-97cf-4e25-b382-1dbcb19a08fa for host: dv-cinder-789564-2-iscsi {{(pid=99028) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 25 17:48:22.308010 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-92e83cab-df20-42f2-adaa-fc63d355330f None None] Updating router f5989ab6-97cf-4e25-b382-1dbcb19a08fa port d0e14de1-78ba-4be4-ab01-9637fae4743c binding host dv-cinder-789564-2-iscsi {{(pid=99028) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 25 17:48:22.336308 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:22.349377 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-5eb65ca6-f074-4b97-bf0e-05fd6c06aa9c None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:48:22.424704 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-92e83cab-df20-42f2-adaa-fc63d355330f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:22.473508 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Pushing event updated for resources: {'Port': ['ID=32d152f0-cc43-4ae9-97e2-62ce1b0f21cf,revision_number=3']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:48:22.478431 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.129s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:48:22.589383 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-9dd1d841-7ccb-4484-b27b-74938eb3e8b7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:22.772272 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-92e83cab-df20-42f2-adaa-fc63d355330f None None] Notify callbacks [] for port, precommit_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:22.785964 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-92e83cab-df20-42f2-adaa-fc63d355330f None None] Transition to ACTIVE for port object d0e14de1-78ba-4be4-ab01-9637fae4743c will not be triggered until provisioned by entity L2. {{(pid=99028) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 17:48:22.803936 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.db_base_plugin_common [None req-9dd1d841-7ccb-4484-b27b-74938eb3e8b7 admin admin] Allocated IP 172.20.0.1 (0c323e60-9fa9-440d-b8b6-7d4cb3856e61/f9276786-22d3-46c6-86c0-89de64dcd673/b9d25e74-356d-4468-b89b-65b6dcd07430) {{(pid=99027) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 17:48:22.885788 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-92e83cab-df20-42f2-adaa-fc63d355330f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:22.891449 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:48:22.960091 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-9dd1d841-7ccb-4484-b27b-74938eb3e8b7 admin admin] Notify callbacks [] for port, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:22.973805 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.managers [None req-92e83cab-df20-42f2-adaa-fc63d355330f None None] Attempting to bind port d0e14de1-78ba-4be4-ab01-9637fae4743c on host dv-cinder-789564-2-iscsi for vnic_type normal with profile  {{(pid=99028) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 17:48:22.973805 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.managers [None req-92e83cab-df20-42f2-adaa-fc63d355330f None None] Attempting to bind port d0e14de1-78ba-4be4-ab01-9637fae4743c by drivers openvswitch,hyperv on host dv-cinder-789564-2-iscsi at level 0 using segments [{'id': '471771f9-c462-4865-800d-0d5029e9eb3e', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb'}] {{(pid=99028) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 17:48:22.973805 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-92e83cab-df20-42f2-adaa-fc63d355330f None None] Attempting to bind port d0e14de1-78ba-4be4-ab01-9637fae4743c on network eb7ec72b-a691-481b-8d7e-42c05e13a8cb {{(pid=99028) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 17:48:22.976802 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.provisioning_blocks [None req-9dd1d841-7ccb-4484-b27b-74938eb3e8b7 admin admin] Transition to ACTIVE for port object b9d25e74-356d-4468-b89b-65b6dcd07430 will not be triggered until provisioned by entity DHCP. {{(pid=99027) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 17:48:22.978447 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59fd63d7-e8a8-4884-b762-b9a1f7fd1111 None None] Pushing event updated for resources: {'Port': ['ID=d0e14de1-78ba-4be4-ab01-9637fae4743c,revision_number=2']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:48:22.982547 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-59fd63d7-e8a8-4884-b762-b9a1f7fd1111 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:48:22.984041 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-92e83cab-df20-42f2-adaa-fc63d355330f None None] Checking agent: {'id': '7bb67520-1e97-4ad9-9b97-101068bbe1a3', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-789564-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 17, 34, 21), 'started_at': datetime.datetime(2021, 5, 25, 17, 34, 51), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 17, 48, 21), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-789564-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=99028) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 17:48:22.984434 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-92e83cab-df20-42f2-adaa-fc63d355330f None None] Checking segment: {'id': '471771f9-c462-4865-800d-0d5029e9eb3e', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=99028) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 17:48:22.984828 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-92e83cab-df20-42f2-adaa-fc63d355330f None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:22.985253 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-92e83cab-df20-42f2-adaa-fc63d355330f None None] Bound using segment: {'id': '471771f9-c462-4865-800d-0d5029e9eb3e', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb'} {{(pid=99028) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 17:48:22.985946 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.managers [None req-92e83cab-df20-42f2-adaa-fc63d355330f None None] Bound port: d0e14de1-78ba-4be4-ab01-9637fae4743c, host: dv-cinder-789564-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '471771f9-c462-4865-800d-0d5029e9eb3e', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb'}}] {{(pid=99028) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 17:48:22.986185 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-92e83cab-df20-42f2-adaa-fc63d355330f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:23.058443 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-92e83cab-df20-42f2-adaa-fc63d355330f None None] For port d0e14de1-78ba-4be4-ab01-9637fae4743c, host dv-cinder-789564-2-iscsi, cleared binding levels {{(pid=99028) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 17:48:23.061593 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-92e83cab-df20-42f2-adaa-fc63d355330f None None] For port d0e14de1-78ba-4be4-ab01-9637fae4743c, host dv-cinder-789564-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=d0e14de1-78ba-4be4-ab01-9637fae4743c,segment=NetworkSegment(471771f9-c462-4865-800d-0d5029e9eb3e),segment_id=471771f9-c462-4865-800d-0d5029e9eb3e)] {{(pid=99028) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 17:48:23.085757 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-9dd1d841-7ccb-4484-b27b-74938eb3e8b7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781840788179', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15468986'] for port, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:23.089613 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-88b4d983-9f8e-472f-a9f0-d5a9bfe95ed4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:48:23.148167 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-92e83cab-df20-42f2-adaa-fc63d355330f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:23.152892 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:48:23.155242 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9dd1d841-7ccb-4484-b27b-74938eb3e8b7 admin admin] Network 0c323e60-9fa9-440d-b8b6-7d4cb3856e61 is already hosted by enough agents. {{(pid=99027) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 17:48:23.158208 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.base_scheduler [None req-9dd1d841-7ccb-4484-b27b-74938eb3e8b7 admin admin] Resources bound (agent type, host, resource id):  {{(pid=99027) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 17:48:23.161724 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9dd1d841-7ccb-4484-b27b-74938eb3e8b7 admin admin] Received port after_create {{(pid=99027) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 17:48:23.197641 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dd1d841-7ccb-4484-b27b-74938eb3e8b7 admin admin] Pushing event updated for resources: {'Port': ['ID=b9d25e74-356d-4468-b89b-65b6dcd07430,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:48:23.203754 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-9dd1d841-7ccb-4484-b27b-74938eb3e8b7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.114s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:48:23.235350 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-9dd1d841-7ccb-4484-b27b-74938eb3e8b7 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-421008'] for router_interface, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:23.258116 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvrscheduler_db [None req-92e83cab-df20-42f2-adaa-fc63d355330f None None] Routers {'f5989ab6-97cf-4e25-b382-1dbcb19a08fa'} bound to L3 agent in host dv-cinder-789564-2-iscsi {{(pid=99028) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 17:48:23.258758 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-92e83cab-df20-42f2-adaa-fc63d355330f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcae6d51ca0>, 'dv-cinder-789564-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-25T17:34:21Z,description=<?>,heartbeat_timestamp=2021-05-25T17:48:21Z,host='dv-cinder-789564-2-iscsi',id=eaeb6875-c4ed-43b6-8658-aa4e52324fdf,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T17:34:21Z,topic='l3_agent')) {'router_ids': ['f5989ab6-97cf-4e25-b382-1dbcb19a08fa'], 'active': True} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:48:23.354062 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59fd63d7-e8a8-4884-b762-b9a1f7fd1111 None None] Pushing event updated for resources: {'Port': ['ID=d0e14de1-78ba-4be4-ab01-9637fae4743c,revision_number=3']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:48:23.367271 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device 32d152f0-cc43-4ae9-97e2-62ce1b0f21cf up at agent ovs-agent-dv-cinder-789564-2-iscsi {{(pid=99028) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 17:48:23.442311 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-59fd63d7-e8a8-4884-b762-b9a1f7fd1111 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.289s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:48:23.446217 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-6df2b2a7-a54e-4d57-9be3-033078b9d5b3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:23.450589 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-9dd1d841-7ccb-4484-b27b-74938eb3e8b7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:23.483602 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 48146) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:48:23.590441 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvr_db [None req-92e83cab-df20-42f2-adaa-fc63d355330f None None] Set router f5989ab6-97cf-4e25-b382-1dbcb19a08fa gateway port host: dv-cinder-789564-2-iscsi {{(pid=99028) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 17:48:23.635569 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-c9479806-ee0d-43e0-ad73-2abec8db8f6c admin admin] Notify callbacks [] for security_group, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:23.652502 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-c9479806-ee0d-43e0-ad73-2abec8db8f6c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:48:23.657665 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-c9479806-ee0d-43e0-ad73-2abec8db8f6c admin admin] Usage tracker for resource:security_group_rule and tenant:8535aa864e0b47789c5567f1556bcd9a is out of sync, need to count used quota {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:48:23.660834 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-c9479806-ee0d-43e0-ad73-2abec8db8f6c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:48:23.670042 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-c9479806-ee0d-43e0-ad73-2abec8db8f6c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:48:23.678793 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-8f704413-663c-4f5d-bbdf-7ad49b21fd01 None None] Provisioning for port b9d25e74-356d-4468-b89b-65b6dcd07430 completed by entity DHCP. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 17:48:23.700475 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-9dd1d841-7ccb-4484-b27b-74938eb3e8b7 admin admin] Notify callbacks [] for port, precommit_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:23.741395 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Provisioning complete for port 32d152f0-cc43-4ae9-97e2-62ce1b0f21cf triggered by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 17:48:23.741769 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:23.765320 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-c9479806-ee0d-43e0-ad73-2abec8db8f6c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:23.786789 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-8f704413-663c-4f5d-bbdf-7ad49b21fd01 None None] Provisioning complete for port b9d25e74-356d-4468-b89b-65b6dcd07430 triggered by entity DHCP. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 17:48:23.787371 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-8f704413-663c-4f5d-bbdf-7ad49b21fd01 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:23.787977 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-9dd1d841-7ccb-4484-b27b-74938eb3e8b7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15468979'] for port, after_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:23.815958 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:48:23.845513 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-c9479806-ee0d-43e0-ad73-2abec8db8f6c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:23.859194 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-8172b226-382c-417f-9669-fc758838ac67 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:48:23.896053 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-c9479806-ee0d-43e0-ad73-2abec8db8f6c admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=8535aa864e0b47789c5567f1556bcd9a&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4113660
May 25 17:48:23.898842 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 48152) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:48:23.902078 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-9dd1d841-7ccb-4484-b27b-74938eb3e8b7 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-549394', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-420925'] for router_interface, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:23.903048 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9479806-ee0d-43e0-ad73-2abec8db8f6c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d6647b82-676b-4ecb-85f9-a1cea9e0bc8b,revision_number=1']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:48:23.905713 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dd1d841-7ccb-4484-b27b-74938eb3e8b7 admin admin] Pushing event updated for resources: {'Port': ['ID=b9d25e74-356d-4468-b89b-65b6dcd07430,revision_number=2']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:48:23.918171 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-c9479806-ee0d-43e0-ad73-2abec8db8f6c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.059s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:48:23.919225 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-9dd1d841-7ccb-4484-b27b-74938eb3e8b7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.103s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:48:23.925539 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.plugin [None req-8f704413-663c-4f5d-bbdf-7ad49b21fd01 None None] Port b9d25e74-356d-4468-b89b-65b6dcd07430 cannot update to ACTIVE because it is not bound. {{(pid=99028) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 25 17:48:24.092914 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-92e83cab-df20-42f2-adaa-fc63d355330f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcae6d51ca0>, [{'id': 'f5989ab6-97cf-4e25-b382-1dbcb19a08fa', 'name': 'tempest-TestMinimumBasicScenario-1194480117-router', 'tenant_id': '97633fb362914841abbdf8ac783702ad', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.96'}], 'enable_snat': True}, 'gw_port_id': 'd0e14de1-78ba-4be4-ab01-9637fae4743c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:48:18Z', 'updated_at': '2021-05-25T17:48:20Z', 'revision_number': 3, 'project_id': '97633fb362914841abbdf8ac783702ad', 'gw_port': {'id': 'd0e14de1-78ba-4be4-ab01-9637fae4743c', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:71:d4:5b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f5989ab6-97cf-4e25-b382-1dbcb19a08fa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 490, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.96', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:48:19Z', 'updated_at': '2021-05-25T17:48:23Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi'}], 'dv-cinder-789564-2-iscsi', False) {} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:48:24.096899 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-92e83cab-df20-42f2-adaa-fc63d355330f None None] The sync data for ids ['f5989ab6-97cf-4e25-b382-1dbcb19a08fa'] in dv-cinder-789564-2-iscsi is: [{'id': 'f5989ab6-97cf-4e25-b382-1dbcb19a08fa', 'name': 'tempest-TestMinimumBasicScenario-1194480117-router', 'tenant_id': '97633fb362914841abbdf8ac783702ad', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.96'}], 'enable_snat': True}, 'gw_port_id': 'd0e14de1-78ba-4be4-ab01-9637fae4743c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:48:18Z', 'updated_at': '2021-05-25T17:48:20Z', 'revision_number': 3, 'project_id': '97633fb362914841abbdf8ac783702ad', 'gw_port': {'id': 'd0e14de1-78ba-4be4-ab01-9637fae4743c', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:71:d4:5b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f5989ab6-97cf-4e25-b382-1dbcb19a08fa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 490, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.96', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:48:19Z', 'updated_at': '2021-05-25T17:48:23Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi'}] {{(pid=99028) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 25 17:48:24.156213 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-d11adb0b-49e5-4727-9a75-f059568b40b3 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:24.204884 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-d11adb0b-49e5-4727-9a75-f059568b40b3 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:24.228571 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9dd1d841-7ccb-4484-b27b-74938eb3e8b7 admin admin] Network 0c323e60-9fa9-440d-b8b6-7d4cb3856e61 is already hosted by enough agents. {{(pid=99027) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 17:48:24.232179 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.base_scheduler [None req-9dd1d841-7ccb-4484-b27b-74938eb3e8b7 admin admin] Resources bound (agent type, host, resource id):  {{(pid=99027) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 17:48:24.483800 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9dd1d841-7ccb-4484-b27b-74938eb3e8b7 admin admin] Router f5989ab6-97cf-4e25-b382-1dbcb19a08fa has already been hosted by L3 agent eaeb6875-c4ed-43b6-8658-aa4e52324fdf {{(pid=99027) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 25 17:48:24.550870 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-d11adb0b-49e5-4727-9a75-f059568b40b3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:24.562985 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-4da68357-fd06-4152-a376-e14c7139ddb3 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:48:24.564174 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-d413ba5e-0c8b-46ac-88de-57c8316a2bab None None] Provisioning complete for port b9d25e74-356d-4468-b89b-65b6dcd07430 triggered by entity DHCP. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 17:48:24.564624 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-d413ba5e-0c8b-46ac-88de-57c8316a2bab None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:24.590641 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d11adb0b-49e5-4727-9a75-f059568b40b3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d6647b82-676b-4ecb-85f9-a1cea9e0bc8b,revision_number=None']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:48:24.596999 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-d11adb0b-49e5-4727-9a75-f059568b40b3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.033s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:48:24.647278 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.plugin [None req-d413ba5e-0c8b-46ac-88de-57c8316a2bab None None] Port b9d25e74-356d-4468-b89b-65b6dcd07430 cannot update to ACTIVE because it is not bound. {{(pid=99028) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 25 17:48:24.662848 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-d11adb0b-49e5-4727-9a75-f059568b40b3 admin admin] Notify callbacks [] for security_group, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:24.664281 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-d11adb0b-49e5-4727-9a75-f059568b40b3 admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/d6647b82-676b-4ecb-85f9-a1cea9e0bc8b HTTP/1.1" status: 204  len: 168 time: 0.7645733
May 25 17:48:24.714027 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9dd1d841-7ccb-4484-b27b-74938eb3e8b7 admin admin] Notify agent at l3_agent.dv-cinder-789564-2-iscsi the message routers_updated {{(pid=99027) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 25 17:48:24.722536 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-9dd1d841-7ccb-4484-b27b-74938eb3e8b7 admin admin] 10.222.0.122 "PUT /v2.0/routers/f5989ab6-97cf-4e25-b382-1dbcb19a08fa/add_router_interface HTTP/1.1" status: 200  len: 503 time: 2.9550204
May 25 17:48:25.324010 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device d0e14de1-78ba-4be4-ab01-9637fae4743c up at agent ovs-agent-dv-cinder-789564-2-iscsi {{(pid=99028) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 17:48:25.457589 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Provisioning for port d0e14de1-78ba-4be4-ab01-9637fae4743c completed by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 17:48:25.463606 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Provisioning complete for port d0e14de1-78ba-4be4-ab01-9637fae4743c triggered by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 17:48:25.463983 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:25.602537 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:25.626784 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] For port d0e14de1-78ba-4be4-ab01-9637fae4743c, host dv-cinder-789564-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=d0e14de1-78ba-4be4-ab01-9637fae4743c,segment=NetworkSegment(471771f9-c462-4865-800d-0d5029e9eb3e),segment_id=471771f9-c462-4865-800d-0d5029e9eb3e)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:48:25.685293 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:25.687774 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-2f51fe2b-b9ae-49f6-9a08-7db018f3258b None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:48:25.765871 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Pushing event updated for resources: {'Port': ['ID=d0e14de1-78ba-4be4-ab01-9637fae4743c,revision_number=4']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:48:25.768823 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:48:25.888494 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ab5a7d46-fa4c-4b9e-92d9-b1ad000e5483 None None] Sync routers for ids ['f5989ab6-97cf-4e25-b382-1dbcb19a08fa'] in dv-cinder-789564-2-iscsi {{(pid=99029) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 25 17:48:25.898298 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ab5a7d46-fa4c-4b9e-92d9-b1ad000e5483 None None] Routers {'f5989ab6-97cf-4e25-b382-1dbcb19a08fa'} bound to L3 agent in host dv-cinder-789564-2-iscsi {{(pid=99029) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 17:48:25.898892 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_hamode_db [None req-ab5a7d46-fa4c-4b9e-92d9-b1ad000e5483 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcae6d349d0>, 'dv-cinder-789564-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-25T17:34:21Z,description=<?>,heartbeat_timestamp=2021-05-25T17:48:21Z,host='dv-cinder-789564-2-iscsi',id=eaeb6875-c4ed-43b6-8658-aa4e52324fdf,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T17:34:21Z,topic='l3_agent')) {'router_ids': ['f5989ab6-97cf-4e25-b382-1dbcb19a08fa'], 'active': True} {{(pid=99029) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:48:26.097188 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_dvr_db [None req-ab5a7d46-fa4c-4b9e-92d9-b1ad000e5483 None None] Set router f5989ab6-97cf-4e25-b382-1dbcb19a08fa gateway port host: dv-cinder-789564-2-iscsi {{(pid=99029) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 17:48:26.446086 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_hamode_db [None req-ab5a7d46-fa4c-4b9e-92d9-b1ad000e5483 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcae6d349d0>, [{'id': 'f5989ab6-97cf-4e25-b382-1dbcb19a08fa', 'name': 'tempest-TestMinimumBasicScenario-1194480117-router', 'tenant_id': '97633fb362914841abbdf8ac783702ad', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.96'}], 'enable_snat': True}, 'gw_port_id': 'd0e14de1-78ba-4be4-ab01-9637fae4743c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:48:18Z', 'updated_at': '2021-05-25T17:48:23Z', 'revision_number': 4, 'project_id': '97633fb362914841abbdf8ac783702ad', 'gw_port': {'id': 'd0e14de1-78ba-4be4-ab01-9637fae4743c', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:71:d4:5b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f5989ab6-97cf-4e25-b382-1dbcb19a08fa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 490, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.96', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:48:19Z', 'updated_at': '2021-05-25T17:48:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi', '_interfaces': [{'id': 'b9d25e74-356d-4468-b89b-65b6dcd07430', 'name': '', 'network_id': '0c323e60-9fa9-440d-b8b6-7d4cb3856e61', 'tenant_id': '97633fb362914841abbdf8ac783702ad', 'mac_address': 'fa:16:3e:6a:d3:af', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f5989ab6-97cf-4e25-b382-1dbcb19a08fa', 'device_owner': 'network:router_interface', 'standard_attr_id': 491, 'fixed_ips': [{'subnet_id': 'f9276786-22d3-46c6-86c0-89de64dcd673', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:48:22Z', 'updated_at': '2021-05-25T17:48:23Z', 'revision_number': 2, 'project_id': '97633fb362914841abbdf8ac783702ad', 'subnets': [{'id': 'f9276786-22d3-46c6-86c0-89de64dcd673', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-789564-2-iscsi', False) {} {{(pid=99029) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:48:26.450159 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ab5a7d46-fa4c-4b9e-92d9-b1ad000e5483 None None] Checking router: f5989ab6-97cf-4e25-b382-1dbcb19a08fa for host: dv-cinder-789564-2-iscsi {{(pid=99029) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 25 17:48:26.450734 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ab5a7d46-fa4c-4b9e-92d9-b1ad000e5483 None None] Updating router f5989ab6-97cf-4e25-b382-1dbcb19a08fa port b9d25e74-356d-4468-b89b-65b6dcd07430 binding host dv-cinder-789564-2-iscsi {{(pid=99029) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 25 17:48:26.509010 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron_lib.callbacks.manager [None req-ab5a7d46-fa4c-4b9e-92d9-b1ad000e5483 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99029) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:26.966706 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron_lib.callbacks.manager [None req-ab5a7d46-fa4c-4b9e-92d9-b1ad000e5483 None None] Notify callbacks [] for port, precommit_update {{(pid=99029) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:26.982440 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.provisioning_blocks [None req-ab5a7d46-fa4c-4b9e-92d9-b1ad000e5483 None None] Transition to ACTIVE for port object b9d25e74-356d-4468-b89b-65b6dcd07430 will not be triggered until provisioned by entity L2. {{(pid=99029) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 17:48:27.069797 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron_lib.callbacks.manager [None req-ab5a7d46-fa4c-4b9e-92d9-b1ad000e5483 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99029) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:27.074234 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:48:27.231235 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8aa73c03-67a1-4f23-8cc2-e55bea9bc2f1 None None] Pushing event updated for resources: {'Port': ['ID=b9d25e74-356d-4468-b89b-65b6dcd07430,revision_number=3']} {{(pid=99029) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:48:27.238647 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG oslo_concurrency.lockutils [None req-8aa73c03-67a1-4f23-8cc2-e55bea9bc2f1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.164s {{(pid=99029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:48:27.325361 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.plugins.ml2.managers [None req-ab5a7d46-fa4c-4b9e-92d9-b1ad000e5483 None None] Attempting to bind port b9d25e74-356d-4468-b89b-65b6dcd07430 on host dv-cinder-789564-2-iscsi for vnic_type normal with profile  {{(pid=99029) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 17:48:27.325871 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.plugins.ml2.managers [None req-ab5a7d46-fa4c-4b9e-92d9-b1ad000e5483 None None] Attempting to bind port b9d25e74-356d-4468-b89b-65b6dcd07430 by drivers openvswitch,hyperv on host dv-cinder-789564-2-iscsi at level 0 using segments [{'id': '5489ccf8-d699-4f3b-b799-d731b364f968', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1322, 'network_id': '0c323e60-9fa9-440d-b8b6-7d4cb3856e61'}] {{(pid=99029) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 17:48:27.326295 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ab5a7d46-fa4c-4b9e-92d9-b1ad000e5483 None None] Attempting to bind port b9d25e74-356d-4468-b89b-65b6dcd07430 on network 0c323e60-9fa9-440d-b8b6-7d4cb3856e61 {{(pid=99029) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 17:48:27.332804 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ab5a7d46-fa4c-4b9e-92d9-b1ad000e5483 None None] Checking agent: {'id': '7bb67520-1e97-4ad9-9b97-101068bbe1a3', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-789564-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 17, 34, 21), 'started_at': datetime.datetime(2021, 5, 25, 17, 34, 51), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 17, 48, 21), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-789564-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=99029) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 17:48:27.332998 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ab5a7d46-fa4c-4b9e-92d9-b1ad000e5483 None None] Checking segment: {'id': '5489ccf8-d699-4f3b-b799-d731b364f968', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1322, 'network_id': '0c323e60-9fa9-440d-b8b6-7d4cb3856e61'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=99029) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 17:48:27.333386 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron_lib.callbacks.manager [None req-ab5a7d46-fa4c-4b9e-92d9-b1ad000e5483 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=99029) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:27.333773 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ab5a7d46-fa4c-4b9e-92d9-b1ad000e5483 None None] Bound using segment: {'id': '5489ccf8-d699-4f3b-b799-d731b364f968', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1322, 'network_id': '0c323e60-9fa9-440d-b8b6-7d4cb3856e61'} {{(pid=99029) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 17:48:27.334709 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.plugins.ml2.managers [None req-ab5a7d46-fa4c-4b9e-92d9-b1ad000e5483 None None] Bound port: b9d25e74-356d-4468-b89b-65b6dcd07430, host: dv-cinder-789564-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5489ccf8-d699-4f3b-b799-d731b364f968', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1322, 'network_id': '0c323e60-9fa9-440d-b8b6-7d4cb3856e61'}}] {{(pid=99029) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 17:48:27.335206 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron_lib.callbacks.manager [None req-ab5a7d46-fa4c-4b9e-92d9-b1ad000e5483 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99029) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:27.351216 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device d0e14de1-78ba-4be4-ab01-9637fae4743c up at agent ovs-agent-dv-cinder-789564-2-iscsi {{(pid=99028) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 17:48:27.457702 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Provisioning complete for port d0e14de1-78ba-4be4-ab01-9637fae4743c triggered by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 17:48:27.458133 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:27.486942 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.plugins.ml2.db [None req-ab5a7d46-fa4c-4b9e-92d9-b1ad000e5483 None None] For port b9d25e74-356d-4468-b89b-65b6dcd07430, host dv-cinder-789564-2-iscsi, cleared binding levels {{(pid=99029) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 17:48:27.490775 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.plugins.ml2.db [None req-ab5a7d46-fa4c-4b9e-92d9-b1ad000e5483 None None] For port b9d25e74-356d-4468-b89b-65b6dcd07430, host dv-cinder-789564-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=b9d25e74-356d-4468-b89b-65b6dcd07430,segment=NetworkSegment(5489ccf8-d699-4f3b-b799-d731b364f968),segment_id=5489ccf8-d699-4f3b-b799-d731b364f968)] {{(pid=99029) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 17:48:27.559549 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron_lib.callbacks.manager [None req-ab5a7d46-fa4c-4b9e-92d9-b1ad000e5483 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99029) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:27.564217 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG oslo_concurrency.lockutils [None req-ee6bfbab-b432-47be-ac64-8a014a796be8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:48:27.660042 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ab5a7d46-fa4c-4b9e-92d9-b1ad000e5483 None None] Routers {'f5989ab6-97cf-4e25-b382-1dbcb19a08fa'} bound to L3 agent in host dv-cinder-789564-2-iscsi {{(pid=99029) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 17:48:27.660042 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_hamode_db [None req-ab5a7d46-fa4c-4b9e-92d9-b1ad000e5483 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcae6d349d0>, 'dv-cinder-789564-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-25T17:34:21Z,description=<?>,heartbeat_timestamp=2021-05-25T17:48:21Z,host='dv-cinder-789564-2-iscsi',id=eaeb6875-c4ed-43b6-8658-aa4e52324fdf,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T17:34:21Z,topic='l3_agent')) {'router_ids': ['f5989ab6-97cf-4e25-b382-1dbcb19a08fa'], 'active': True} {{(pid=99029) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:48:27.792914 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8aa73c03-67a1-4f23-8cc2-e55bea9bc2f1 None None] Pushing event updated for resources: {'Port': ['ID=b9d25e74-356d-4468-b89b-65b6dcd07430,revision_number=4']} {{(pid=99029) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:48:27.792914 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG oslo_concurrency.lockutils [None req-8aa73c03-67a1-4f23-8cc2-e55bea9bc2f1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.188s {{(pid=99029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:48:27.980965 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_dvr_db [None req-ab5a7d46-fa4c-4b9e-92d9-b1ad000e5483 None None] Set router f5989ab6-97cf-4e25-b382-1dbcb19a08fa gateway port host: dv-cinder-789564-2-iscsi {{(pid=99029) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 17:48:28.336220 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_hamode_db [None req-ab5a7d46-fa4c-4b9e-92d9-b1ad000e5483 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcae6d349d0>, [{'id': 'f5989ab6-97cf-4e25-b382-1dbcb19a08fa', 'name': 'tempest-TestMinimumBasicScenario-1194480117-router', 'tenant_id': '97633fb362914841abbdf8ac783702ad', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.96'}], 'enable_snat': True}, 'gw_port_id': 'd0e14de1-78ba-4be4-ab01-9637fae4743c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:48:18Z', 'updated_at': '2021-05-25T17:48:23Z', 'revision_number': 4, 'project_id': '97633fb362914841abbdf8ac783702ad', 'gw_port': {'id': 'd0e14de1-78ba-4be4-ab01-9637fae4743c', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:71:d4:5b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f5989ab6-97cf-4e25-b382-1dbcb19a08fa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 490, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.96', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:48:19Z', 'updated_at': '2021-05-25T17:48:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi', '_interfaces': [{'id': 'b9d25e74-356d-4468-b89b-65b6dcd07430', 'name': '', 'network_id': '0c323e60-9fa9-440d-b8b6-7d4cb3856e61', 'tenant_id': '97633fb362914841abbdf8ac783702ad', 'mac_address': 'fa:16:3e:6a:d3:af', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f5989ab6-97cf-4e25-b382-1dbcb19a08fa', 'device_owner': 'network:router_interface', 'standard_attr_id': 491, 'fixed_ips': [{'subnet_id': 'f9276786-22d3-46c6-86c0-89de64dcd673', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:48:22Z', 'updated_at': '2021-05-25T17:48:27Z', 'revision_number': 4, 'project_id': '97633fb362914841abbdf8ac783702ad', 'subnets': [{'id': 'f9276786-22d3-46c6-86c0-89de64dcd673', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-789564-2-iscsi', False) {} {{(pid=99029) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:48:28.342499 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ab5a7d46-fa4c-4b9e-92d9-b1ad000e5483 None None] The sync data for ids ['f5989ab6-97cf-4e25-b382-1dbcb19a08fa'] in dv-cinder-789564-2-iscsi is: [{'id': 'f5989ab6-97cf-4e25-b382-1dbcb19a08fa', 'name': 'tempest-TestMinimumBasicScenario-1194480117-router', 'tenant_id': '97633fb362914841abbdf8ac783702ad', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.96'}], 'enable_snat': True}, 'gw_port_id': 'd0e14de1-78ba-4be4-ab01-9637fae4743c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:48:18Z', 'updated_at': '2021-05-25T17:48:23Z', 'revision_number': 4, 'project_id': '97633fb362914841abbdf8ac783702ad', 'gw_port': {'id': 'd0e14de1-78ba-4be4-ab01-9637fae4743c', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:71:d4:5b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f5989ab6-97cf-4e25-b382-1dbcb19a08fa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 490, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.96', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:48:19Z', 'updated_at': '2021-05-25T17:48:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi', '_interfaces': [{'id': 'b9d25e74-356d-4468-b89b-65b6dcd07430', 'name': '', 'network_id': '0c323e60-9fa9-440d-b8b6-7d4cb3856e61', 'tenant_id': '97633fb362914841abbdf8ac783702ad', 'mac_address': 'fa:16:3e:6a:d3:af', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f5989ab6-97cf-4e25-b382-1dbcb19a08fa', 'device_owner': 'network:router_interface', 'standard_attr_id': 491, 'fixed_ips': [{'subnet_id': 'f9276786-22d3-46c6-86c0-89de64dcd673', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:48:22Z', 'updated_at': '2021-05-25T17:48:27Z', 'revision_number': 4, 'project_id': '97633fb362914841abbdf8ac783702ad', 'subnets': [{'id': 'f9276786-22d3-46c6-86c0-89de64dcd673', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=99029) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 25 17:48:29.388008 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device b9d25e74-356d-4468-b89b-65b6dcd07430 up at agent ovs-agent-dv-cinder-789564-2-iscsi {{(pid=99028) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 17:48:29.566043 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Provisioning for port b9d25e74-356d-4468-b89b-65b6dcd07430 completed by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 17:48:29.571818 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Provisioning complete for port b9d25e74-356d-4468-b89b-65b6dcd07430 triggered by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 17:48:29.572195 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:29.709204 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:29.750989 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] For port b9d25e74-356d-4468-b89b-65b6dcd07430, host dv-cinder-789564-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=b9d25e74-356d-4468-b89b-65b6dcd07430,segment=NetworkSegment(5489ccf8-d699-4f3b-b799-d731b364f968),segment_id=5489ccf8-d699-4f3b-b799-d731b364f968)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:48:29.817184 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:29.819051 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-09f76bfc-ecac-4cd4-80fa-1e2d2668d569 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:48:29.900182 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Pushing event updated for resources: {'Port': ['ID=b9d25e74-356d-4468-b89b-65b6dcd07430,revision_number=5']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:48:29.903444 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:48:31.307384 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device b9d25e74-356d-4468-b89b-65b6dcd07430 up at agent ovs-agent-dv-cinder-789564-2-iscsi {{(pid=99028) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 17:48:31.390053 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Provisioning complete for port b9d25e74-356d-4468-b89b-65b6dcd07430 triggered by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 17:48:31.390409 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:36.731399 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b2ab103-e60a-4ee4-8532-43b5cb5b4582 req-55ac58b6-bf4c-4568-9a95-89261901e037 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:48:36.732870 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-8b2ab103-e60a-4ee4-8532-43b5cb5b4582 req-55ac58b6-bf4c-4568-9a95-89261901e037 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] 10.222.0.122 "GET /v2.0/networks?id=7904a86e-e373-4117-97cd-a894d782e3e5 HTTP/1.1" status: 200  len: 815 time: 0.1489158
May 25 17:48:36.747755 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-8b2ab103-e60a-4ee4-8532-43b5cb5b4582 req-788cf7dd-28da-464c-8ff5-1c5b10b4ece5 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] 10.222.0.122 "GET /v2.0/quotas/79ce7e80f85a4c57896263e5974c8df8 HTTP/1.1" status: 200  len: 375 time: 0.0092609
May 25 17:48:36.828997 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-8b2ab103-e60a-4ee4-8532-43b5cb5b4582 req-bc197d99-576f-4b55-bd31-2999b4132755 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] 10.222.0.122 "GET /v2.0/ports?tenant_id=79ce7e80f85a4c57896263e5974c8df8&fields=id HTTP/1.1" status: 200  len: 302 time: 0.0761452
May 25 17:48:37.077024 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-8b2ab103-e60a-4ee4-8532-43b5cb5b4582 req-10324e0b-2456-4caa-b445-94cc9bac94a3 service neutron] 10.222.0.122 "GET /v2.0/networks/7904a86e-e373-4117-97cd-a894d782e3e5?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2359192
May 25 17:48:37.207351 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-8b2ab103-e60a-4ee4-8532-43b5cb5b4582 req-46e100ca-7d97-4546-b927-e6c1c2009a47 service neutron] 10.222.0.122 "GET /v2.0/networks/7904a86e-e373-4117-97cd-a894d782e3e5?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1246037
May 25 17:48:37.457661 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-043a3cf0-0010-4492-b9c3-4a529cc881b2 req-165139a0-891e-4e3d-ae46-fa75c0e4e85f tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Synchronizing usage tracker for tenant:79ce7e80f85a4c57896263e5974c8df8 on resource:port {{(pid=99027) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 17:48:37.553582 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-043a3cf0-0010-4492-b9c3-4a529cc881b2 req-165139a0-891e-4e3d-ae46-fa75c0e4e85f tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Unset dirty status for tenant:79ce7e80f85a4c57896263e5974c8df8 on resource:port {{(pid=99027) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 17:48:37.555005 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-043a3cf0-0010-4492-b9c3-4a529cc881b2 req-165139a0-891e-4e3d-ae46-fa75c0e4e85f tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] 10.222.0.122 "GET /v2.0/ports?device_id=0065a651-57d4-42bb-a61b-5b33682e5abb HTTP/1.1" status: 200  len: 210 time: 0.1394610
May 25 17:48:38.711029 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-1793e8a5-7c89-4c3e-924f-f904c1bc7a78 req-d6510a43-ad82-4d2b-b270-be5559e6ad86 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] 10.222.0.122 "GET /v2.0/ports?device_id=0065a651-57d4-42bb-a61b-5b33682e5abb HTTP/1.1" status: 200  len: 210 time: 0.0449219
May 25 17:48:39.929024 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-1039d8dd-0da8-46d1-8edb-79e69e2df605 req-85942169-6aeb-496c-9780-5898489ef5db tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] 10.222.0.122 "GET /v2.0/ports?device_id=0065a651-57d4-42bb-a61b-5b33682e5abb HTTP/1.1" status: 200  len: 210 time: 0.0631757
May 25 17:48:39.980590 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b2ab103-e60a-4ee4-8532-43b5cb5b4582 req-d91c7bdf-1cd3-4493-92ca-8ad6d2ad175a tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:48:39.981370 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-8b2ab103-e60a-4ee4-8532-43b5cb5b4582 req-d91c7bdf-1cd3-4493-92ca-8ad6d2ad175a tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Synchronizing usage tracker for tenant:79ce7e80f85a4c57896263e5974c8df8 on resource:network {{(pid=99027) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 17:48:40.090754 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-8b2ab103-e60a-4ee4-8532-43b5cb5b4582 req-d91c7bdf-1cd3-4493-92ca-8ad6d2ad175a tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Unset dirty status for tenant:79ce7e80f85a4c57896263e5974c8df8 on resource:network {{(pid=99027) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 17:48:40.092506 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-8b2ab103-e60a-4ee4-8532-43b5cb5b4582 req-d91c7bdf-1cd3-4493-92ca-8ad6d2ad175a tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] 10.222.0.125 "GET /v2.0/networks?id=7904a86e-e373-4117-97cd-a894d782e3e5 HTTP/1.1" status: 200  len: 815 time: 0.3343894
May 25 17:48:40.110414 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.v2.base [req-8b2ab103-e60a-4ee4-8532-43b5cb5b4582 req-242e741d-a250-4f57-a3ea-057f13c71969 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Request body: {'port': {'device_id': '0065a651-57d4-42bb-a61b-5b33682e5abb', 'network_id': '7904a86e-e373-4117-97cd-a894d782e3e5', 'admin_state_up': True, 'tenant_id': '79ce7e80f85a4c57896263e5974c8df8'}} {{(pid=99027) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:48:40.245794 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [req-8b2ab103-e60a-4ee4-8532-43b5cb5b4582 req-242e741d-a250-4f57-a3ea-057f13c71969 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:48:40.255979 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [req-8b2ab103-e60a-4ee4-8532-43b5cb5b4582 req-242e741d-a250-4f57-a3ea-057f13c71969 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:48:40.343063 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-8b2ab103-e60a-4ee4-8532-43b5cb5b4582 req-242e741d-a250-4f57-a3ea-057f13c71969 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Made reservation on behalf of 79ce7e80f85a4c57896263e5974c8df8 for: {'port': 1} {{(pid=99027) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 17:48:40.346564 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-8b2ab103-e60a-4ee4-8532-43b5cb5b4582 req-242e741d-a250-4f57-a3ea-057f13c71969 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:40.513267 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.db_base_plugin_common [req-8b2ab103-e60a-4ee4-8532-43b5cb5b4582 req-242e741d-a250-4f57-a3ea-057f13c71969 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Allocated IP 172.20.0.8 (7904a86e-e373-4117-97cd-a894d782e3e5/200f371a-f534-452e-9426-951e43bcffe5/2f574cd3-1bb5-44f2-895b-c48b9d8c6c8f) {{(pid=99027) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 17:48:40.714444 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-8b2ab103-e60a-4ee4-8532-43b5cb5b4582 req-242e741d-a250-4f57-a3ea-057f13c71969 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Notify callbacks [] for port, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:40.735821 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.provisioning_blocks [req-8b2ab103-e60a-4ee4-8532-43b5cb5b4582 req-242e741d-a250-4f57-a3ea-057f13c71969 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Transition to ACTIVE for port object 2f574cd3-1bb5-44f2-895b-c48b9d8c6c8f will not be triggered until provisioned by entity DHCP. {{(pid=99027) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 17:48:40.841532 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-8b2ab103-e60a-4ee4-8532-43b5cb5b4582 req-242e741d-a250-4f57-a3ea-057f13c71969 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781840788179', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15468986'] for port, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:40.850757 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:48:40.927504 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-8b2ab103-e60a-4ee4-8532-43b5cb5b4582 req-242e741d-a250-4f57-a3ea-057f13c71969 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Network 7904a86e-e373-4117-97cd-a894d782e3e5 is already hosted by enough agents. {{(pid=99027) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 17:48:40.928735 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.base_scheduler [req-8b2ab103-e60a-4ee4-8532-43b5cb5b4582 req-242e741d-a250-4f57-a3ea-057f13c71969 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Resources bound (agent type, host, resource id):  {{(pid=99027) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 17:48:40.931890 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.l3_dvrscheduler_db [req-8b2ab103-e60a-4ee4-8532-43b5cb5b4582 req-242e741d-a250-4f57-a3ea-057f13c71969 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Received port after_create {{(pid=99027) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 17:48:41.010896 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-242e741d-a250-4f57-a3ea-057f13c71969 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Pushing event updated for resources: {'Port': ['ID=2f574cd3-1bb5-44f2-895b-c48b9d8c6c8f,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:48:41.022999 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-242e741d-a250-4f57-a3ea-057f13c71969 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:48:41.023652 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-242e741d-a250-4f57-a3ea-057f13c71969 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:48:41.024282 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-242e741d-a250-4f57-a3ea-057f13c71969 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:48:41.024794 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-242e741d-a250-4f57-a3ea-057f13c71969 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:48:41.025319 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-242e741d-a250-4f57-a3ea-057f13c71969 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:48:41.025839 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-242e741d-a250-4f57-a3ea-057f13c71969 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:48:41.026346 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-242e741d-a250-4f57-a3ea-057f13c71969 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:48:41.027132 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-242e741d-a250-4f57-a3ea-057f13c71969 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:48:41.027639 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-242e741d-a250-4f57-a3ea-057f13c71969 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:48:41.028151 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-242e741d-a250-4f57-a3ea-057f13c71969 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:48:41.028654 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-242e741d-a250-4f57-a3ea-057f13c71969 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:48:41.029400 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-242e741d-a250-4f57-a3ea-057f13c71969 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:48:41.041535 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-242e741d-a250-4f57-a3ea-057f13c71969 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.191s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:48:41.063814 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b2ab103-e60a-4ee4-8532-43b5cb5b4582 req-242e741d-a250-4f57-a3ea-057f13c71969 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:48:41.064755 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-8b2ab103-e60a-4ee4-8532-43b5cb5b4582 req-242e741d-a250-4f57-a3ea-057f13c71969 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-239387'] for port, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:41.290678 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-8b2ab103-e60a-4ee4-8532-43b5cb5b4582 req-242e741d-a250-4f57-a3ea-057f13c71969 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] 10.222.0.125 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.1809821
May 25 17:48:41.299975 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.v2.base [req-8b2ab103-e60a-4ee4-8532-43b5cb5b4582 req-d67ed42c-eb85-4e6b-bf7c-21705136a299 service neutron] Request body: {'port': {'device_id': '0065a651-57d4-42bb-a61b-5b33682e5abb', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78956'}} {{(pid=99027) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:48:41.403531 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2efd1c6-2a4f-4026-a76f-3b89f167c859 req-66202efa-e52b-41fb-9ac5-1cd6b95c22ac tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:48:41.405931 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-b2efd1c6-2a4f-4026-a76f-3b89f167c859 req-66202efa-e52b-41fb-9ac5-1cd6b95c22ac tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] 10.222.0.122 "GET /v2.0/ports?device_id=0065a651-57d4-42bb-a61b-5b33682e5abb HTTP/1.1" status: 200  len: 931 time: 0.2660849
May 25 17:48:41.459738 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-b2efd1c6-2a4f-4026-a76f-3b89f167c859 req-624bba9b-687b-446c-9a0b-b8dabbaf0e29 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] 10.222.0.122 "GET /v2.0/security-groups?id=f36e68fc-4038-4509-8aec-f49be290aa8b&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0477703
May 25 17:48:41.467514 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-8b2ab103-e60a-4ee4-8532-43b5cb5b4582 req-d67ed42c-eb85-4e6b-bf7c-21705136a299 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:41.479551 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-a86d5de7-e406-4c3d-9991-91c54f1bebd7 None None] Provisioning for port 2f574cd3-1bb5-44f2-895b-c48b9d8c6c8f completed by entity DHCP. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 17:48:41.488485 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-a86d5de7-e406-4c3d-9991-91c54f1bebd7 None None] Provisioning complete for port 2f574cd3-1bb5-44f2-895b-c48b9d8c6c8f triggered by entity DHCP. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 17:48:41.489094 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-a86d5de7-e406-4c3d-9991-91c54f1bebd7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:41.544342 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:41.571254 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.plugin [None req-a86d5de7-e406-4c3d-9991-91c54f1bebd7 None None] Port 2f574cd3-1bb5-44f2-895b-c48b9d8c6c8f cannot update to ACTIVE because it is not bound. {{(pid=99028) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 25 17:48:41.963067 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.notifiers.nova [req-8b2ab103-e60a-4ee4-8532-43b5cb5b4582 req-d67ed42c-eb85-4e6b-bf7c-21705136a299 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 2f574cd3-1bb5-44f2-895b-c48b9d8c6c8f {{(pid=99027) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 25 17:48:41.972056 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-8b2ab103-e60a-4ee4-8532-43b5cb5b4582 req-d67ed42c-eb85-4e6b-bf7c-21705136a299 service neutron] Notify callbacks [] for port, precommit_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:41.986587 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.provisioning_blocks [req-8b2ab103-e60a-4ee4-8532-43b5cb5b4582 req-d67ed42c-eb85-4e6b-bf7c-21705136a299 service neutron] Transition to ACTIVE for port object 2f574cd3-1bb5-44f2-895b-c48b9d8c6c8f will not be triggered until provisioned by entity L2. {{(pid=99027) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 17:48:42.073456 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-8b2ab103-e60a-4ee4-8532-43b5cb5b4582 req-d67ed42c-eb85-4e6b-bf7c-21705136a299 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15468979'] for port, after_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:42.077812 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-154be7f1-9e02-4583-be0f-3de0d4be93bd tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:48:42.251535 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d67ed42c-eb85-4e6b-bf7c-21705136a299 service neutron] Pushing event updated for resources: {'Port': ['ID=2f574cd3-1bb5-44f2-895b-c48b9d8c6c8f,revision_number=2']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:48:42.259816 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-d67ed42c-eb85-4e6b-bf7c-21705136a299 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.182s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:48:42.344934 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.managers [req-8b2ab103-e60a-4ee4-8532-43b5cb5b4582 req-d67ed42c-eb85-4e6b-bf7c-21705136a299 service neutron] Attempting to bind port 2f574cd3-1bb5-44f2-895b-c48b9d8c6c8f on host hv-cinder-78956 for vnic_type normal with profile  {{(pid=99027) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 17:48:42.345305 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.managers [req-8b2ab103-e60a-4ee4-8532-43b5cb5b4582 req-d67ed42c-eb85-4e6b-bf7c-21705136a299 service neutron] Attempting to bind port 2f574cd3-1bb5-44f2-895b-c48b9d8c6c8f by drivers openvswitch,hyperv on host hv-cinder-78956 at level 0 using segments [{'id': '343b7bea-3acc-4c9d-939f-d8bc9eea2e5e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1319, 'network_id': '7904a86e-e373-4117-97cd-a894d782e3e5'}] {{(pid=99027) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 17:48:42.345624 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8b2ab103-e60a-4ee4-8532-43b5cb5b4582 req-d67ed42c-eb85-4e6b-bf7c-21705136a299 service neutron] Attempting to bind port 2f574cd3-1bb5-44f2-895b-c48b9d8c6c8f on network 7904a86e-e373-4117-97cd-a894d782e3e5 {{(pid=99027) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 17:48:42.350642 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8b2ab103-e60a-4ee4-8532-43b5cb5b4582 req-d67ed42c-eb85-4e6b-bf7c-21705136a299 service neutron] Port 2f574cd3-1bb5-44f2-895b-c48b9d8c6c8f on network 7904a86e-e373-4117-97cd-a894d782e3e5 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78956 {{(pid=99027) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 25 17:48:42.350958 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8b2ab103-e60a-4ee4-8532-43b5cb5b4582 req-d67ed42c-eb85-4e6b-bf7c-21705136a299 service neutron] Attempting to bind port 2f574cd3-1bb5-44f2-895b-c48b9d8c6c8f on network 7904a86e-e373-4117-97cd-a894d782e3e5 {{(pid=99027) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 17:48:42.363358 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8b2ab103-e60a-4ee4-8532-43b5cb5b4582 req-d67ed42c-eb85-4e6b-bf7c-21705136a299 service neutron] Checking agent: {'id': '4d02a528-6a0e-4977-985f-4bcff1ca6cb7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78956', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 17, 40, 41), 'started_at': datetime.datetime(2021, 5, 25, 17, 40, 41), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 17, 48, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=99027) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 17:48:42.363688 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8b2ab103-e60a-4ee4-8532-43b5cb5b4582 req-d67ed42c-eb85-4e6b-bf7c-21705136a299 service neutron] Checking segment: {'id': '343b7bea-3acc-4c9d-939f-d8bc9eea2e5e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1319, 'network_id': '7904a86e-e373-4117-97cd-a894d782e3e5'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=99027) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 17:48:42.364074 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8b2ab103-e60a-4ee4-8532-43b5cb5b4582 req-d67ed42c-eb85-4e6b-bf7c-21705136a299 service neutron] Bound using segment: {'id': '343b7bea-3acc-4c9d-939f-d8bc9eea2e5e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1319, 'network_id': '7904a86e-e373-4117-97cd-a894d782e3e5'} {{(pid=99027) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 17:48:42.364516 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.managers [req-8b2ab103-e60a-4ee4-8532-43b5cb5b4582 req-d67ed42c-eb85-4e6b-bf7c-21705136a299 service neutron] Bound port: 2f574cd3-1bb5-44f2-895b-c48b9d8c6c8f, host: hv-cinder-78956, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '343b7bea-3acc-4c9d-939f-d8bc9eea2e5e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1319, 'network_id': '7904a86e-e373-4117-97cd-a894d782e3e5'}}] {{(pid=99027) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 17:48:42.364857 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-8b2ab103-e60a-4ee4-8532-43b5cb5b4582 req-d67ed42c-eb85-4e6b-bf7c-21705136a299 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:42.507469 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.db [req-8b2ab103-e60a-4ee4-8532-43b5cb5b4582 req-d67ed42c-eb85-4e6b-bf7c-21705136a299 service neutron] For port 2f574cd3-1bb5-44f2-895b-c48b9d8c6c8f, host hv-cinder-78956, cleared binding levels {{(pid=99027) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 17:48:42.512899 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.db [req-8b2ab103-e60a-4ee4-8532-43b5cb5b4582 req-d67ed42c-eb85-4e6b-bf7c-21705136a299 service neutron] For port 2f574cd3-1bb5-44f2-895b-c48b9d8c6c8f, host hv-cinder-78956, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=2f574cd3-1bb5-44f2-895b-c48b9d8c6c8f,segment=NetworkSegment(343b7bea-3acc-4c9d-939f-d8bc9eea2e5e),segment_id=343b7bea-3acc-4c9d-939f-d8bc9eea2e5e)] {{(pid=99027) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 17:48:42.638579 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-8b2ab103-e60a-4ee4-8532-43b5cb5b4582 req-d67ed42c-eb85-4e6b-bf7c-21705136a299 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15468979'] for port, after_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:42.647623 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-72f30d11-db2b-4fc0-a58f-ed209d4bab7c service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:48:42.723097 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b2ab103-e60a-4ee4-8532-43b5cb5b4582 req-d67ed42c-eb85-4e6b-bf7c-21705136a299 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:48:42.723722 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-8b2ab103-e60a-4ee4-8532-43b5cb5b4582 req-d67ed42c-eb85-4e6b-bf7c-21705136a299 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-239387'] for port, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:42.725148 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-8b2ab103-e60a-4ee4-8532-43b5cb5b4582 req-d67ed42c-eb85-4e6b-bf7c-21705136a299 service neutron] 10.222.0.125 "PUT /v2.0/ports/2f574cd3-1bb5-44f2-895b-c48b9d8c6c8f HTTP/1.1" status: 200  len: 1093 time: 1.4303296
May 25 17:48:42.725670 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0065a651-57d4-42bb-a61b-5b33682e5abb', 'tag': '2f574cd3-1bb5-44f2-895b-c48b9d8c6c8f'}] {{(pid=99027) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 17:48:42.758004 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d67ed42c-eb85-4e6b-bf7c-21705136a299 service neutron] Pushing event updated for resources: {'Port': ['ID=2f574cd3-1bb5-44f2-895b-c48b9d8c6c8f,revision_number=3']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:48:42.771065 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-d67ed42c-eb85-4e6b-bf7c-21705136a299 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.121s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:48:42.806314 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8dde29b9-eebe-4e5f-9c50-19aa1d0d5c7c req-17840b68-d640-4267-88be-bf0c763cad3e tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:48:42.807473 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-8dde29b9-eebe-4e5f-9c50-19aa1d0d5c7c req-17840b68-d640-4267-88be-bf0c763cad3e tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Synchronizing usage tracker for tenant:79ce7e80f85a4c57896263e5974c8df8 on resource:port {{(pid=99027) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 17:48:42.909264 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-8dde29b9-eebe-4e5f-9c50-19aa1d0d5c7c req-17840b68-d640-4267-88be-bf0c763cad3e tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Unset dirty status for tenant:79ce7e80f85a4c57896263e5974c8df8 on resource:port {{(pid=99027) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 17:48:42.910478 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-8dde29b9-eebe-4e5f-9c50-19aa1d0d5c7c req-17840b68-d640-4267-88be-bf0c763cad3e tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] 10.222.0.122 "GET /v2.0/ports?device_id=0065a651-57d4-42bb-a61b-5b33682e5abb HTTP/1.1" status: 200  len: 943 time: 0.3131647
May 25 17:48:42.916651 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0065a651-57d4-42bb-a61b-5b33682e5abb', 'tag': '2f574cd3-1bb5-44f2-895b-c48b9d8c6c8f', 'status': 'completed', 'code': 200}
May 25 17:48:43.021226 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-8dde29b9-eebe-4e5f-9c50-19aa1d0d5c7c req-3cc732da-f2d2-4971-86af-e459ee4cd515 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Synchronizing usage tracker for tenant:79ce7e80f85a4c57896263e5974c8df8 on resource:security_group {{(pid=99027) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 17:48:43.164325 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-8dde29b9-eebe-4e5f-9c50-19aa1d0d5c7c req-3cc732da-f2d2-4971-86af-e459ee4cd515 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Unset dirty status for tenant:79ce7e80f85a4c57896263e5974c8df8 on resource:security_group {{(pid=99027) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 17:48:43.182632 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-8dde29b9-eebe-4e5f-9c50-19aa1d0d5c7c req-3cc732da-f2d2-4971-86af-e459ee4cd515 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] 10.222.0.122 "GET /v2.0/security-groups?id=f36e68fc-4038-4509-8aec-f49be290aa8b&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2468534
May 25 17:48:43.309649 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96f8baa6-47ed-44d9-b942-621b570f8b9e req-b22a17ab-86ff-437f-8762-cd7b2b20fcd2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:48:43.352124 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-96f8baa6-47ed-44d9-b942-621b570f8b9e req-b22a17ab-86ff-437f-8762-cd7b2b20fcd2 service neutron] 10.222.0.125 "GET /v2.0/ports?tenant_id=79ce7e80f85a4c57896263e5974c8df8&device_id=0065a651-57d4-42bb-a61b-5b33682e5abb HTTP/1.1" status: 200  len: 1096 time: 0.1304758
May 25 17:48:43.500141 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-4d0843cd-85c5-418e-b61d-60eb48472a2d req-99c489b7-87a4-4124-a6aa-de5c752dd574 service neutron] 10.222.0.125 "GET /v2.0/ports?device_id=00d13d2c-33fc-42ec-a80d-4cd8155b6fe1&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.0956578
May 25 17:48:43.650878 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96f8baa6-47ed-44d9-b942-621b570f8b9e req-b57b001b-eb9e-451f-a4d1-ff663c5bc309 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:48:43.652659 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-96f8baa6-47ed-44d9-b942-621b570f8b9e req-b57b001b-eb9e-451f-a4d1-ff663c5bc309 service neutron] 10.222.0.125 "GET /v2.0/networks?tenant_id=79ce7e80f85a4c57896263e5974c8df8&shared=False HTTP/1.1" status: 200  len: 917 time: 0.2468545
May 25 17:48:43.880273 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d0843cd-85c5-418e-b61d-60eb48472a2d req-8b289681-0d7d-4f6e-ba45-e364a418500f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:48:43.882223 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-4d0843cd-85c5-418e-b61d-60eb48472a2d req-8b289681-0d7d-4f6e-ba45-e364a418500f service neutron] 10.222.0.125 "GET /v2.0/ports?tenant_id=cf02997eda314aee8fb322add2fbb921&device_id=00d13d2c-33fc-42ec-a80d-4cd8155b6fe1 HTTP/1.1" status: 200  len: 1098 time: 0.1512756
May 25 17:48:43.969785 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96f8baa6-47ed-44d9-b942-621b570f8b9e req-9e8e99b6-c2e7-4d7e-8a09-5888150cbc5c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:48:43.972543 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-96f8baa6-47ed-44d9-b942-621b570f8b9e req-9e8e99b6-c2e7-4d7e-8a09-5888150cbc5c service neutron] 10.222.0.125 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 871 time: 0.2390606
May 25 17:48:44.456721 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b2ab103-e60a-4ee4-8532-43b5cb5b4582 req-8140a455-c37d-4e09-acca-0b59581d407f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:48:44.459131 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-8b2ab103-e60a-4ee4-8532-43b5cb5b4582 req-8140a455-c37d-4e09-acca-0b59581d407f service neutron] 10.222.0.125 "GET /v2.0/ports?tenant_id=79ce7e80f85a4c57896263e5974c8df8&device_id=0065a651-57d4-42bb-a61b-5b33682e5abb HTTP/1.1" status: 200  len: 1096 time: 0.1635201
May 25 17:48:44.575368 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dee2cdda-8b2f-4a93-b6d0-ae1d05bcfc3d req-ebd2b654-c968-473c-a3b4-75b58143feb2 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:48:44.582034 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-dee2cdda-8b2f-4a93-b6d0-ae1d05bcfc3d req-ebd2b654-c968-473c-a3b4-75b58143feb2 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] 10.222.0.122 "GET /v2.0/ports?device_id=0065a651-57d4-42bb-a61b-5b33682e5abb HTTP/1.1" status: 200  len: 943 time: 0.1658278
May 25 17:48:44.584048 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d0843cd-85c5-418e-b61d-60eb48472a2d req-4d816805-4635-4f83-9b88-68c2b1a82765 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:48:44.585508 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-4d0843cd-85c5-418e-b61d-60eb48472a2d req-4d816805-4635-4f83-9b88-68c2b1a82765 service neutron] 10.222.0.125 "GET /v2.0/networks?id=45b850af-d423-458a-855a-d7f828a11fff HTTP/1.1" status: 200  len: 919 time: 0.3065350
May 25 17:48:44.641649 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-dee2cdda-8b2f-4a93-b6d0-ae1d05bcfc3d req-785396d2-bc72-4257-9b56-ad75f0575286 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] 10.222.0.122 "GET /v2.0/security-groups?id=f36e68fc-4038-4509-8aec-f49be290aa8b&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0551536
May 25 17:48:44.865406 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-4d0843cd-85c5-418e-b61d-60eb48472a2d req-3fdbe25f-349c-45f7-a7e4-b7c064a3b424 service neutron] 10.222.0.125 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=5c96172a-06f4-41ce-b47a-f1bbde47e41c HTTP/1.1" status: 200  len: 999 time: 0.1163211
May 25 17:48:44.869449 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-8b2ab103-e60a-4ee4-8532-43b5cb5b4582 req-b7e4fa5b-987c-4f09-a305-8310e36a4324 service neutron] 10.222.0.125 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=2f574cd3-1bb5-44f2-895b-c48b9d8c6c8f HTTP/1.1" status: 200  len: 217 time: 0.1205649
May 25 17:48:45.056078 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d0843cd-85c5-418e-b61d-60eb48472a2d req-6dc10c3e-b89b-4e09-a10c-ce4d5b2d54ed service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:48:45.057596 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-4d0843cd-85c5-418e-b61d-60eb48472a2d req-6dc10c3e-b89b-4e09-a10c-ce4d5b2d54ed service neutron] 10.222.0.125 "GET /v2.0/subnets?id=704d0a85-ee4f-4df2-90a3-a525dfe28461 HTTP/1.1" status: 200  len: 856 time: 0.1025155
May 25 17:48:45.058135 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b2ab103-e60a-4ee4-8532-43b5cb5b4582 req-5f135a91-2d98-4bb7-a518-d8af698d4446 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:48:45.059580 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-8b2ab103-e60a-4ee4-8532-43b5cb5b4582 req-5f135a91-2d98-4bb7-a518-d8af698d4446 service neutron] 10.222.0.125 "GET /v2.0/subnets?id=200f371a-f534-452e-9426-951e43bcffe5 HTTP/1.1" status: 200  len: 854 time: 0.1039689
May 25 17:48:45.281197 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b2ab103-e60a-4ee4-8532-43b5cb5b4582 req-ba799c2d-85a1-4548-9fda-7677ae403e14 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:48:45.282800 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-8b2ab103-e60a-4ee4-8532-43b5cb5b4582 req-ba799c2d-85a1-4548-9fda-7677ae403e14 service neutron] 10.222.0.125 "GET /v2.0/ports?network_id=7904a86e-e373-4117-97cd-a894d782e3e5&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1211002
May 25 17:48:45.300906 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d0843cd-85c5-418e-b61d-60eb48472a2d req-f3dbf0bf-042a-45eb-bc40-413f78a4ad91 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:48:45.303722 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-4d0843cd-85c5-418e-b61d-60eb48472a2d req-f3dbf0bf-042a-45eb-bc40-413f78a4ad91 service neutron] 10.222.0.125 "GET /v2.0/ports?network_id=45b850af-d423-458a-855a-d7f828a11fff&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1403363
May 25 17:48:45.617186 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-4d0843cd-85c5-418e-b61d-60eb48472a2d req-7bce0da3-9fef-4811-8313-b993e8f2de3a service neutron] 10.222.0.125 "GET /v2.0/networks/45b850af-d423-458a-855a-d7f828a11fff?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1326673
May 25 17:48:45.689417 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-8b2ab103-e60a-4ee4-8532-43b5cb5b4582 req-f6708547-0b89-4d7d-b63a-c2acef883c3c service neutron] 10.222.0.125 "GET /v2.0/networks/7904a86e-e373-4117-97cd-a894d782e3e5?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2047338
May 25 17:48:45.780955 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-4d0843cd-85c5-418e-b61d-60eb48472a2d req-cc42297d-2119-46e9-a089-1e04cfb24d2f service neutron] 10.222.0.125 "GET /v2.0/networks/45b850af-d423-458a-855a-d7f828a11fff?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1581151
May 25 17:48:45.968429 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-8b2ab103-e60a-4ee4-8532-43b5cb5b4582 req-8fd1fd30-7080-4ea4-ae89-11b64678c699 service neutron] 10.222.0.125 "GET /v2.0/networks/7904a86e-e373-4117-97cd-a894d782e3e5?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2710149
May 25 17:48:46.046478 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf2e6e48-00cb-473e-b8d1-b578a969b4e8 req-2ff24d6b-7a93-483a-b0a0-2e1b0fab3476 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:48:46.056290 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-bf2e6e48-00cb-473e-b8d1-b578a969b4e8 req-2ff24d6b-7a93-483a-b0a0-2e1b0fab3476 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] 10.222.0.122 "GET /v2.0/ports?device_id=0065a651-57d4-42bb-a61b-5b33682e5abb HTTP/1.1" status: 200  len: 943 time: 0.1778140
May 25 17:48:46.112856 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-bf2e6e48-00cb-473e-b8d1-b578a969b4e8 req-19add198-6d3c-415b-8c3c-f28f72c4d182 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] 10.222.0.122 "GET /v2.0/security-groups?id=f36e68fc-4038-4509-8aec-f49be290aa8b&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0555685
May 25 17:48:47.315835 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f532482c-672a-4ec1-b426-8a639e43efcc req-b5008840-f6ef-48a8-ab58-69fa42aa2fde tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:48:47.317322 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-f532482c-672a-4ec1-b426-8a639e43efcc req-b5008840-f6ef-48a8-ab58-69fa42aa2fde tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] 10.222.0.122 "GET /v2.0/ports?device_id=0065a651-57d4-42bb-a61b-5b33682e5abb HTTP/1.1" status: 200  len: 943 time: 0.0846925
May 25 17:48:47.362718 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-f532482c-672a-4ec1-b426-8a639e43efcc req-d13bc9ce-ba42-4487-b409-6f5048e1b0df tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] 10.222.0.122 "GET /v2.0/security-groups?id=f36e68fc-4038-4509-8aec-f49be290aa8b&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0396314
May 25 17:48:47.770625 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.agents_db [None req-14fae233-15dc-4576-836b-621c5f95b584 None None] Agent healthcheck: found 6 active agents {{(pid=99029) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 17:48:48.159956 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-ea79a341-ad10-4b0e-801c-5f0665170a29 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:48.583018 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f79a06e2-1da8-4530-b392-2a4391067552 req-13c39f56-45fe-463c-9f4a-3ac0bb99856b tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:48:48.588592 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-f79a06e2-1da8-4530-b392-2a4391067552 req-13c39f56-45fe-463c-9f4a-3ac0bb99856b tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] 10.222.0.122 "GET /v2.0/ports?device_id=0065a651-57d4-42bb-a61b-5b33682e5abb HTTP/1.1" status: 200  len: 943 time: 0.1029766
May 25 17:48:48.643805 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-f79a06e2-1da8-4530-b392-2a4391067552 req-ba2cefa7-dfaa-41f4-9415-48a3d6c67c9d tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] 10.222.0.122 "GET /v2.0/security-groups?id=f36e68fc-4038-4509-8aec-f49be290aa8b&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0531037
May 25 17:48:49.835347 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c47e7e6f-2172-4c9f-b9cc-3ba8ffc15009 req-44694235-0012-4c48-8860-831c189c1632 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:48:49.836812 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-c47e7e6f-2172-4c9f-b9cc-3ba8ffc15009 req-44694235-0012-4c48-8860-831c189c1632 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] 10.222.0.122 "GET /v2.0/ports?device_id=0065a651-57d4-42bb-a61b-5b33682e5abb HTTP/1.1" status: 200  len: 943 time: 0.0799572
May 25 17:48:49.881620 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-c47e7e6f-2172-4c9f-b9cc-3ba8ffc15009 req-22cc96ba-db63-4bef-ad47-973c33cd876f tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] 10.222.0.122 "GET /v2.0/security-groups?id=f36e68fc-4038-4509-8aec-f49be290aa8b&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0384302
May 25 17:48:49.886571 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Device 2f574cd3-1bb5-44f2-895b-c48b9d8c6c8f details requested by agent hyperv_hv-cinder-78956 with host hv-cinder-78956 {{(pid=99028) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 25 17:48:50.045963 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] For port 2f574cd3-1bb5-44f2-895b-c48b9d8c6c8f, host hv-cinder-78956, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=2f574cd3-1bb5-44f2-895b-c48b9d8c6c8f,segment=NetworkSegment(343b7bea-3acc-4c9d-939f-d8bc9eea2e5e),segment_id=343b7bea-3acc-4c9d-939f-d8bc9eea2e5e)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:48:50.058980 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Returning: {'device': '2f574cd3-1bb5-44f2-895b-c48b9d8c6c8f', 'network_id': '7904a86e-e373-4117-97cd-a894d782e3e5', 'port_id': '2f574cd3-1bb5-44f2-895b-c48b9d8c6c8f', 'mac_address': 'fa:16:3e:9f:0a:27', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1319, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '200f371a-f534-452e-9426-951e43bcffe5', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=99028) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 25 17:48:50.115789 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:50.132314 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.notifiers.nova [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 2f574cd3-1bb5-44f2-895b-c48b9d8c6c8f {{(pid=99028) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 25 17:48:50.147786 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] For port 2f574cd3-1bb5-44f2-895b-c48b9d8c6c8f, host hv-cinder-78956, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=2f574cd3-1bb5-44f2-895b-c48b9d8c6c8f,segment=NetworkSegment(343b7bea-3acc-4c9d-939f-d8bc9eea2e5e),segment_id=343b7bea-3acc-4c9d-939f-d8bc9eea2e5e)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:48:50.217160 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:50.218917 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-d329346d-8f64-4913-a945-427009f9577d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:48:50.285020 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Pushing event updated for resources: {'Port': ['ID=2f574cd3-1bb5-44f2-895b-c48b9d8c6c8f,revision_number=4']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:48:50.287936 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.069s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:48:50.480365 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] get_ports_and_sgs() called for port_ids ['2f574cd3-1bb5-44f2-895b-c48b9d8c6c8f'] {{(pid=99028) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 25 17:48:50.702820 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4fa27e2c-0e6c-4811-8ae8-6aae6c54adbb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:50.845338 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:51.071923 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddc771e5-fac2-45e8-8da6-3a00291074ef req-e5222f4b-0af1-4743-9b28-78527d90bc18 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:48:51.073413 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-ddc771e5-fac2-45e8-8da6-3a00291074ef req-e5222f4b-0af1-4743-9b28-78527d90bc18 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] 10.222.0.122 "GET /v2.0/ports?device_id=0065a651-57d4-42bb-a61b-5b33682e5abb HTTP/1.1" status: 200  len: 944 time: 0.0826678
May 25 17:48:51.118797 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-ddc771e5-fac2-45e8-8da6-3a00291074ef req-a31286e1-0130-49ad-b735-4f4652e0288e tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] 10.222.0.122 "GET /v2.0/security-groups?id=f36e68fc-4038-4509-8aec-f49be290aa8b&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0390472
May 25 17:48:51.725125 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-7e261f94-b84f-443e-be49-3bc1ac903b55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:51.900743 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Device 2f574cd3-1bb5-44f2-895b-c48b9d8c6c8f up at agent hyperv_hv-cinder-78956 {{(pid=99028) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 17:48:52.038535 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Provisioning for port 2f574cd3-1bb5-44f2-895b-c48b9d8c6c8f completed by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 17:48:52.043432 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Provisioning complete for port 2f574cd3-1bb5-44f2-895b-c48b9d8c6c8f triggered by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 17:48:52.043814 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:52.161075 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:52.188280 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0065a651-57d4-42bb-a61b-5b33682e5abb', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2f574cd3-1bb5-44f2-895b-c48b9d8c6c8f'}] {{(pid=99028) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 17:48:52.197924 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] For port 2f574cd3-1bb5-44f2-895b-c48b9d8c6c8f, host hv-cinder-78956, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=2f574cd3-1bb5-44f2-895b-c48b9d8c6c8f,segment=NetworkSegment(343b7bea-3acc-4c9d-939f-d8bc9eea2e5e),segment_id=343b7bea-3acc-4c9d-939f-d8bc9eea2e5e)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:48:52.280592 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:52.282697 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:48:52.312316 dv-cinder-789564-2-iscsi neutron-server[99028]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0065a651-57d4-42bb-a61b-5b33682e5abb', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2f574cd3-1bb5-44f2-895b-c48b9d8c6c8f', 'code': 200}
May 25 17:48:52.323265 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8855a895-875f-44a4-8c31-9c8549a4ed25 req-6ad09677-11b5-4101-98a8-ac0188ab779c tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:48:52.324906 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-8855a895-875f-44a4-8c31-9c8549a4ed25 req-6ad09677-11b5-4101-98a8-ac0188ab779c tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] 10.222.0.122 "GET /v2.0/ports?device_id=0065a651-57d4-42bb-a61b-5b33682e5abb HTTP/1.1" status: 200  len: 944 time: 0.0901086
May 25 17:48:52.353804 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Pushing event updated for resources: {'Port': ['ID=2f574cd3-1bb5-44f2-895b-c48b9d8c6c8f,revision_number=5']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:48:52.356809 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:48:52.373174 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-8855a895-875f-44a4-8c31-9c8549a4ed25 req-c8baa99d-9481-4bff-965a-9d8899b22175 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] 10.222.0.122 "GET /v2.0/security-groups?id=f36e68fc-4038-4509-8aec-f49be290aa8b&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0417950
May 25 17:48:52.736734 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93c5271e-9dcf-460e-ac0c-0b191e77861c req-36a49638-a53f-402c-b4c9-dbb2170bd304 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:48:52.738238 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-93c5271e-9dcf-460e-ac0c-0b191e77861c req-36a49638-a53f-402c-b4c9-dbb2170bd304 service neutron] 10.222.0.125 "GET /v2.0/ports?device_id=0065a651-57d4-42bb-a61b-5b33682e5abb HTTP/1.1" status: 200  len: 1098 time: 0.0714355
May 25 17:48:52.781977 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-93c5271e-9dcf-460e-ac0c-0b191e77861c req-6283dd59-6053-44db-978f-a8063f741b35 service neutron] 10.222.0.125 "GET /v2.0/security-groups?id=f36e68fc-4038-4509-8aec-f49be290aa8b&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0354826
May 25 17:48:53.313427 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-6df2b2a7-a54e-4d57-9be3-033078b9d5b3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:48:53.571314 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24237010-d079-4c69-8520-514aa1a8a770 req-3ec74040-f962-4037-a07c-0f180d253070 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:48:53.572767 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-24237010-d079-4c69-8520-514aa1a8a770 req-3ec74040-f962-4037-a07c-0f180d253070 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] 10.222.0.122 "GET /v2.0/ports?device_id=0065a651-57d4-42bb-a61b-5b33682e5abb HTTP/1.1" status: 200  len: 945 time: 0.0910120
May 25 17:48:53.620575 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-24237010-d079-4c69-8520-514aa1a8a770 req-38b155f0-5489-4086-b6ff-6626d24932f9 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] 10.222.0.122 "GET /v2.0/security-groups?id=f36e68fc-4038-4509-8aec-f49be290aa8b&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0405886
May 25 17:48:54.813602 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc19fe7f-78e9-4c2f-bdc5-42d4e422fe79 req-01c45cc7-9c06-4bfb-8e3a-e689b6ac4192 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:48:54.815105 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-fc19fe7f-78e9-4c2f-bdc5-42d4e422fe79 req-01c45cc7-9c06-4bfb-8e3a-e689b6ac4192 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] 10.222.0.122 "GET /v2.0/ports?device_id=0065a651-57d4-42bb-a61b-5b33682e5abb HTTP/1.1" status: 200  len: 945 time: 0.0820823
May 25 17:48:54.864040 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-fc19fe7f-78e9-4c2f-bdc5-42d4e422fe79 req-27c37519-0894-46d2-8565-9a952dc56f7d tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] 10.222.0.122 "GET /v2.0/security-groups?id=f36e68fc-4038-4509-8aec-f49be290aa8b&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0430341
May 25 17:48:55.055943 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70b57ddd-c7fd-4b4f-9a7a-19155952ce35 req-7eb60482-f8c7-4421-8ec4-3044c276d25d tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:48:55.057421 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-70b57ddd-c7fd-4b4f-9a7a-19155952ce35 req-7eb60482-f8c7-4421-8ec4-3044c276d25d tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] 10.222.0.122 "GET /v2.0/ports?device_id=0065a651-57d4-42bb-a61b-5b33682e5abb HTTP/1.1" status: 200  len: 945 time: 0.0834947
May 25 17:48:55.101554 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-70b57ddd-c7fd-4b4f-9a7a-19155952ce35 req-52a03fb3-cee4-4ebd-a258-db090a6b4f6c tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] 10.222.0.122 "GET /v2.0/security-groups?id=f36e68fc-4038-4509-8aec-f49be290aa8b&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0383301
May 25 17:48:55.636375 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54ca66c8-96e8-4075-8592-8ee09ce29a3c req-e1c56efd-4ddb-4ba9-9c51-9bdb0078d3af tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:48:55.637858 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-54ca66c8-96e8-4075-8592-8ee09ce29a3c req-e1c56efd-4ddb-4ba9-9c51-9bdb0078d3af tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] 10.222.0.122 "GET /v2.0/ports?device_id=0065a651-57d4-42bb-a61b-5b33682e5abb HTTP/1.1" status: 200  len: 945 time: 0.0843923
May 25 17:48:55.682216 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-54ca66c8-96e8-4075-8592-8ee09ce29a3c req-7dc86d44-946f-43d6-9128-00e92fb5488b tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] 10.222.0.122 "GET /v2.0/security-groups?id=f36e68fc-4038-4509-8aec-f49be290aa8b&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0377729
May 25 17:49:08.234973 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-372e4621-f5d6-4f3d-92c0-324d32358b09 req-0137a409-dfc7-419d-9f86-260b9d3c733e tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:49:08.236458 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-372e4621-f5d6-4f3d-92c0-324d32358b09 req-0137a409-dfc7-419d-9f86-260b9d3c733e tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] 10.222.0.122 "GET /v2.0/ports?device_id=0065a651-57d4-42bb-a61b-5b33682e5abb HTTP/1.1" status: 200  len: 945 time: 0.0799665
May 25 17:49:08.285890 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-372e4621-f5d6-4f3d-92c0-324d32358b09 req-c736fa3d-6c7d-4bd0-8c86-3951c248797f tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] 10.222.0.122 "GET /v2.0/security-groups?id=f36e68fc-4038-4509-8aec-f49be290aa8b&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0437417
May 25 17:49:08.310599 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 48500) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:49:08.502532 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-67de164e-8fb4-4383-9c5c-b96e6d07b822 tempest-TestMinimumBasicScenario-399739139 tempest-TestMinimumBasicScenario-399739139-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:49:08.503282 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-67de164e-8fb4-4383-9c5c-b96e6d07b822 tempest-TestMinimumBasicScenario-399739139 tempest-TestMinimumBasicScenario-399739139-project-admin] Synchronizing usage tracker for tenant:97633fb362914841abbdf8ac783702ad on resource:port {{(pid=99027) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 17:49:08.617176 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-67de164e-8fb4-4383-9c5c-b96e6d07b822 tempest-TestMinimumBasicScenario-399739139 tempest-TestMinimumBasicScenario-399739139-project-admin] Unset dirty status for tenant:97633fb362914841abbdf8ac783702ad on resource:port {{(pid=99027) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 17:49:08.618310 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-67de164e-8fb4-4383-9c5c-b96e6d07b822 tempest-TestMinimumBasicScenario-399739139 tempest-TestMinimumBasicScenario-399739139-project-admin] 10.222.0.122 "GET /v2.0/ports?device_id=0065a651-57d4-42bb-a61b-5b33682e5abb HTTP/1.1" status: 200  len: 1093 time: 0.3066902
May 25 17:49:08.621823 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 48508) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:49:08.627905 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.v2.base [None req-88a72984-6d49-4b78-b3e5-cd7b079f88b9 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Request body: {'floatingip': {'floating_network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'port_id': '2f574cd3-1bb5-44f2-895b-c48b9d8c6c8f', 'tenant_id': '79ce7e80f85a4c57896263e5974c8df8', 'fixed_ip_address': '172.20.0.8'}} {{(pid=99026) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:49:08.633986 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-88a72984-6d49-4b78-b3e5-cd7b079f88b9 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:49:08.638515 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-88a72984-6d49-4b78-b3e5-cd7b079f88b9 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Usage tracker for resource:floatingip and tenant:79ce7e80f85a4c57896263e5974c8df8 is out of sync, need to count used quota {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:49:08.642164 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-88a72984-6d49-4b78-b3e5-cd7b079f88b9 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:49:08.648271 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-88a72984-6d49-4b78-b3e5-cd7b079f88b9 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:49:08.759658 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-88a72984-6d49-4b78-b3e5-cd7b079f88b9 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Notify callbacks [] for floatingip, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:49:08.899394 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-88a72984-6d49-4b78-b3e5-cd7b079f88b9 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:49:09.033557 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.db_base_plugin_common [None req-88a72984-6d49-4b78-b3e5-cd7b079f88b9 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Allocated IP 172.27.3.67 (eb7ec72b-a691-481b-8d7e-42c05e13a8cb/d6898f5f-da0b-4428-97b4-4cbe3e83caaa/bb08b8b5-9db4-430f-af5a-c3af49b29b5b) {{(pid=99026) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 17:49:09.265368 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-88a72984-6d49-4b78-b3e5-cd7b079f88b9 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Notify callbacks [] for port, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:49:09.376970 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-88a72984-6d49-4b78-b3e5-cd7b079f88b9 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781840788179', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15476536'] for port, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:49:09.380835 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-650f39c4-e288-4d9d-93fd-6eb70c75b81e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:49:09.446534 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-88a72984-6d49-4b78-b3e5-cd7b079f88b9 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Network eb7ec72b-a691-481b-8d7e-42c05e13a8cb is already hosted by enough agents. {{(pid=99026) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 17:49:09.449212 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.scheduler.base_scheduler [None req-88a72984-6d49-4b78-b3e5-cd7b079f88b9 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Resources bound (agent type, host, resource id):  {{(pid=99026) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 17:49:09.453666 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.l3_dvrscheduler_db [None req-88a72984-6d49-4b78-b3e5-cd7b079f88b9 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Received port after_create {{(pid=99026) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 17:49:09.487660 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88a72984-6d49-4b78-b3e5-cd7b079f88b9 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Pushing event updated for resources: {'Port': ['ID=bb08b8b5-9db4-430f-af5a-c3af49b29b5b,revision_number=1']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:49:09.504500 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88a72984-6d49-4b78-b3e5-cd7b079f88b9 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:49:09.504867 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88a72984-6d49-4b78-b3e5-cd7b079f88b9 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:49:09.505261 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88a72984-6d49-4b78-b3e5-cd7b079f88b9 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:49:09.505624 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88a72984-6d49-4b78-b3e5-cd7b079f88b9 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:49:09.505973 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88a72984-6d49-4b78-b3e5-cd7b079f88b9 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:49:09.506325 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88a72984-6d49-4b78-b3e5-cd7b079f88b9 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:49:09.506672 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88a72984-6d49-4b78-b3e5-cd7b079f88b9 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:49:09.507020 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88a72984-6d49-4b78-b3e5-cd7b079f88b9 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:49:09.507439 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88a72984-6d49-4b78-b3e5-cd7b079f88b9 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:49:09.507702 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88a72984-6d49-4b78-b3e5-cd7b079f88b9 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:49:09.508042 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88a72984-6d49-4b78-b3e5-cd7b079f88b9 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:49:09.508383 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88a72984-6d49-4b78-b3e5-cd7b079f88b9 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:49:09.514195 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-88a72984-6d49-4b78-b3e5-cd7b079f88b9 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.133s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:49:09.924604 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-88a72984-6d49-4b78-b3e5-cd7b079f88b9 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Notify callbacks [] for floatingip, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:49:10.070459 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-88a72984-6d49-4b78-b3e5-cd7b079f88b9 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:49:10.279359 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-88a72984-6d49-4b78-b3e5-cd7b079f88b9 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Notify callbacks [] for port, precommit_update {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:49:10.348139 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-88a72984-6d49-4b78-b3e5-cd7b079f88b9 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15476529'] for port, after_update {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:49:10.351867 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-e74312b5-520e-41a6-a834-099c9fe636b6 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:49:10.460932 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88a72984-6d49-4b78-b3e5-cd7b079f88b9 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Pushing event updated for resources: {'Port': ['ID=bb08b8b5-9db4-430f-af5a-c3af49b29b5b,revision_number=2']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:49:10.463744 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-88a72984-6d49-4b78-b3e5-cd7b079f88b9 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.112s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:49:10.473769 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-88a72984-6d49-4b78-b3e5-cd7b079f88b9 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-419865'] for floatingip, after_update {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:49:10.648513 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.db.l3_db [None req-88a72984-6d49-4b78-b3e5-cd7b079f88b9 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Floating IP 7340c255-1f10-4c35-9cef-b0b7daf08937 associated. External IP: 172.27.3.67, port: 2f574cd3-1bb5-44f2-895b-c48b9d8c6c8f.
May 25 17:49:11.104461 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-88a72984-6d49-4b78-b3e5-cd7b079f88b9 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Router ed6451cf-7a08-48a6-b823-dd9d01bcee79 has already been hosted by L3 agent eaeb6875-c4ed-43b6-8658-aa4e52324fdf {{(pid=99026) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 25 17:49:11.288436 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-88a72984-6d49-4b78-b3e5-cd7b079f88b9 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Notify agent at l3_agent.dv-cinder-789564-2-iscsi the message routers_updated {{(pid=99026) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 25 17:49:11.298507 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-47953747-c7cd-47cf-96fd-3550ddb87ea5 None None] Sync routers for ids ['ed6451cf-7a08-48a6-b823-dd9d01bcee79'] in dv-cinder-789564-2-iscsi {{(pid=99028) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 25 17:49:11.307594 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvrscheduler_db [None req-47953747-c7cd-47cf-96fd-3550ddb87ea5 None None] Routers {'ed6451cf-7a08-48a6-b823-dd9d01bcee79'} bound to L3 agent in host dv-cinder-789564-2-iscsi {{(pid=99028) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 17:49:11.308328 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-47953747-c7cd-47cf-96fd-3550ddb87ea5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcae5ad0130>, 'dv-cinder-789564-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T17:34:21Z,description=<?>,heartbeat_timestamp=2021-05-25T17:48:51Z,host='dv-cinder-789564-2-iscsi',id=eaeb6875-c4ed-43b6-8658-aa4e52324fdf,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T17:34:21Z,topic='l3_agent')) {'router_ids': ['ed6451cf-7a08-48a6-b823-dd9d01bcee79'], 'active': True} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:49:11.394161 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-88a72984-6d49-4b78-b3e5-cd7b079f88b9 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-239387'] for floatingip, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:49:11.453088 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-88a72984-6d49-4b78-b3e5-cd7b079f88b9 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] 10.222.0.122 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 995 time: 2.8293531
May 25 17:49:11.453841 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0065a651-57d4-42bb-a61b-5b33682e5abb', 'tag': '2f574cd3-1bb5-44f2-895b-c48b9d8c6c8f'}] {{(pid=99026) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 17:49:11.456249 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 48520) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:49:11.463253 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.v2.base [None req-670b7157-d104-42cf-a680-7e261e653452 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1814385905', 'description': 'tempest-secgroup-smoke-1814385905 description', 'project_id': '79ce7e80f85a4c57896263e5974c8df8'}} {{(pid=99027) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:49:11.472506 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-670b7157-d104-42cf-a680-7e261e653452 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:49:11.483137 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-670b7157-d104-42cf-a680-7e261e653452 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:49:11.517033 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvr_db [None req-47953747-c7cd-47cf-96fd-3550ddb87ea5 None None] Set router ed6451cf-7a08-48a6-b823-dd9d01bcee79 gateway port host: dv-cinder-789564-2-iscsi {{(pid=99028) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 17:49:11.556287 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0065a651-57d4-42bb-a61b-5b33682e5abb', 'tag': '2f574cd3-1bb5-44f2-895b-c48b9d8c6c8f', 'status': 'completed', 'code': 200}
May 25 17:49:11.619850 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-670b7157-d104-42cf-a680-7e261e653452 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Notify callbacks [] for security_group, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:49:11.656592 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-670b7157-d104-42cf-a680-7e261e653452 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:49:11.661960 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-670b7157-d104-42cf-a680-7e261e653452 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Usage tracker for resource:security_group_rule and tenant:79ce7e80f85a4c57896263e5974c8df8 is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:49:11.666804 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-670b7157-d104-42cf-a680-7e261e653452 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:49:11.670576 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:49:11.678940 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-670b7157-d104-42cf-a680-7e261e653452 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:49:11.710512 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9430c0d6-85bd-4818-9fdd-bf6a2e9d09a3 req-cc021ddf-7267-4abf-adba-60dcaeb29917 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:49:11.711978 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-9430c0d6-85bd-4818-9fdd-bf6a2e9d09a3 req-cc021ddf-7267-4abf-adba-60dcaeb29917 service neutron] 10.222.0.125 "GET /v2.0/ports?tenant_id=79ce7e80f85a4c57896263e5974c8df8&device_id=0065a651-57d4-42bb-a61b-5b33682e5abb HTTP/1.1" status: 200  len: 1098 time: 0.1299386
May 25 17:49:11.866392 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-670b7157-d104-42cf-a680-7e261e653452 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Notify callbacks [] for security_group, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:49:11.876464 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-47953747-c7cd-47cf-96fd-3550ddb87ea5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcae5ad0130>, [{'id': 'ed6451cf-7a08-48a6-b823-dd9d01bcee79', 'name': 'tempest-TestMinimumBasicScenario-1304633943-router', 'tenant_id': '79ce7e80f85a4c57896263e5974c8df8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.80'}], 'enable_snat': True}, 'gw_port_id': '6c066f26-0761-4bef-b612-661f04382074', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:48:09Z', 'updated_at': '2021-05-25T17:48:14Z', 'revision_number': 4, 'project_id': '79ce7e80f85a4c57896263e5974c8df8', 'gw_port': {'id': '6c066f26-0761-4bef-b612-661f04382074', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:0c:b5:ed', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ed6451cf-7a08-48a6-b823-dd9d01bcee79', 'device_owner': 'network:router_gateway', 'standard_attr_id': 478, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.80', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:48:10Z', 'updated_at': '2021-05-25T17:48:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi', '_floatingips': [{'id': '7340c255-1f10-4c35-9cef-b0b7daf08937', 'tenant_id': '79ce7e80f85a4c57896263e5974c8df8', 'floating_ip_address': '172.27.3.67', 'floating_network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'router_id': 'ed6451cf-7a08-48a6-b823-dd9d01bcee79', 'port_id': '2f574cd3-1bb5-44f2-895b-c48b9d8c6c8f', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 499, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '7904a86e-e373-4117-97cd-a894d782e3e5', 'mac_address': 'fa:16:3e:9f:0a:27', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0065a651-57d4-42bb-a61b-5b33682e5abb', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T17:49:09Z', 'updated_at': '2021-05-25T17:49:09Z', 'revision_number': 0, 'project_id': '79ce7e80f85a4c57896263e5974c8df8', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '1d7a4034-86b0-49fb-bf45-68dda95544c2', 'name': '', 'network_id': '7904a86e-e373-4117-97cd-a894d782e3e5', 'tenant_id': '79ce7e80f85a4c57896263e5974c8df8', 'mac_address': 'fa:16:3e:46:21:20', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ed6451cf-7a08-48a6-b823-dd9d01bcee79', 'device_owner': 'network:router_interface', 'standard_attr_id': 479, 'fixed_ips': [{'subnet_id': '200f371a-f534-452e-9426-951e43bcffe5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:48:13Z', 'updated_at': '2021-05-25T17:48:19Z', 'revision_number': 5, 'project_id': '79ce7e80f85a4c57896263e5974c8df8', 'subnets': [{'id': '200f371a-f534-452e-9426-951e43bcffe5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-789564-2-iscsi', False) {} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:49:11.885249 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-47953747-c7cd-47cf-96fd-3550ddb87ea5 None None] Checking router: ed6451cf-7a08-48a6-b823-dd9d01bcee79 for host: dv-cinder-789564-2-iscsi {{(pid=99028) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 25 17:49:11.890398 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvrscheduler_db [None req-47953747-c7cd-47cf-96fd-3550ddb87ea5 None None] Routers {'ed6451cf-7a08-48a6-b823-dd9d01bcee79'} bound to L3 agent in host dv-cinder-789564-2-iscsi {{(pid=99028) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 17:49:11.891006 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-47953747-c7cd-47cf-96fd-3550ddb87ea5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcae5ad0130>, 'dv-cinder-789564-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T17:34:21Z,description=<?>,heartbeat_timestamp=2021-05-25T17:48:51Z,host='dv-cinder-789564-2-iscsi',id=eaeb6875-c4ed-43b6-8658-aa4e52324fdf,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T17:34:21Z,topic='l3_agent')) {'router_ids': ['ed6451cf-7a08-48a6-b823-dd9d01bcee79'], 'active': True} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:49:11.895043 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9430c0d6-85bd-4818-9fdd-bf6a2e9d09a3 req-157e33dc-2b3c-419c-b8e9-abdc8bfc306a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:49:11.896528 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-9430c0d6-85bd-4818-9fdd-bf6a2e9d09a3 req-157e33dc-2b3c-419c-b8e9-abdc8bfc306a service neutron] 10.222.0.125 "GET /v2.0/networks?id=7904a86e-e373-4117-97cd-a894d782e3e5 HTTP/1.1" status: 200  len: 917 time: 0.1804018
May 25 17:49:11.958035 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-670b7157-d104-42cf-a680-7e261e653452 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:49:11.981378 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-d11adb0b-49e5-4727-9a75-f059568b40b3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:49:12.038431 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-670b7157-d104-42cf-a680-7e261e653452 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Pushing event updated for resources: {'SecurityGroup': ['ID=466efd7c-7fba-415a-9c52-bbb1ea6e12f4,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:49:12.041389 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-670b7157-d104-42cf-a680-7e261e653452 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.060s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:49:12.053460 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-9430c0d6-85bd-4818-9fdd-bf6a2e9d09a3 req-13117641-fc9d-4295-aeb8-0f34793e6d98 service neutron] 10.222.0.125 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=2f574cd3-1bb5-44f2-895b-c48b9d8c6c8f HTTP/1.1" status: 200  len: 998 time: 0.1506915
May 25 17:49:12.074263 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvr_db [None req-47953747-c7cd-47cf-96fd-3550ddb87ea5 None None] Set router ed6451cf-7a08-48a6-b823-dd9d01bcee79 gateway port host: dv-cinder-789564-2-iscsi {{(pid=99028) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 17:49:12.116044 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-670b7157-d104-42cf-a680-7e261e653452 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Notify callbacks [] for security_group, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:49:12.117269 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-670b7157-d104-42cf-a680-7e261e653452 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] 10.222.0.122 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1794 time: 0.6598897
May 25 17:49:12.120354 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 48532) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:49:12.123569 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9430c0d6-85bd-4818-9fdd-bf6a2e9d09a3 req-df98195b-f70d-4d15-925b-d57b6089de29 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:49:12.133194 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-9430c0d6-85bd-4818-9fdd-bf6a2e9d09a3 req-df98195b-f70d-4d15-925b-d57b6089de29 service neutron] 10.222.0.125 "GET /v2.0/subnets?id=200f371a-f534-452e-9426-951e43bcffe5 HTTP/1.1" status: 200  len: 854 time: 0.0627997
May 25 17:49:12.133349 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.v2.base [None req-cd7bf401-86b6-49f6-98fe-1687587ddca3 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Request body: {'security_group_rule': {'security_group_id': '466efd7c-7fba-415a-9c52-bbb1ea6e12f4', 'project_id': '79ce7e80f85a4c57896263e5974c8df8', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=99026) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:49:12.133349 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-cd7bf401-86b6-49f6-98fe-1687587ddca3 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:49:12.137061 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-cd7bf401-86b6-49f6-98fe-1687587ddca3 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Usage tracker for resource:security_group_rule and tenant:79ce7e80f85a4c57896263e5974c8df8 is out of sync, need to count used quota {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:49:12.141015 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-cd7bf401-86b6-49f6-98fe-1687587ddca3 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:49:12.147675 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-cd7bf401-86b6-49f6-98fe-1687587ddca3 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:49:12.207099 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9430c0d6-85bd-4818-9fdd-bf6a2e9d09a3 req-290f4abe-fc6a-4290-93eb-cda661224a33 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:49:12.208566 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-9430c0d6-85bd-4818-9fdd-bf6a2e9d09a3 req-290f4abe-fc6a-4290-93eb-cda661224a33 service neutron] 10.222.0.125 "GET /v2.0/ports?network_id=7904a86e-e373-4117-97cd-a894d782e3e5&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0788341
May 25 17:49:12.228640 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-cd7bf401-86b6-49f6-98fe-1687587ddca3 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Notify callbacks [] for security_group_rule, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:49:12.305805 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-cd7bf401-86b6-49f6-98fe-1687587ddca3 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:49:12.393794 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-cd7bf401-86b6-49f6-98fe-1687587ddca3 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459369'] for security_group_rule, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:49:12.402106 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-4e3b8941-aa53-4df2-b5cb-663c9ef9d34d tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:49:12.426714 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd7bf401-86b6-49f6-98fe-1687587ddca3 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=dd6793cf-863c-4f28-98c6-3fd42e1038aa,revision_number=0']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:49:12.430011 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-cd7bf401-86b6-49f6-98fe-1687587ddca3 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:49:12.438127 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-9430c0d6-85bd-4818-9fdd-bf6a2e9d09a3 req-e38711c0-c5bb-4021-af53-e320f759dd1b service neutron] 10.222.0.125 "GET /v2.0/networks/7904a86e-e373-4117-97cd-a894d782e3e5?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2203767
May 25 17:49:12.472303 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-47953747-c7cd-47cf-96fd-3550ddb87ea5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcae5ad0130>, [{'id': 'ed6451cf-7a08-48a6-b823-dd9d01bcee79', 'name': 'tempest-TestMinimumBasicScenario-1304633943-router', 'tenant_id': '79ce7e80f85a4c57896263e5974c8df8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.80'}], 'enable_snat': True}, 'gw_port_id': '6c066f26-0761-4bef-b612-661f04382074', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:48:09Z', 'updated_at': '2021-05-25T17:48:14Z', 'revision_number': 4, 'project_id': '79ce7e80f85a4c57896263e5974c8df8', 'gw_port': {'id': '6c066f26-0761-4bef-b612-661f04382074', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:0c:b5:ed', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ed6451cf-7a08-48a6-b823-dd9d01bcee79', 'device_owner': 'network:router_gateway', 'standard_attr_id': 478, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.80', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:48:10Z', 'updated_at': '2021-05-25T17:48:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi', '_floatingips': [{'id': '7340c255-1f10-4c35-9cef-b0b7daf08937', 'tenant_id': '79ce7e80f85a4c57896263e5974c8df8', 'floating_ip_address': '172.27.3.67', 'floating_network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'router_id': 'ed6451cf-7a08-48a6-b823-dd9d01bcee79', 'port_id': '2f574cd3-1bb5-44f2-895b-c48b9d8c6c8f', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 499, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '7904a86e-e373-4117-97cd-a894d782e3e5', 'mac_address': 'fa:16:3e:9f:0a:27', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0065a651-57d4-42bb-a61b-5b33682e5abb', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T17:49:09Z', 'updated_at': '2021-05-25T17:49:09Z', 'revision_number': 0, 'project_id': '79ce7e80f85a4c57896263e5974c8df8', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '1d7a4034-86b0-49fb-bf45-68dda95544c2', 'name': '', 'network_id': '7904a86e-e373-4117-97cd-a894d782e3e5', 'tenant_id': '79ce7e80f85a4c57896263e5974c8df8', 'mac_address': 'fa:16:3e:46:21:20', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ed6451cf-7a08-48a6-b823-dd9d01bcee79', 'device_owner': 'network:router_interface', 'standard_attr_id': 479, 'fixed_ips': [{'subnet_id': '200f371a-f534-452e-9426-951e43bcffe5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:48:13Z', 'updated_at': '2021-05-25T17:48:19Z', 'revision_number': 5, 'project_id': '79ce7e80f85a4c57896263e5974c8df8', 'subnets': [{'id': '200f371a-f534-452e-9426-951e43bcffe5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-789564-2-iscsi', False) {} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:49:12.476449 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-47953747-c7cd-47cf-96fd-3550ddb87ea5 None None] The sync data for ids ['ed6451cf-7a08-48a6-b823-dd9d01bcee79'] in dv-cinder-789564-2-iscsi is: [{'id': 'ed6451cf-7a08-48a6-b823-dd9d01bcee79', 'name': 'tempest-TestMinimumBasicScenario-1304633943-router', 'tenant_id': '79ce7e80f85a4c57896263e5974c8df8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.80'}], 'enable_snat': True}, 'gw_port_id': '6c066f26-0761-4bef-b612-661f04382074', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:48:09Z', 'updated_at': '2021-05-25T17:48:14Z', 'revision_number': 4, 'project_id': '79ce7e80f85a4c57896263e5974c8df8', 'gw_port': {'id': '6c066f26-0761-4bef-b612-661f04382074', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:0c:b5:ed', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ed6451cf-7a08-48a6-b823-dd9d01bcee79', 'device_owner': 'network:router_gateway', 'standard_attr_id': 478, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.80', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:48:10Z', 'updated_at': '2021-05-25T17:48:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi', '_floatingips': [{'id': '7340c255-1f10-4c35-9cef-b0b7daf08937', 'tenant_id': '79ce7e80f85a4c57896263e5974c8df8', 'floating_ip_address': '172.27.3.67', 'floating_network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'router_id': 'ed6451cf-7a08-48a6-b823-dd9d01bcee79', 'port_id': '2f574cd3-1bb5-44f2-895b-c48b9d8c6c8f', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 499, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '7904a86e-e373-4117-97cd-a894d782e3e5', 'mac_address': 'fa:16:3e:9f:0a:27', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0065a651-57d4-42bb-a61b-5b33682e5abb', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T17:49:09Z', 'updated_at': '2021-05-25T17:49:09Z', 'revision_number': 0, 'project_id': '79ce7e80f85a4c57896263e5974c8df8', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '1d7a4034-86b0-49fb-bf45-68dda95544c2', 'name': '', 'network_id': '7904a86e-e373-4117-97cd-a894d782e3e5', 'tenant_id': '79ce7e80f85a4c57896263e5974c8df8', 'mac_address': 'fa:16:3e:46:21:20', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ed6451cf-7a08-48a6-b823-dd9d01bcee79', 'device_owner': 'network:router_interface', 'standard_attr_id': 479, 'fixed_ips': [{'subnet_id': '200f371a-f534-452e-9426-951e43bcffe5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:48:13Z', 'updated_at': '2021-05-25T17:48:19Z', 'revision_number': 5, 'project_id': '79ce7e80f85a4c57896263e5974c8df8', 'subnets': [{'id': '200f371a-f534-452e-9426-951e43bcffe5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=99028) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 25 17:49:12.508129 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-cd7bf401-86b6-49f6-98fe-1687587ddca3 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Notify callbacks [] for security_group_rule, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:49:12.509393 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-cd7bf401-86b6-49f6-98fe-1687587ddca3 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] 10.222.0.122 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 0.3879726
May 25 17:49:12.512229 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 48536) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:49:12.518325 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.v2.base [None req-fd05245f-4440-49c3-8ec6-79d5f15045cc tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Request body: {'security_group_rule': {'security_group_id': '466efd7c-7fba-415a-9c52-bbb1ea6e12f4', 'project_id': '79ce7e80f85a4c57896263e5974c8df8', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=99026) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:49:12.524436 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-fd05245f-4440-49c3-8ec6-79d5f15045cc tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:49:12.529116 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-fd05245f-4440-49c3-8ec6-79d5f15045cc tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Usage tracker for resource:security_group_rule and tenant:79ce7e80f85a4c57896263e5974c8df8 is out of sync, need to count used quota {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:49:12.532211 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-fd05245f-4440-49c3-8ec6-79d5f15045cc tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:49:12.538908 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-fd05245f-4440-49c3-8ec6-79d5f15045cc tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:49:12.582280 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-9430c0d6-85bd-4818-9fdd-bf6a2e9d09a3 req-716eff25-dfc2-456c-b57d-e8ff8ddb7ad9 service neutron] 10.222.0.125 "GET /v2.0/networks/7904a86e-e373-4117-97cd-a894d782e3e5?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1359875
May 25 17:49:12.641973 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-fd05245f-4440-49c3-8ec6-79d5f15045cc tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Notify callbacks [] for security_group_rule, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:49:12.680868 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-47b29c05-9ef8-4df9-926f-d5a0e963b0cb None None] New status for floating IP 7340c255-1f10-4c35-9cef-b0b7daf08937: ACTIVE {{(pid=99029) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 25 17:49:12.707935 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-fd05245f-4440-49c3-8ec6-79d5f15045cc tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:49:12.833846 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-fd05245f-4440-49c3-8ec6-79d5f15045cc tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459369'] for security_group_rule, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:49:12.835773 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:49:12.861234 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd05245f-4440-49c3-8ec6-79d5f15045cc tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=daf9d9c3-cfdd-4d86-9313-a41421c85827,revision_number=0']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:49:12.867624 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-fd05245f-4440-49c3-8ec6-79d5f15045cc tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.032s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:49:12.954149 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-fd05245f-4440-49c3-8ec6-79d5f15045cc tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Notify callbacks [] for security_group_rule, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:49:12.959997 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-fd05245f-4440-49c3-8ec6-79d5f15045cc tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] 10.222.0.122 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 763 time: 0.4415698
May 25 17:49:12.959997 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 48544) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:49:12.963508 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.v2.base [None req-a4ad2af0-d16c-4579-854a-7f56f7268f24 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Request body: {'security_group_rule': {'security_group_id': '466efd7c-7fba-415a-9c52-bbb1ea6e12f4', 'project_id': '79ce7e80f85a4c57896263e5974c8df8', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=99026) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:49:12.970008 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-a4ad2af0-d16c-4579-854a-7f56f7268f24 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:49:12.975145 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-a4ad2af0-d16c-4579-854a-7f56f7268f24 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Usage tracker for resource:security_group_rule and tenant:79ce7e80f85a4c57896263e5974c8df8 is out of sync, need to count used quota {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:49:12.978450 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-a4ad2af0-d16c-4579-854a-7f56f7268f24 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:49:12.985302 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-a4ad2af0-d16c-4579-854a-7f56f7268f24 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:49:13.136948 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-a4ad2af0-d16c-4579-854a-7f56f7268f24 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Notify callbacks [] for security_group_rule, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:49:13.199742 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-a4ad2af0-d16c-4579-854a-7f56f7268f24 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:49:13.290831 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-a4ad2af0-d16c-4579-854a-7f56f7268f24 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459369'] for security_group_rule, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:49:13.300520 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-cd7bf401-86b6-49f6-98fe-1687587ddca3 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:49:13.319259 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4ad2af0-d16c-4579-854a-7f56f7268f24 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9a40dd95-6ac0-4c95-91aa-470d65ad8e14,revision_number=0']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:49:13.321520 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-a4ad2af0-d16c-4579-854a-7f56f7268f24 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:49:13.435770 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-a4ad2af0-d16c-4579-854a-7f56f7268f24 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Notify callbacks [] for security_group_rule, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:49:13.437065 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-a4ad2af0-d16c-4579-854a-7f56f7268f24 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] 10.222.0.122 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.4776816
May 25 17:49:13.440870 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 48548) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:49:13.448516 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.v2.base [None req-996f7073-506f-4987-aba6-5d6d2c37e9ec tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Request body: {'security_group_rule': {'security_group_id': '466efd7c-7fba-415a-9c52-bbb1ea6e12f4', 'project_id': '79ce7e80f85a4c57896263e5974c8df8', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=99027) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:49:13.458174 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-996f7073-506f-4987-aba6-5d6d2c37e9ec tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:49:13.462149 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-996f7073-506f-4987-aba6-5d6d2c37e9ec tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Usage tracker for resource:security_group_rule and tenant:79ce7e80f85a4c57896263e5974c8df8 is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:49:13.465712 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-996f7073-506f-4987-aba6-5d6d2c37e9ec tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:49:13.474388 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-996f7073-506f-4987-aba6-5d6d2c37e9ec tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:49:13.562737 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-996f7073-506f-4987-aba6-5d6d2c37e9ec tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Notify callbacks [] for security_group_rule, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:49:13.655501 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-996f7073-506f-4987-aba6-5d6d2c37e9ec tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:49:13.777119 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-996f7073-506f-4987-aba6-5d6d2c37e9ec tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459369'] for security_group_rule, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:49:13.779959 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-0a6a4bbc-e1a1-4a3a-8fcb-f91fdd525edc tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:49:13.812808 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-996f7073-506f-4987-aba6-5d6d2c37e9ec tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=7fcc11eb-f759-4d69-96ac-a9cfd571ce81,revision_number=0']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:49:13.815573 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-996f7073-506f-4987-aba6-5d6d2c37e9ec tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.036s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:49:13.937260 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-996f7073-506f-4987-aba6-5d6d2c37e9ec tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Notify callbacks [] for security_group_rule, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:49:13.938466 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-996f7073-506f-4987-aba6-5d6d2c37e9ec tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] 10.222.0.122 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 768 time: 0.4965250
May 25 17:49:13.941105 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 48552) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:49:13.947287 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.v2.base [None req-304d3f38-ebda-43da-a141-e9be23333dc3 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Request body: {'security_group_rule': {'security_group_id': '466efd7c-7fba-415a-9c52-bbb1ea6e12f4', 'project_id': '79ce7e80f85a4c57896263e5974c8df8', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=99027) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:49:13.953457 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-304d3f38-ebda-43da-a141-e9be23333dc3 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:49:13.957288 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-304d3f38-ebda-43da-a141-e9be23333dc3 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Usage tracker for resource:security_group_rule and tenant:79ce7e80f85a4c57896263e5974c8df8 is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:49:13.960743 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-304d3f38-ebda-43da-a141-e9be23333dc3 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:49:13.968202 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-304d3f38-ebda-43da-a141-e9be23333dc3 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:49:14.069753 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.db.securitygroups_db [None req-304d3f38-ebda-43da-a141-e9be23333dc3 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Project 79ce7e80f85a4c57896263e5974c8df8 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted.
May 25 17:49:14.077572 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-304d3f38-ebda-43da-a141-e9be23333dc3 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Notify callbacks [] for security_group_rule, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:49:14.147159 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-304d3f38-ebda-43da-a141-e9be23333dc3 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:49:14.251197 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-304d3f38-ebda-43da-a141-e9be23333dc3 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459369'] for security_group_rule, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:49:14.253208 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:49:14.279695 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-304d3f38-ebda-43da-a141-e9be23333dc3 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=eee945c5-44d0-4c47-994c-d37eb0193b9e,revision_number=0']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:49:14.284137 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-304d3f38-ebda-43da-a141-e9be23333dc3 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:49:14.359798 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-304d3f38-ebda-43da-a141-e9be23333dc3 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Notify callbacks [] for security_group_rule, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:49:14.360995 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-304d3f38-ebda-43da-a141-e9be23333dc3 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] 10.222.0.122 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 774 time: 0.4189646
May 25 17:49:14.363788 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 48560) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:49:14.369666 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.v2.base [None req-5dd1aca0-9757-4bb7-9df5-f593dfd02049 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Request body: {'security_group_rule': {'security_group_id': '466efd7c-7fba-415a-9c52-bbb1ea6e12f4', 'project_id': '79ce7e80f85a4c57896263e5974c8df8', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=99027) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:49:14.376327 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-5dd1aca0-9757-4bb7-9df5-f593dfd02049 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:49:14.380051 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-5dd1aca0-9757-4bb7-9df5-f593dfd02049 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Usage tracker for resource:security_group_rule and tenant:79ce7e80f85a4c57896263e5974c8df8 is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:49:14.382924 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-5dd1aca0-9757-4bb7-9df5-f593dfd02049 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:49:14.389598 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-5dd1aca0-9757-4bb7-9df5-f593dfd02049 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:49:14.474036 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.db.securitygroups_db [None req-5dd1aca0-9757-4bb7-9df5-f593dfd02049 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Project 79ce7e80f85a4c57896263e5974c8df8 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted.
May 25 17:49:14.480291 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-5dd1aca0-9757-4bb7-9df5-f593dfd02049 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Notify callbacks [] for security_group_rule, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:49:14.546741 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-5dd1aca0-9757-4bb7-9df5-f593dfd02049 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:49:14.656070 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-5dd1aca0-9757-4bb7-9df5-f593dfd02049 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459369'] for security_group_rule, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:49:14.658186 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-304d3f38-ebda-43da-a141-e9be23333dc3 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:49:14.680324 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5dd1aca0-9757-4bb7-9df5-f593dfd02049 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d65dea45-b29a-4b06-86b9-1b83b8c0b3d5,revision_number=0']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:49:14.685110 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-5dd1aca0-9757-4bb7-9df5-f593dfd02049 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:49:14.765413 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-5dd1aca0-9757-4bb7-9df5-f593dfd02049 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Notify callbacks [] for security_group_rule, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:49:14.766704 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-5dd1aca0-9757-4bb7-9df5-f593dfd02049 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] 10.222.0.122 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 773 time: 0.4018080
May 25 17:49:14.890547 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-2daa853d-8d1f-4c48-b669-a9280447dfd8 req-23d5afb6-b518-4506-8b05-60111098c641 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Synchronizing usage tracker for tenant:79ce7e80f85a4c57896263e5974c8df8 on resource:security_group {{(pid=99027) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 17:49:14.976730 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-2daa853d-8d1f-4c48-b669-a9280447dfd8 req-23d5afb6-b518-4506-8b05-60111098c641 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Unset dirty status for tenant:79ce7e80f85a4c57896263e5974c8df8 on resource:security_group {{(pid=99027) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 17:49:14.978353 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-2daa853d-8d1f-4c48-b669-a9280447dfd8 req-23d5afb6-b518-4506-8b05-60111098c641 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] 10.222.0.122 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1814385905&fields=id&tenant_id=79ce7e80f85a4c57896263e5974c8df8 HTTP/1.1" status: 200  len: 267 time: 0.1309469
May 25 17:49:15.069409 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2daa853d-8d1f-4c48-b669-a9280447dfd8 req-97d23395-a9cc-4586-aa9e-d3e7225e7aed tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:49:15.072037 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-2daa853d-8d1f-4c48-b669-a9280447dfd8 req-97d23395-a9cc-4586-aa9e-d3e7225e7aed tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] 10.222.0.122 "GET /v2.0/ports?device_id=0065a651-57d4-42bb-a61b-5b33682e5abb HTTP/1.1" status: 200  len: 945 time: 0.0876827
May 25 17:49:15.081909 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.v2.base [req-2daa853d-8d1f-4c48-b669-a9280447dfd8 req-d6f6e584-b7af-4130-b297-831ae646f5f8 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Request body: {'port': {'security_groups': ['f36e68fc-4038-4509-8aec-f49be290aa8b', '466efd7c-7fba-415a-9c52-bbb1ea6e12f4']}} {{(pid=99027) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:49:15.200376 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-2daa853d-8d1f-4c48-b669-a9280447dfd8 req-d6f6e584-b7af-4130-b297-831ae646f5f8 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:49:15.471627 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.db [req-2daa853d-8d1f-4c48-b669-a9280447dfd8 req-d6f6e584-b7af-4130-b297-831ae646f5f8 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] For port 2f574cd3-1bb5-44f2-895b-c48b9d8c6c8f, host hv-cinder-78956, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=2f574cd3-1bb5-44f2-895b-c48b9d8c6c8f,segment=NetworkSegment(343b7bea-3acc-4c9d-939f-d8bc9eea2e5e),segment_id=343b7bea-3acc-4c9d-939f-d8bc9eea2e5e)] {{(pid=99027) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:49:15.496653 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-2daa853d-8d1f-4c48-b669-a9280447dfd8 req-d6f6e584-b7af-4130-b297-831ae646f5f8 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Notify callbacks [] for port, precommit_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:49:15.634060 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-2daa853d-8d1f-4c48-b669-a9280447dfd8 req-d6f6e584-b7af-4130-b297-831ae646f5f8 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15468979'] for port, after_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:49:15.639821 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-48208825-78cb-4c26-bcb1-acd3c173ba7c service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:49:15.643450 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] get_ports_and_sgs() called for port_ids ['2f574cd3-1bb5-44f2-895b-c48b9d8c6c8f'] {{(pid=99028) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 25 17:49:15.708852 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2daa853d-8d1f-4c48-b669-a9280447dfd8 req-d6f6e584-b7af-4130-b297-831ae646f5f8 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:49:15.709516 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-2daa853d-8d1f-4c48-b669-a9280447dfd8 req-d6f6e584-b7af-4130-b297-831ae646f5f8 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-239387'] for port, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:49:15.710903 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-2daa853d-8d1f-4c48-b669-a9280447dfd8 req-d6f6e584-b7af-4130-b297-831ae646f5f8 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] 10.222.0.122 "PUT /v2.0/ports/2f574cd3-1bb5-44f2-895b-c48b9d8c6c8f HTTP/1.1" status: 200  len: 981 time: 0.6337285
May 25 17:49:15.712778 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0065a651-57d4-42bb-a61b-5b33682e5abb', 'tag': '2f574cd3-1bb5-44f2-895b-c48b9d8c6c8f'}] {{(pid=99027) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 17:49:15.735639 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6f6e584-b7af-4130-b297-831ae646f5f8 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Pushing event updated for resources: {'Port': ['ID=2f574cd3-1bb5-44f2-895b-c48b9d8c6c8f,revision_number=6']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:49:15.739203 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-d6f6e584-b7af-4130-b297-831ae646f5f8 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.099s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:49:15.771318 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0065a651-57d4-42bb-a61b-5b33682e5abb', 'tag': '2f574cd3-1bb5-44f2-895b-c48b9d8c6c8f', 'status': 'completed', 'code': 200}
May 25 17:49:15.869797 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] get_ports_and_sgs() called for port_ids ['2f574cd3-1bb5-44f2-895b-c48b9d8c6c8f'] {{(pid=99028) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 25 17:49:15.886995 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90a75de8-1d6d-4a4f-931a-5d68639a7b96 req-570163b5-56bb-4c92-b5f6-1fce0e36e066 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:49:15.888606 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-90a75de8-1d6d-4a4f-931a-5d68639a7b96 req-570163b5-56bb-4c92-b5f6-1fce0e36e066 service neutron] 10.222.0.125 "GET /v2.0/ports?tenant_id=79ce7e80f85a4c57896263e5974c8df8&device_id=0065a651-57d4-42bb-a61b-5b33682e5abb HTTP/1.1" status: 200  len: 1137 time: 0.0930882
May 25 17:49:15.923515 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-078cb08a-5553-4b08-ae3f-c307f4f27da5 req-fd55ebbd-9be8-478b-a411-d4c7a92309f9 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:49:15.925651 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-078cb08a-5553-4b08-ae3f-c307f4f27da5 req-fd55ebbd-9be8-478b-a411-d4c7a92309f9 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] 10.222.0.122 "GET /v2.0/ports?device_id=0065a651-57d4-42bb-a61b-5b33682e5abb HTTP/1.1" status: 200  len: 984 time: 0.0954320
May 25 17:49:15.986901 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-078cb08a-5553-4b08-ae3f-c307f4f27da5 req-10d6dab2-4443-44e5-b16a-fd85261151b8 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] 10.222.0.122 "GET /v2.0/security-groups?id=466efd7c-7fba-415a-9c52-bbb1ea6e12f4&id=f36e68fc-4038-4509-8aec-f49be290aa8b&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0534720
May 25 17:49:16.040841 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90a75de8-1d6d-4a4f-931a-5d68639a7b96 req-0f785146-d21a-41bb-b06a-5ece6a872120 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:49:16.042347 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-90a75de8-1d6d-4a4f-931a-5d68639a7b96 req-0f785146-d21a-41bb-b06a-5ece6a872120 service neutron] 10.222.0.125 "GET /v2.0/networks?id=7904a86e-e373-4117-97cd-a894d782e3e5 HTTP/1.1" status: 200  len: 917 time: 0.1433632
May 25 17:49:16.051231 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-76db18e3-d3a9-450c-9b02-2f8e6236472a None None] Provisioning complete for port 2f574cd3-1bb5-44f2-895b-c48b9d8c6c8f triggered by entity DHCP. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 17:49:16.051609 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-76db18e3-d3a9-450c-9b02-2f8e6236472a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:49:16.158359 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-90a75de8-1d6d-4a4f-931a-5d68639a7b96 req-f4b313fd-5331-4413-844a-110e76f5e35d service neutron] 10.222.0.125 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=2f574cd3-1bb5-44f2-895b-c48b9d8c6c8f HTTP/1.1" status: 200  len: 1000 time: 0.1075430
May 25 17:49:16.233638 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90a75de8-1d6d-4a4f-931a-5d68639a7b96 req-76f12fb6-3216-4b83-abe8-161f4a2e5831 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:49:16.235146 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-90a75de8-1d6d-4a4f-931a-5d68639a7b96 req-76f12fb6-3216-4b83-abe8-161f4a2e5831 service neutron] 10.222.0.125 "GET /v2.0/subnets?id=200f371a-f534-452e-9426-951e43bcffe5 HTTP/1.1" status: 200  len: 854 time: 0.0694041
May 25 17:49:16.328708 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90a75de8-1d6d-4a4f-931a-5d68639a7b96 req-f864840c-e6fc-4cf4-8e5e-f0d819e03519 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:49:16.330221 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-90a75de8-1d6d-4a4f-931a-5d68639a7b96 req-f864840c-e6fc-4cf4-8e5e-f0d819e03519 service neutron] 10.222.0.125 "GET /v2.0/ports?network_id=7904a86e-e373-4117-97cd-a894d782e3e5&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0869911
May 25 17:49:16.472084 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-90a75de8-1d6d-4a4f-931a-5d68639a7b96 req-af7ae7fe-83d0-4496-bf8e-3311b257a254 service neutron] 10.222.0.125 "GET /v2.0/networks/7904a86e-e373-4117-97cd-a894d782e3e5?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1365769
May 25 17:49:16.697804 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-90a75de8-1d6d-4a4f-931a-5d68639a7b96 req-2cf39735-ffaf-4c05-a708-ff79f264b242 service neutron] 10.222.0.125 "GET /v2.0/networks/7904a86e-e373-4117-97cd-a894d782e3e5?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2185357
May 25 17:49:18.171272 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-db40554e-9a45-4bd9-9e31-bca3fd78e648 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:49:20.651619 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-1c5e148b-cd5c-4957-9fff-1b57b5b684a7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:49:20.838902 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:49:21.719573 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-7e261f94-b84f-443e-be49-3bc1ac903b55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:49:23.290600 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-6df2b2a7-a54e-4d57-9be3-033078b9d5b3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:49:24.770711 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.agents_db [None req-14fae233-15dc-4576-836b-621c5f95b584 None None] Agent healthcheck: found 6 active agents {{(pid=99029) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 17:49:41.531152 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:49:44.895117 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-ac277467-b6fb-4d7e-893d-17feeec9188d req-1e90ff69-ec77-46b7-ba89-c74a6d746236 service neutron] 10.222.0.125 "GET /v2.0/ports?device_id=446d90e5-0bef-47f6-852a-61b638d2a161&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.0708296
May 25 17:49:45.043665 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac277467-b6fb-4d7e-893d-17feeec9188d req-2d5c26d2-4d25-4608-991a-2a0ce60e8d2a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:49:45.045192 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-ac277467-b6fb-4d7e-893d-17feeec9188d req-2d5c26d2-4d25-4608-991a-2a0ce60e8d2a service neutron] 10.222.0.125 "GET /v2.0/ports?tenant_id=b4cdc54b260f4e79b87fdf4a43b12e16&device_id=446d90e5-0bef-47f6-852a-61b638d2a161 HTTP/1.1" status: 200  len: 1099 time: 0.0748250
May 25 17:49:45.198313 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac277467-b6fb-4d7e-893d-17feeec9188d req-9e935597-a48c-4f56-b423-9fc9ec60ce6a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:49:45.199741 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-ac277467-b6fb-4d7e-893d-17feeec9188d req-9e935597-a48c-4f56-b423-9fc9ec60ce6a service neutron] 10.222.0.125 "GET /v2.0/networks?id=defaef08-c0f9-4608-b66d-b97e06e185bf HTTP/1.1" status: 200  len: 913 time: 0.1318755
May 25 17:49:45.305598 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-ac277467-b6fb-4d7e-893d-17feeec9188d req-cc265337-d68b-4e8d-906f-5c4082827842 service neutron] 10.222.0.125 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=841b2456-1a8a-47bd-a481-929b9038fe0d HTTP/1.1" status: 200  len: 1002 time: 0.0975392
May 25 17:49:45.373483 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac277467-b6fb-4d7e-893d-17feeec9188d req-0a8a3714-68f3-4f63-9be9-3f6e7322e803 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:49:45.375119 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-ac277467-b6fb-4d7e-893d-17feeec9188d req-0a8a3714-68f3-4f63-9be9-3f6e7322e803 service neutron] 10.222.0.125 "GET /v2.0/subnets?id=5be08358-9d04-4ee9-91ac-104e66e66e20 HTTP/1.1" status: 200  len: 850 time: 0.0620668
May 25 17:49:45.454150 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac277467-b6fb-4d7e-893d-17feeec9188d req-3a4f67b1-49b1-43bf-a7ad-81ad8b3c34f4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:49:45.455652 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-ac277467-b6fb-4d7e-893d-17feeec9188d req-3a4f67b1-49b1-43bf-a7ad-81ad8b3c34f4 service neutron] 10.222.0.125 "GET /v2.0/ports?network_id=defaef08-c0f9-4608-b66d-b97e06e185bf&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0720329
May 25 17:49:45.593303 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-ac277467-b6fb-4d7e-893d-17feeec9188d req-9cdef730-6f0b-4804-9149-fe13b6eb6488 service neutron] 10.222.0.125 "GET /v2.0/networks/defaef08-c0f9-4608-b66d-b97e06e185bf?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1288714
May 25 17:49:45.729090 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-ac277467-b6fb-4d7e-893d-17feeec9188d req-4f395552-69b4-46cb-aebc-af3ef47cb7a5 service neutron] 10.222.0.125 "GET /v2.0/networks/defaef08-c0f9-4608-b66d-b97e06e185bf?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1276145
May 25 17:49:48.148168 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-fbfb1d4a-4c94-4da4-97a5-35a89fc027d7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:49:50.668208 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4cbc5fde-6ac5-4a71-ad9b-c1587dfd2349 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:49:50.839722 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:49:51.742392 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-7e261f94-b84f-443e-be49-3bc1ac903b55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:49:53.279884 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-6df2b2a7-a54e-4d57-9be3-033078b9d5b3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:50:01.770338 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.agents_db [None req-14fae233-15dc-4576-836b-621c5f95b584 None None] Agent healthcheck: found 6 active agents {{(pid=99029) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 17:50:11.542651 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:50:18.165374 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-c8323ef0-c874-42e0-881b-390af43d3494 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:50:20.691086 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-eaedd4a8-b93f-4eb9-96c6-1d43f601f3fc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:50:20.884479 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:50:21.690149 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-7e261f94-b84f-443e-be49-3bc1ac903b55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:50:23.285437 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-6df2b2a7-a54e-4d57-9be3-033078b9d5b3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:50:38.769331 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.agents_db [None req-14fae233-15dc-4576-836b-621c5f95b584 None None] Agent healthcheck: found 6 active agents {{(pid=99029) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 17:50:41.582876 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:50:44.980550 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-fc50caeb-9b26-4dfe-be2b-dd14581818a9 req-4bb31145-7ebe-43e6-aa29-21472860b719 service neutron] 10.222.0.125 "GET /v2.0/ports?device_id=00d13d2c-33fc-42ec-a80d-4cd8155b6fe1&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.0749328
May 25 17:50:45.076005 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc50caeb-9b26-4dfe-be2b-dd14581818a9 req-639556b2-00a1-42d1-bb2e-b3f2e4f2e327 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:50:45.077515 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-fc50caeb-9b26-4dfe-be2b-dd14581818a9 req-639556b2-00a1-42d1-bb2e-b3f2e4f2e327 service neutron] 10.222.0.125 "GET /v2.0/ports?tenant_id=cf02997eda314aee8fb322add2fbb921&device_id=00d13d2c-33fc-42ec-a80d-4cd8155b6fe1 HTTP/1.1" status: 200  len: 1098 time: 0.0732436
May 25 17:50:45.231763 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc50caeb-9b26-4dfe-be2b-dd14581818a9 req-dd94dd84-936f-4a88-a7c8-f92400bc81af service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:50:45.233320 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-fc50caeb-9b26-4dfe-be2b-dd14581818a9 req-dd94dd84-936f-4a88-a7c8-f92400bc81af service neutron] 10.222.0.125 "GET /v2.0/networks?id=45b850af-d423-458a-855a-d7f828a11fff HTTP/1.1" status: 200  len: 919 time: 0.1346033
May 25 17:50:45.340655 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-fc50caeb-9b26-4dfe-be2b-dd14581818a9 req-f8756da6-7232-4b31-821c-5f4c741c14f1 service neutron] 10.222.0.125 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=5c96172a-06f4-41ce-b47a-f1bbde47e41c HTTP/1.1" status: 200  len: 999 time: 0.0996614
May 25 17:50:45.404921 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc50caeb-9b26-4dfe-be2b-dd14581818a9 req-b0e3a166-593a-4475-8abb-1e8496317c14 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:50:45.406402 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-fc50caeb-9b26-4dfe-be2b-dd14581818a9 req-b0e3a166-593a-4475-8abb-1e8496317c14 service neutron] 10.222.0.125 "GET /v2.0/subnets?id=704d0a85-ee4f-4df2-90a3-a525dfe28461 HTTP/1.1" status: 200  len: 856 time: 0.0585854
May 25 17:50:45.489920 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc50caeb-9b26-4dfe-be2b-dd14581818a9 req-aa543e8c-2f00-4172-be1b-608da7824198 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:50:45.491301 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-fc50caeb-9b26-4dfe-be2b-dd14581818a9 req-aa543e8c-2f00-4172-be1b-608da7824198 service neutron] 10.222.0.125 "GET /v2.0/ports?network_id=45b850af-d423-458a-855a-d7f828a11fff&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0767334
May 25 17:50:45.629361 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-fc50caeb-9b26-4dfe-be2b-dd14581818a9 req-e550cb4f-1142-4d06-b3bc-c75e85a98910 service neutron] 10.222.0.125 "GET /v2.0/networks/45b850af-d423-458a-855a-d7f828a11fff?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1282372
May 25 17:50:45.846229 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-fc50caeb-9b26-4dfe-be2b-dd14581818a9 req-f71c6c35-7c40-45bd-9b50-aab86c3dd650 service neutron] 10.222.0.125 "GET /v2.0/networks/45b850af-d423-458a-855a-d7f828a11fff?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2080767
May 25 17:50:48.187490 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-3d29a252-e19a-49dd-804c-75e73840c1a3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:50:50.674222 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-749317c6-d0b1-4685-b8ed-762887c30cb8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:50:50.839729 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:50:51.697038 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-7e261f94-b84f-443e-be49-3bc1ac903b55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:50:53.291410 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-6df2b2a7-a54e-4d57-9be3-033078b9d5b3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:51:11.571168 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:51:15.768000 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.agents_db [None req-14fae233-15dc-4576-836b-621c5f95b584 None None] Agent healthcheck: found 6 active agents {{(pid=99029) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 17:51:18.137369 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-b0eb02e3-02ce-4ad0-8eeb-d39c99738010 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:51:20.640398 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-ee9e587e-0f47-4b4d-b400-8e563cb9cc94 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:51:20.838270 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:51:21.697254 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-7e261f94-b84f-443e-be49-3bc1ac903b55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:51:23.283916 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-6df2b2a7-a54e-4d57-9be3-033078b9d5b3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:51:41.617684 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:51:44.926428 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-b8fbd218-f9c4-42ab-9b0a-c123f2f68529 req-216ae47c-6149-4ab1-8a0a-eef4109673de service neutron] 10.222.0.125 "GET /v2.0/ports?device_id=0065a651-57d4-42bb-a61b-5b33682e5abb&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.0696278
May 25 17:51:45.025349 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8fbd218-f9c4-42ab-9b0a-c123f2f68529 req-531fd185-d090-438d-998c-558c57c84d33 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:51:45.026802 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-b8fbd218-f9c4-42ab-9b0a-c123f2f68529 req-531fd185-d090-438d-998c-558c57c84d33 service neutron] 10.222.0.125 "GET /v2.0/ports?tenant_id=79ce7e80f85a4c57896263e5974c8df8&device_id=0065a651-57d4-42bb-a61b-5b33682e5abb HTTP/1.1" status: 200  len: 1137 time: 0.0752358
May 25 17:51:45.174775 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8fbd218-f9c4-42ab-9b0a-c123f2f68529 req-0bbae5e6-9baa-41fa-beb8-0ade6ef0317e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:51:45.176342 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-b8fbd218-f9c4-42ab-9b0a-c123f2f68529 req-0bbae5e6-9baa-41fa-beb8-0ade6ef0317e service neutron] 10.222.0.125 "GET /v2.0/networks?id=7904a86e-e373-4117-97cd-a894d782e3e5 HTTP/1.1" status: 200  len: 917 time: 0.1312616
May 25 17:51:45.284729 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-b8fbd218-f9c4-42ab-9b0a-c123f2f68529 req-2d52f80f-676f-4597-a315-723f88b05fc5 service neutron] 10.222.0.125 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=2f574cd3-1bb5-44f2-895b-c48b9d8c6c8f HTTP/1.1" status: 200  len: 1000 time: 0.0995748
May 25 17:51:45.348863 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8fbd218-f9c4-42ab-9b0a-c123f2f68529 req-f56951bd-f1b3-4565-ae9c-822842946e7d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:51:45.350376 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-b8fbd218-f9c4-42ab-9b0a-c123f2f68529 req-f56951bd-f1b3-4565-ae9c-822842946e7d service neutron] 10.222.0.125 "GET /v2.0/subnets?id=200f371a-f534-452e-9426-951e43bcffe5 HTTP/1.1" status: 200  len: 854 time: 0.0580883
May 25 17:51:45.430955 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8fbd218-f9c4-42ab-9b0a-c123f2f68529 req-c2b03346-58e7-4663-92f0-69c4eacc9953 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:51:45.432438 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-b8fbd218-f9c4-42ab-9b0a-c123f2f68529 req-c2b03346-58e7-4663-92f0-69c4eacc9953 service neutron] 10.222.0.125 "GET /v2.0/ports?network_id=7904a86e-e373-4117-97cd-a894d782e3e5&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0744371
May 25 17:51:45.566383 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-b8fbd218-f9c4-42ab-9b0a-c123f2f68529 req-0708b89b-caea-40e5-ac38-cbf01b5d01a0 service neutron] 10.222.0.125 "GET /v2.0/networks/7904a86e-e373-4117-97cd-a894d782e3e5?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1249952
May 25 17:51:45.699540 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-b8fbd218-f9c4-42ab-9b0a-c123f2f68529 req-6e1ee24b-3231-49dd-9b81-cbdf880fb1e1 service neutron] 10.222.0.125 "GET /v2.0/networks/7904a86e-e373-4117-97cd-a894d782e3e5?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1256077
May 25 17:51:48.152933 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-ba5e541f-0df1-46cc-ba9f-ffd8baf665ca None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:51:50.628660 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-449c2292-0ab8-4bb6-9beb-d1a90b2756b3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:51:50.868619 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:51:51.695751 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-7e261f94-b84f-443e-be49-3bc1ac903b55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:51:52.767354 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.agents_db [None req-14fae233-15dc-4576-836b-621c5f95b584 None None] Agent healthcheck: found 6 active agents {{(pid=99029) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 17:51:53.295626 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-6df2b2a7-a54e-4d57-9be3-033078b9d5b3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:52:11.617188 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:52:18.178083 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-a9a17ca5-6836-470d-a852-23d2feff7629 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:52:20.629173 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-6334545f-9114-446c-8417-433a6bab8671 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:52:20.855193 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:52:21.817771 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-7e261f94-b84f-443e-be49-3bc1ac903b55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:52:23.290023 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-6df2b2a7-a54e-4d57-9be3-033078b9d5b3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:52:29.767132 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.agents_db [None req-14fae233-15dc-4576-836b-621c5f95b584 None None] Agent healthcheck: found 6 active agents {{(pid=99029) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 17:52:41.593063 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:52:44.974085 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-8b880b2d-9e57-445c-b78e-ebb29b0da080 req-f871e78e-483c-4ac4-ae4c-79cee72198ce service neutron] 10.222.0.125 "GET /v2.0/ports?device_id=446d90e5-0bef-47f6-852a-61b638d2a161&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.1164649
May 25 17:52:45.120535 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b880b2d-9e57-445c-b78e-ebb29b0da080 req-bddc4b2f-88c8-4fa0-82d3-f38c670a900e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:52:45.121954 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-8b880b2d-9e57-445c-b78e-ebb29b0da080 req-bddc4b2f-88c8-4fa0-82d3-f38c670a900e service neutron] 10.222.0.125 "GET /v2.0/ports?tenant_id=b4cdc54b260f4e79b87fdf4a43b12e16&device_id=446d90e5-0bef-47f6-852a-61b638d2a161 HTTP/1.1" status: 200  len: 1099 time: 0.0731025
May 25 17:52:45.273716 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b880b2d-9e57-445c-b78e-ebb29b0da080 req-48393d86-1401-4b11-b4ba-b34cb793bf75 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:52:45.275150 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-8b880b2d-9e57-445c-b78e-ebb29b0da080 req-48393d86-1401-4b11-b4ba-b34cb793bf75 service neutron] 10.222.0.125 "GET /v2.0/networks?id=defaef08-c0f9-4608-b66d-b97e06e185bf HTTP/1.1" status: 200  len: 913 time: 0.1312263
May 25 17:52:45.387237 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-8b880b2d-9e57-445c-b78e-ebb29b0da080 req-7a4ffdbf-15d6-4730-bd89-61aaec3fc569 service neutron] 10.222.0.125 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=841b2456-1a8a-47bd-a481-929b9038fe0d HTTP/1.1" status: 200  len: 1002 time: 0.0990362
May 25 17:52:45.446332 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b880b2d-9e57-445c-b78e-ebb29b0da080 req-f8fb91ce-ef52-46d6-aaee-6ab34cb7e9c8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:52:45.447764 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-8b880b2d-9e57-445c-b78e-ebb29b0da080 req-f8fb91ce-ef52-46d6-aaee-6ab34cb7e9c8 service neutron] 10.222.0.125 "GET /v2.0/subnets?id=5be08358-9d04-4ee9-91ac-104e66e66e20 HTTP/1.1" status: 200  len: 850 time: 0.0609794
May 25 17:52:45.522520 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b880b2d-9e57-445c-b78e-ebb29b0da080 req-fcc9962c-e524-4cfd-8609-974af8273730 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:52:45.523980 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-8b880b2d-9e57-445c-b78e-ebb29b0da080 req-fcc9962c-e524-4cfd-8609-974af8273730 service neutron] 10.222.0.125 "GET /v2.0/ports?network_id=defaef08-c0f9-4608-b66d-b97e06e185bf&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0712047
May 25 17:52:45.534612 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [req-8b880b2d-9e57-445c-b78e-ebb29b0da080 req-07941217-44b5-4c71-8b46-d06fe9c1c673 service neutron] http://10.222.0.122:9696/v2.0/extensions returned with HTTP 200 {{(pid=99027) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 25 17:52:45.535498 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-8b880b2d-9e57-445c-b78e-ebb29b0da080 req-07941217-44b5-4c71-8b46-d06fe9c1c673 service neutron] 10.222.0.125 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.0048788
May 25 17:52:45.675877 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-8b880b2d-9e57-445c-b78e-ebb29b0da080 req-c8fa570c-a191-4170-9a01-6983234cae40 service neutron] 10.222.0.125 "GET /v2.0/networks/defaef08-c0f9-4608-b66d-b97e06e185bf?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1337643
May 25 17:52:45.888041 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-8b880b2d-9e57-445c-b78e-ebb29b0da080 req-133d3daf-6562-4939-bda5-10acb8225a70 service neutron] 10.222.0.125 "GET /v2.0/networks/defaef08-c0f9-4608-b66d-b97e06e185bf?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2052555
May 25 17:52:48.192920 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-1baaec8c-dfd0-4c43-a628-d7db09264d0b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:52:48.623425 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-bc04aea7-8c82-43c0-8f04-1640395f4fc9 req-7c31d589-d4f9-438f-8739-3078711b8c8b tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] 10.222.0.122 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1814385905&fields=id&tenant_id=79ce7e80f85a4c57896263e5974c8df8 HTTP/1.1" status: 200  len: 267 time: 0.0966680
May 25 17:52:48.715198 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc04aea7-8c82-43c0-8f04-1640395f4fc9 req-4252c5b7-8eab-4691-b5db-056c07a514be tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:52:48.716746 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-bc04aea7-8c82-43c0-8f04-1640395f4fc9 req-4252c5b7-8eab-4691-b5db-056c07a514be tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] 10.222.0.122 "GET /v2.0/ports?device_id=0065a651-57d4-42bb-a61b-5b33682e5abb HTTP/1.1" status: 200  len: 984 time: 0.0858996
May 25 17:52:48.730678 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.v2.base [req-bc04aea7-8c82-43c0-8f04-1640395f4fc9 req-decba094-5d8f-408f-bd88-34da27663c2d tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Request body: {'port': {'security_groups': ['f36e68fc-4038-4509-8aec-f49be290aa8b']}} {{(pid=99026) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:52:48.884859 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6da2e85-28f2-4611-8ce3-4b22e4447985 req-dc57d08f-9e9c-471b-be28-803cee6b49a5 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:52:48.886349 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-b6da2e85-28f2-4611-8ce3-4b22e4447985 req-dc57d08f-9e9c-471b-be28-803cee6b49a5 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] 10.222.0.122 "GET /v2.0/ports?device_id=446d90e5-0bef-47f6-852a-61b638d2a161 HTTP/1.1" status: 200  len: 946 time: 0.1425030
May 25 17:52:48.890104 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [req-bc04aea7-8c82-43c0-8f04-1640395f4fc9 req-decba094-5d8f-408f-bd88-34da27663c2d tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:52:48.970212 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-b6da2e85-28f2-4611-8ce3-4b22e4447985 req-2827b30a-00c7-4522-98d2-92319cc69335 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] 10.222.0.122 "GET /v2.0/security-groups?id=82248efd-bb41-43a8-9551-d25c3e3aa06c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0781314
May 25 17:52:49.018296 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2f18049-ed97-4b51-8b7f-0c85cb49423c req-dc9ff1da-d00a-4ad7-880b-e2abd08f24b1 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:52:49.020283 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-d2f18049-ed97-4b51-8b7f-0c85cb49423c req-dc9ff1da-d00a-4ad7-880b-e2abd08f24b1 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] 10.222.0.125 "GET /v2.0/ports?device_id=446d90e5-0bef-47f6-852a-61b638d2a161 HTTP/1.1" status: 200  len: 946 time: 0.0893176
May 25 17:52:49.145887 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.db [req-bc04aea7-8c82-43c0-8f04-1640395f4fc9 req-decba094-5d8f-408f-bd88-34da27663c2d tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] For port 2f574cd3-1bb5-44f2-895b-c48b9d8c6c8f, host hv-cinder-78956, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=2f574cd3-1bb5-44f2-895b-c48b9d8c6c8f,segment=NetworkSegment(343b7bea-3acc-4c9d-939f-d8bc9eea2e5e),segment_id=343b7bea-3acc-4c9d-939f-d8bc9eea2e5e)] {{(pid=99026) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:52:49.163489 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.plugin [req-d2f18049-ed97-4b51-8b7f-0c85cb49423c req-887c0a5b-9377-40ad-bf51-a66e5e8550fb tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Deleting port 841b2456-1a8a-47bd-a481-929b9038fe0d {{(pid=99027) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 17:52:49.163825 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-d2f18049-ed97-4b51-8b7f-0c85cb49423c req-887c0a5b-9377-40ad-bf51-a66e5e8550fb tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781841220419'] for port, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:52:49.171205 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [req-bc04aea7-8c82-43c0-8f04-1640395f4fc9 req-decba094-5d8f-408f-bd88-34da27663c2d tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Notify callbacks [] for port, precommit_update {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:52:49.240291 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [req-bc04aea7-8c82-43c0-8f04-1640395f4fc9 req-decba094-5d8f-408f-bd88-34da27663c2d tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15476529'] for port, after_update {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:52:49.246140 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-10f4a4fe-3f29-45f5-a579-2b6360486995 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:52:49.256813 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] get_ports_and_sgs() called for port_ids ['2f574cd3-1bb5-44f2-895b-c48b9d8c6c8f'] {{(pid=99028) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 25 17:52:49.306554 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.db [req-d2f18049-ed97-4b51-8b7f-0c85cb49423c req-887c0a5b-9377-40ad-bf51-a66e5e8550fb tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] For port 841b2456-1a8a-47bd-a481-929b9038fe0d, host hv-cinder-78956, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=841b2456-1a8a-47bd-a481-929b9038fe0d,segment=NetworkSegment(9ffd894c-b357-4c03-93af-a222f8984466),segment_id=9ffd894c-b357-4c03-93af-a222f8984466)] {{(pid=99027) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:52:49.306812 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-d2f18049-ed97-4b51-8b7f-0c85cb49423c req-887c0a5b-9377-40ad-bf51-a66e5e8550fb tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-418810'] for port, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:52:49.319539 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc04aea7-8c82-43c0-8f04-1640395f4fc9 req-decba094-5d8f-408f-bd88-34da27663c2d tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:52:49.320178 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [req-bc04aea7-8c82-43c0-8f04-1640395f4fc9 req-decba094-5d8f-408f-bd88-34da27663c2d tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-239387'] for port, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:52:49.328018 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-bc04aea7-8c82-43c0-8f04-1640395f4fc9 req-decba094-5d8f-408f-bd88-34da27663c2d tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] 10.222.0.122 "PUT /v2.0/ports/2f574cd3-1bb5-44f2-895b-c48b9d8c6c8f HTTP/1.1" status: 200  len: 942 time: 0.6042647
May 25 17:52:49.328587 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0065a651-57d4-42bb-a61b-5b33682e5abb', 'tag': '2f574cd3-1bb5-44f2-895b-c48b9d8c6c8f'}] {{(pid=99026) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 17:52:49.359855 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 48836) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:52:49.373151 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-decba094-5d8f-408f-bd88-34da27663c2d tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Pushing event updated for resources: {'Port': ['ID=2f574cd3-1bb5-44f2-895b-c48b9d8c6c8f,revision_number=7']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:52:49.386707 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-decba094-5d8f-408f-bd88-34da27663c2d tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:52:49.387140 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-decba094-5d8f-408f-bd88-34da27663c2d tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:52:49.387556 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-decba094-5d8f-408f-bd88-34da27663c2d tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:52:49.387923 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-decba094-5d8f-408f-bd88-34da27663c2d tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:52:49.389336 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-decba094-5d8f-408f-bd88-34da27663c2d tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:52:49.389336 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-decba094-5d8f-408f-bd88-34da27663c2d tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:52:49.389336 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-decba094-5d8f-408f-bd88-34da27663c2d tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:52:49.389336 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-decba094-5d8f-408f-bd88-34da27663c2d tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:52:49.389757 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-decba094-5d8f-408f-bd88-34da27663c2d tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:52:49.390424 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-decba094-5d8f-408f-bd88-34da27663c2d tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:52:49.390424 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-decba094-5d8f-408f-bd88-34da27663c2d tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:52:49.390757 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-decba094-5d8f-408f-bd88-34da27663c2d tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:52:49.435016 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-decba094-5d8f-408f-bd88-34da27663c2d tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.189s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:52:49.474526 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0065a651-57d4-42bb-a61b-5b33682e5abb', 'tag': '2f574cd3-1bb5-44f2-895b-c48b9d8c6c8f', 'status': 'completed', 'code': 200}
May 25 17:52:49.489009 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-ccec9fc7-bcd2-4ac6-a9e5-98c513ec0fb5 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Notify callbacks [] for security_group, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:52:49.493624 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] get_ports_and_sgs() called for port_ids ['2f574cd3-1bb5-44f2-895b-c48b9d8c6c8f'] {{(pid=99028) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 25 17:52:49.578567 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-ccec9fc7-bcd2-4ac6-a9e5-98c513ec0fb5 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Notify callbacks [] for security_group, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:52:49.633146 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-e7878478-54e5-411c-a229-ad4ca65971d9 None None] Provisioning complete for port 2f574cd3-1bb5-44f2-895b-c48b9d8c6c8f triggered by entity DHCP. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 17:52:49.633579 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-e7878478-54e5-411c-a229-ad4ca65971d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:52:49.634715 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d722fa82-7f75-4768-bfc0-cd7525a70f68 req-4b29e3ae-b551-4498-b1b2-7f9bfda90a06 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:52:49.636208 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-d722fa82-7f75-4768-bfc0-cd7525a70f68 req-4b29e3ae-b551-4498-b1b2-7f9bfda90a06 service neutron] 10.222.0.125 "GET /v2.0/ports?tenant_id=79ce7e80f85a4c57896263e5974c8df8&device_id=0065a651-57d4-42bb-a61b-5b33682e5abb HTTP/1.1" status: 200  len: 1098 time: 0.1441958
May 25 17:52:49.645976 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-d2f18049-ed97-4b51-8b7f-0c85cb49423c req-887c0a5b-9377-40ad-bf51-a66e5e8550fb tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify callbacks [] for floatingip, precommit_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:52:49.646404 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-d2f18049-ed97-4b51-8b7f-0c85cb49423c req-887c0a5b-9377-40ad-bf51-a66e5e8550fb tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-419865'] for floatingip, after_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:52:49.646724 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.db.l3_db [req-d2f18049-ed97-4b51-8b7f-0c85cb49423c req-887c0a5b-9377-40ad-bf51-a66e5e8550fb tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Floating IP b8a63c59-5bb4-4dba-9942-ee1a0066a9c7 disassociated. External IP: 172.27.3.117, port: 841b2456-1a8a-47bd-a481-929b9038fe0d.
May 25 17:52:49.647094 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.plugin [req-d2f18049-ed97-4b51-8b7f-0c85cb49423c req-887c0a5b-9377-40ad-bf51-a66e5e8550fb tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Calling delete_port for 841b2456-1a8a-47bd-a481-929b9038fe0d owned by compute:nova {{(pid=99027) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 17:52:49.867447 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-d2f18049-ed97-4b51-8b7f-0c85cb49423c req-887c0a5b-9377-40ad-bf51-a66e5e8550fb tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781841222566', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781840788188', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15468986'] for port, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:52:49.871743 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d722fa82-7f75-4768-bfc0-cd7525a70f68 req-712342ab-fd32-4763-bde5-2e8102c37b4f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:52:49.875422 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-d722fa82-7f75-4768-bfc0-cd7525a70f68 req-712342ab-fd32-4763-bde5-2e8102c37b4f service neutron] 10.222.0.125 "GET /v2.0/networks?id=7904a86e-e373-4117-97cd-a894d782e3e5 HTTP/1.1" status: 200  len: 917 time: 0.2309904
May 25 17:52:49.875563 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-e389e06a-4d6c-4aa0-a0ec-24818b85cd45 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:52:49.919358 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-887c0a5b-9377-40ad-bf51-a66e5e8550fb tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Pushing event deleted for resources: {'Port': ['ID=841b2456-1a8a-47bd-a481-929b9038fe0d,revision_number=None']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:52:49.930366 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-887c0a5b-9377-40ad-bf51-a66e5e8550fb tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:52:49.930693 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-887c0a5b-9377-40ad-bf51-a66e5e8550fb tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:52:49.931072 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-887c0a5b-9377-40ad-bf51-a66e5e8550fb tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:52:49.931414 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-887c0a5b-9377-40ad-bf51-a66e5e8550fb tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:52:49.931767 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-887c0a5b-9377-40ad-bf51-a66e5e8550fb tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:52:49.932117 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-887c0a5b-9377-40ad-bf51-a66e5e8550fb tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:52:49.932463 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-887c0a5b-9377-40ad-bf51-a66e5e8550fb tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:52:49.935482 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-887c0a5b-9377-40ad-bf51-a66e5e8550fb tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:52:49.935634 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-ccec9fc7-bcd2-4ac6-a9e5-98c513ec0fb5 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:52:49.938976 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-887c0a5b-9377-40ad-bf51-a66e5e8550fb tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:52:49.938976 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-887c0a5b-9377-40ad-bf51-a66e5e8550fb tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:52:49.938976 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-887c0a5b-9377-40ad-bf51-a66e5e8550fb tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:52:49.938976 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-887c0a5b-9377-40ad-bf51-a66e5e8550fb tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:52:49.939686 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-177d4da4-fc7b-4b3d-b4b8-7b8424809204 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:52:49.945156 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-887c0a5b-9377-40ad-bf51-a66e5e8550fb tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:52:49.975063 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ccec9fc7-bcd2-4ac6-a9e5-98c513ec0fb5 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=466efd7c-7fba-415a-9c52-bbb1ea6e12f4,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:52:49.984907 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-ccec9fc7-bcd2-4ac6-a9e5-98c513ec0fb5 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.041s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:52:50.014840 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-d722fa82-7f75-4768-bfc0-cd7525a70f68 req-55d17d6b-77ba-4148-9775-48fc3517a8b5 service neutron] 10.222.0.125 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=2f574cd3-1bb5-44f2-895b-c48b9d8c6c8f HTTP/1.1" status: 200  len: 1000 time: 0.1353095
May 25 17:52:50.077463 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-ccec9fc7-bcd2-4ac6-a9e5-98c513ec0fb5 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Notify callbacks [] for security_group, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:52:50.078595 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-ccec9fc7-bcd2-4ac6-a9e5-98c513ec0fb5 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] 10.222.0.122 "DELETE /v2.0/security-groups/466efd7c-7fba-415a-9c52-bbb1ea6e12f4 HTTP/1.1" status: 204  len: 168 time: 0.7416070
May 25 17:52:50.082653 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 48846) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:52:50.149921 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.l3_agent_scheduler [req-d2f18049-ed97-4b51-8b7f-0c85cb49423c req-887c0a5b-9377-40ad-bf51-a66e5e8550fb tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Router d71e624d-d858-442b-b878-577be49edd03 has already been hosted by L3 agent eaeb6875-c4ed-43b6-8658-aa4e52324fdf {{(pid=99027) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 25 17:52:50.229456 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-94a87214-db34-4176-bb3c-3590f0491700 req-42233344-d1dc-4ace-a1a4-b39b407cf46c tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] 10.222.0.122 "GET /v2.0/ports?device_id=446d90e5-0bef-47f6-852a-61b638d2a161 HTTP/1.1" status: 200  len: 210 time: 0.0711377
May 25 17:52:50.230813 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d722fa82-7f75-4768-bfc0-cd7525a70f68 req-a98e7f64-69e4-49ec-919e-dfd6499e1afe service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:52:50.232242 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-d722fa82-7f75-4768-bfc0-cd7525a70f68 req-a98e7f64-69e4-49ec-919e-dfd6499e1afe service neutron] 10.222.0.125 "GET /v2.0/subnets?id=200f371a-f534-452e-9426-951e43bcffe5 HTTP/1.1" status: 200  len: 854 time: 0.2084742
May 25 17:52:50.333815 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-d2f18049-ed97-4b51-8b7f-0c85cb49423c req-887c0a5b-9377-40ad-bf51-a66e5e8550fb tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify agent at l3_agent.dv-cinder-789564-2-iscsi the message routers_updated {{(pid=99027) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 25 17:52:50.343230 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-961c9f6f-48b5-421b-ab81-1ca2268199e7 None None] Sync routers for ids ['d71e624d-d858-442b-b878-577be49edd03'] in dv-cinder-789564-2-iscsi {{(pid=99028) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 25 17:52:50.353707 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvrscheduler_db [None req-961c9f6f-48b5-421b-ab81-1ca2268199e7 None None] Routers {'d71e624d-d858-442b-b878-577be49edd03'} bound to L3 agent in host dv-cinder-789564-2-iscsi {{(pid=99028) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 17:52:50.354429 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-961c9f6f-48b5-421b-ab81-1ca2268199e7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcae7c2b250>, 'dv-cinder-789564-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T17:34:21Z,description=<?>,heartbeat_timestamp=2021-05-25T17:52:21Z,host='dv-cinder-789564-2-iscsi',id=eaeb6875-c4ed-43b6-8658-aa4e52324fdf,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T17:34:21Z,topic='l3_agent')) {'router_ids': ['d71e624d-d858-442b-b878-577be49edd03'], 'active': True} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:52:50.413743 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.l3_dvrscheduler_db [req-d2f18049-ed97-4b51-8b7f-0c85cb49423c req-887c0a5b-9377-40ad-bf51-a66e5e8550fb tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] No DVR routers for this DVR port 841b2456-1a8a-47bd-a481-929b9038fe0d on host hv-cinder-78956 {{(pid=99027) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 25 17:52:50.416278 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-d2f18049-ed97-4b51-8b7f-0c85cb49423c req-887c0a5b-9377-40ad-bf51-a66e5e8550fb tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-239387'] for port, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:52:50.420152 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '446d90e5-0bef-47f6-852a-61b638d2a161', 'name': 'network-vif-deleted', 'tag': '841b2456-1a8a-47bd-a481-929b9038fe0d'}] {{(pid=99027) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 17:52:50.463978 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d722fa82-7f75-4768-bfc0-cd7525a70f68 req-d0d22498-9310-4d0a-8f99-210f6e2ee65c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:52:50.465535 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-d722fa82-7f75-4768-bfc0-cd7525a70f68 req-d0d22498-9310-4d0a-8f99-210f6e2ee65c service neutron] 10.222.0.125 "GET /v2.0/ports?network_id=7904a86e-e373-4117-97cd-a894d782e3e5&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.2231581
May 25 17:52:50.471370 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '446d90e5-0bef-47f6-852a-61b638d2a161', 'name': 'network-vif-deleted', 'tag': '841b2456-1a8a-47bd-a481-929b9038fe0d', 'status': 'completed', 'code': 200}
May 25 17:52:50.497607 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-d2f18049-ed97-4b51-8b7f-0c85cb49423c req-887c0a5b-9377-40ad-bf51-a66e5e8550fb tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] 10.222.0.125 "DELETE /v2.0/ports/841b2456-1a8a-47bd-a481-929b9038fe0d HTTP/1.1" status: 204  len: 173 time: 1.4701855
May 25 17:52:50.518971 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.plugin [None req-e86bca68-74f2-4100-990a-1c7c1cd7149f tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Deleting port bb08b8b5-9db4-430f-af5a-c3af49b29b5b {{(pid=99026) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 17:52:50.519637 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-e86bca68-74f2-4100-990a-1c7c1cd7149f tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781841220419'] for port, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:52:50.543959 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvr_db [None req-961c9f6f-48b5-421b-ab81-1ca2268199e7 None None] Set router d71e624d-d858-442b-b878-577be49edd03 gateway port host: dv-cinder-789564-2-iscsi {{(pid=99028) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 17:52:50.705594 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-61597314-63ec-4983-b50f-07e632f470b3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:52:50.734998 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-d722fa82-7f75-4768-bfc0-cd7525a70f68 req-fcdd819d-9904-4358-a27b-5edaa6b32a17 service neutron] 10.222.0.125 "GET /v2.0/networks/7904a86e-e373-4117-97cd-a894d782e3e5?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2489209
May 25 17:52:50.736528 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-e86bca68-74f2-4100-990a-1c7c1cd7149f tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-418810'] for port, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:52:50.736851 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-e86bca68-74f2-4100-990a-1c7c1cd7149f tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:52:50.867427 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:52:50.898214 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-961c9f6f-48b5-421b-ab81-1ca2268199e7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcae7c2b250>, [{'id': 'd71e624d-d858-442b-b878-577be49edd03', 'name': 'tempest-AttachVolumeTestJSON-1986395052-router', 'tenant_id': 'b4cdc54b260f4e79b87fdf4a43b12e16', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.176'}], 'enable_snat': True}, 'gw_port_id': '9635c7b0-eb08-41ee-980e-3da56221f88d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:42:22Z', 'updated_at': '2021-05-25T17:42:34Z', 'revision_number': 4, 'project_id': 'b4cdc54b260f4e79b87fdf4a43b12e16', 'gw_port': {'id': '9635c7b0-eb08-41ee-980e-3da56221f88d', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:44:59', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd71e624d-d858-442b-b878-577be49edd03', 'device_owner': 'network:router_gateway', 'standard_attr_id': 80, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.176', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:42:23Z', 'updated_at': '2021-05-25T17:42:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi', '_interfaces': [{'id': 'd13f3233-9e09-41c7-8315-4eae735fe605', 'name': '', 'network_id': 'defaef08-c0f9-4608-b66d-b97e06e185bf', 'tenant_id': 'b4cdc54b260f4e79b87fdf4a43b12e16', 'mac_address': 'fa:16:3e:87:b7:74', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd71e624d-d858-442b-b878-577be49edd03', 'device_owner': 'network:router_interface', 'standard_attr_id': 106, 'fixed_ips': [{'subnet_id': '5be08358-9d04-4ee9-91ac-104e66e66e20', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:42:29Z', 'updated_at': '2021-05-25T17:42:46Z', 'revision_number': 5, 'project_id': 'b4cdc54b260f4e79b87fdf4a43b12e16', 'subnets': [{'id': '5be08358-9d04-4ee9-91ac-104e66e66e20', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-789564-2-iscsi', False) {} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:52:50.903982 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-961c9f6f-48b5-421b-ab81-1ca2268199e7 None None] Checking router: d71e624d-d858-442b-b878-577be49edd03 for host: dv-cinder-789564-2-iscsi {{(pid=99028) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 25 17:52:50.913989 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvrscheduler_db [None req-961c9f6f-48b5-421b-ab81-1ca2268199e7 None None] Routers {'d71e624d-d858-442b-b878-577be49edd03'} bound to L3 agent in host dv-cinder-789564-2-iscsi {{(pid=99028) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 17:52:50.914619 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-961c9f6f-48b5-421b-ab81-1ca2268199e7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcae7c2b250>, 'dv-cinder-789564-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T17:34:21Z,description=<?>,heartbeat_timestamp=2021-05-25T17:52:51Z,host='dv-cinder-789564-2-iscsi',id=eaeb6875-c4ed-43b6-8658-aa4e52324fdf,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T17:34:21Z,topic='l3_agent')) {'router_ids': ['d71e624d-d858-442b-b878-577be49edd03'], 'active': True} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:52:50.926834 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.plugin [None req-e86bca68-74f2-4100-990a-1c7c1cd7149f tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Calling delete_port for bb08b8b5-9db4-430f-af5a-c3af49b29b5b owned by network:floatingip {{(pid=99026) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 17:52:51.017212 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-d722fa82-7f75-4768-bfc0-cd7525a70f68 req-122df6e4-a5f4-46c7-af87-b4af107bc865 service neutron] 10.222.0.125 "GET /v2.0/networks/7904a86e-e373-4117-97cd-a894d782e3e5?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2723026
May 25 17:52:51.095881 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvr_db [None req-961c9f6f-48b5-421b-ab81-1ca2268199e7 None None] Set router d71e624d-d858-442b-b878-577be49edd03 gateway port host: dv-cinder-789564-2-iscsi {{(pid=99028) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 17:52:51.246850 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-e86bca68-74f2-4100-990a-1c7c1cd7149f tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781841222566', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781840788188', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15476536'] for port, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:52:51.253767 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-decba094-5d8f-408f-bd88-34da27663c2d tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:52:51.305461 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e86bca68-74f2-4100-990a-1c7c1cd7149f tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Pushing event deleted for resources: {'Port': ['ID=bb08b8b5-9db4-430f-af5a-c3af49b29b5b,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:52:51.341809 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-e86bca68-74f2-4100-990a-1c7c1cd7149f tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:52:51.457826 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-961c9f6f-48b5-421b-ab81-1ca2268199e7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcae7c2b250>, [{'id': 'd71e624d-d858-442b-b878-577be49edd03', 'name': 'tempest-AttachVolumeTestJSON-1986395052-router', 'tenant_id': 'b4cdc54b260f4e79b87fdf4a43b12e16', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.176'}], 'enable_snat': True}, 'gw_port_id': '9635c7b0-eb08-41ee-980e-3da56221f88d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:42:22Z', 'updated_at': '2021-05-25T17:42:34Z', 'revision_number': 4, 'project_id': 'b4cdc54b260f4e79b87fdf4a43b12e16', 'gw_port': {'id': '9635c7b0-eb08-41ee-980e-3da56221f88d', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:44:59', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd71e624d-d858-442b-b878-577be49edd03', 'device_owner': 'network:router_gateway', 'standard_attr_id': 80, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.176', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:42:23Z', 'updated_at': '2021-05-25T17:42:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi', '_interfaces': [{'id': 'd13f3233-9e09-41c7-8315-4eae735fe605', 'name': '', 'network_id': 'defaef08-c0f9-4608-b66d-b97e06e185bf', 'tenant_id': 'b4cdc54b260f4e79b87fdf4a43b12e16', 'mac_address': 'fa:16:3e:87:b7:74', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd71e624d-d858-442b-b878-577be49edd03', 'device_owner': 'network:router_interface', 'standard_attr_id': 106, 'fixed_ips': [{'subnet_id': '5be08358-9d04-4ee9-91ac-104e66e66e20', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:42:29Z', 'updated_at': '2021-05-25T17:42:46Z', 'revision_number': 5, 'project_id': 'b4cdc54b260f4e79b87fdf4a43b12e16', 'subnets': [{'id': '5be08358-9d04-4ee9-91ac-104e66e66e20', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-789564-2-iscsi', False) {} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:52:51.462185 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-961c9f6f-48b5-421b-ab81-1ca2268199e7 None None] The sync data for ids ['d71e624d-d858-442b-b878-577be49edd03'] in dv-cinder-789564-2-iscsi is: [{'id': 'd71e624d-d858-442b-b878-577be49edd03', 'name': 'tempest-AttachVolumeTestJSON-1986395052-router', 'tenant_id': 'b4cdc54b260f4e79b87fdf4a43b12e16', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.176'}], 'enable_snat': True}, 'gw_port_id': '9635c7b0-eb08-41ee-980e-3da56221f88d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:42:22Z', 'updated_at': '2021-05-25T17:42:34Z', 'revision_number': 4, 'project_id': 'b4cdc54b260f4e79b87fdf4a43b12e16', 'gw_port': {'id': '9635c7b0-eb08-41ee-980e-3da56221f88d', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:44:59', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd71e624d-d858-442b-b878-577be49edd03', 'device_owner': 'network:router_gateway', 'standard_attr_id': 80, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.176', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:42:23Z', 'updated_at': '2021-05-25T17:42:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi', '_interfaces': [{'id': 'd13f3233-9e09-41c7-8315-4eae735fe605', 'name': '', 'network_id': 'defaef08-c0f9-4608-b66d-b97e06e185bf', 'tenant_id': 'b4cdc54b260f4e79b87fdf4a43b12e16', 'mac_address': 'fa:16:3e:87:b7:74', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd71e624d-d858-442b-b878-577be49edd03', 'device_owner': 'network:router_interface', 'standard_attr_id': 106, 'fixed_ips': [{'subnet_id': '5be08358-9d04-4ee9-91ac-104e66e66e20', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:42:29Z', 'updated_at': '2021-05-25T17:42:46Z', 'revision_number': 5, 'project_id': 'b4cdc54b260f4e79b87fdf4a43b12e16', 'subnets': [{'id': '5be08358-9d04-4ee9-91ac-104e66e66e20', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=99028) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 25 17:52:51.561024 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-fbff6b53-e0f8-489b-905d-be80f52c2222 req-541a3365-c07c-4cf0-be26-c8f8d057896f tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] 10.222.0.122 "GET /v2.0/ports?device_id=446d90e5-0bef-47f6-852a-61b638d2a161 HTTP/1.1" status: 200  len: 210 time: 0.1869226
May 25 17:52:51.579760 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-e86bca68-74f2-4100-990a-1c7c1cd7149f tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Notify callbacks [] for floatingip, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:52:51.580167 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.db.l3_db [None req-e86bca68-74f2-4100-990a-1c7c1cd7149f tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Floating IP 7340c255-1f10-4c35-9cef-b0b7daf08937 disassociated (deleted). External IP: 172.27.3.67, port: 2f574cd3-1bb5-44f2-895b-c48b9d8c6c8f.
May 25 17:52:51.722667 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8863d363-6d2e-407d-aa61-8807637b2758 None None] New status for floating IP b8a63c59-5bb4-4dba-9942-ee1a0066a9c7: DOWN {{(pid=99029) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 25 17:52:51.743368 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-7e261f94-b84f-443e-be49-3bc1ac903b55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:52:51.967169 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e86bca68-74f2-4100-990a-1c7c1cd7149f tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Router ed6451cf-7a08-48a6-b823-dd9d01bcee79 has already been hosted by L3 agent eaeb6875-c4ed-43b6-8658-aa4e52324fdf {{(pid=99026) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 25 17:52:52.148611 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e86bca68-74f2-4100-990a-1c7c1cd7149f tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Notify agent at l3_agent.dv-cinder-789564-2-iscsi the message routers_updated {{(pid=99026) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 25 17:52:52.157772 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-81884d9d-e56a-447c-be18-0080f44b3eb1 None None] Sync routers for ids ['ed6451cf-7a08-48a6-b823-dd9d01bcee79'] in dv-cinder-789564-2-iscsi {{(pid=99028) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 25 17:52:52.166984 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvrscheduler_db [None req-81884d9d-e56a-447c-be18-0080f44b3eb1 None None] Routers {'ed6451cf-7a08-48a6-b823-dd9d01bcee79'} bound to L3 agent in host dv-cinder-789564-2-iscsi {{(pid=99028) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 17:52:52.167635 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-81884d9d-e56a-447c-be18-0080f44b3eb1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcae6c80400>, 'dv-cinder-789564-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T17:34:21Z,description=<?>,heartbeat_timestamp=2021-05-25T17:52:51Z,host='dv-cinder-789564-2-iscsi',id=eaeb6875-c4ed-43b6-8658-aa4e52324fdf,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T17:34:21Z,topic='l3_agent')) {'router_ids': ['ed6451cf-7a08-48a6-b823-dd9d01bcee79'], 'active': True} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:52:52.245738 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-e86bca68-74f2-4100-990a-1c7c1cd7149f tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-239387'] for floatingip, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:52:52.303815 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-e86bca68-74f2-4100-990a-1c7c1cd7149f tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] 10.222.0.122 "DELETE /v2.0/floatingips/7340c255-1f10-4c35-9cef-b0b7daf08937 HTTP/1.1" status: 204  len: 168 time: 2.2117026
May 25 17:52:52.304639 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0065a651-57d4-42bb-a61b-5b33682e5abb', 'tag': '2f574cd3-1bb5-44f2-895b-c48b9d8c6c8f'}] {{(pid=99026) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 17:52:52.358410 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0065a651-57d4-42bb-a61b-5b33682e5abb', 'tag': '2f574cd3-1bb5-44f2-895b-c48b9d8c6c8f', 'status': 'completed', 'code': 200}
May 25 17:52:52.362656 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvr_db [None req-81884d9d-e56a-447c-be18-0080f44b3eb1 None None] Set router ed6451cf-7a08-48a6-b823-dd9d01bcee79 gateway port host: dv-cinder-789564-2-iscsi {{(pid=99028) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 17:52:52.453395 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-859cfbae-e95a-42f4-969f-59c466a5ef25 req-212fe5ff-732d-4f42-b87d-d738d681252b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:52:52.455217 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-859cfbae-e95a-42f4-969f-59c466a5ef25 req-212fe5ff-732d-4f42-b87d-d738d681252b service neutron] 10.222.0.125 "GET /v2.0/ports?tenant_id=79ce7e80f85a4c57896263e5974c8df8&device_id=0065a651-57d4-42bb-a61b-5b33682e5abb HTTP/1.1" status: 200  len: 1098 time: 0.0736277
May 25 17:52:52.610921 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-859cfbae-e95a-42f4-969f-59c466a5ef25 req-9d1236df-4dd3-4ac5-9ea8-3b1737a9cd49 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:52:52.613342 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-859cfbae-e95a-42f4-969f-59c466a5ef25 req-9d1236df-4dd3-4ac5-9ea8-3b1737a9cd49 service neutron] 10.222.0.125 "GET /v2.0/networks?id=7904a86e-e373-4117-97cd-a894d782e3e5 HTTP/1.1" status: 200  len: 917 time: 0.1478992
May 25 17:52:52.692805 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-859cfbae-e95a-42f4-969f-59c466a5ef25 req-1acbeb1f-fe8e-4e04-bbe7-ff9188add94b service neutron] 10.222.0.125 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=2f574cd3-1bb5-44f2-895b-c48b9d8c6c8f HTTP/1.1" status: 200  len: 217 time: 0.0695746
May 25 17:52:52.693662 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-81884d9d-e56a-447c-be18-0080f44b3eb1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcae6c80400>, [{'id': 'ed6451cf-7a08-48a6-b823-dd9d01bcee79', 'name': 'tempest-TestMinimumBasicScenario-1304633943-router', 'tenant_id': '79ce7e80f85a4c57896263e5974c8df8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.80'}], 'enable_snat': True}, 'gw_port_id': '6c066f26-0761-4bef-b612-661f04382074', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:48:09Z', 'updated_at': '2021-05-25T17:48:14Z', 'revision_number': 4, 'project_id': '79ce7e80f85a4c57896263e5974c8df8', 'gw_port': {'id': '6c066f26-0761-4bef-b612-661f04382074', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:0c:b5:ed', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ed6451cf-7a08-48a6-b823-dd9d01bcee79', 'device_owner': 'network:router_gateway', 'standard_attr_id': 478, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.80', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:48:10Z', 'updated_at': '2021-05-25T17:48:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi', '_interfaces': [{'id': '1d7a4034-86b0-49fb-bf45-68dda95544c2', 'name': '', 'network_id': '7904a86e-e373-4117-97cd-a894d782e3e5', 'tenant_id': '79ce7e80f85a4c57896263e5974c8df8', 'mac_address': 'fa:16:3e:46:21:20', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ed6451cf-7a08-48a6-b823-dd9d01bcee79', 'device_owner': 'network:router_interface', 'standard_attr_id': 479, 'fixed_ips': [{'subnet_id': '200f371a-f534-452e-9426-951e43bcffe5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:48:13Z', 'updated_at': '2021-05-25T17:48:19Z', 'revision_number': 5, 'project_id': '79ce7e80f85a4c57896263e5974c8df8', 'subnets': [{'id': '200f371a-f534-452e-9426-951e43bcffe5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-789564-2-iscsi', False) {} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:52:52.697707 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-81884d9d-e56a-447c-be18-0080f44b3eb1 None None] Checking router: ed6451cf-7a08-48a6-b823-dd9d01bcee79 for host: dv-cinder-789564-2-iscsi {{(pid=99028) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 25 17:52:52.707809 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvrscheduler_db [None req-81884d9d-e56a-447c-be18-0080f44b3eb1 None None] Routers {'ed6451cf-7a08-48a6-b823-dd9d01bcee79'} bound to L3 agent in host dv-cinder-789564-2-iscsi {{(pid=99028) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 17:52:52.708604 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-81884d9d-e56a-447c-be18-0080f44b3eb1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcae6c80400>, 'dv-cinder-789564-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T17:34:21Z,description=<?>,heartbeat_timestamp=2021-05-25T17:52:51Z,host='dv-cinder-789564-2-iscsi',id=eaeb6875-c4ed-43b6-8658-aa4e52324fdf,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T17:34:21Z,topic='l3_agent')) {'router_ids': ['ed6451cf-7a08-48a6-b823-dd9d01bcee79'], 'active': True} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:52:52.759568 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-859cfbae-e95a-42f4-969f-59c466a5ef25 req-2a8a991b-6f96-40ab-b8c7-a74e0bc0291b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:52:52.760964 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-859cfbae-e95a-42f4-969f-59c466a5ef25 req-2a8a991b-6f96-40ab-b8c7-a74e0bc0291b service neutron] 10.222.0.125 "GET /v2.0/subnets?id=200f371a-f534-452e-9426-951e43bcffe5 HTTP/1.1" status: 200  len: 854 time: 0.0607836
May 25 17:52:52.813480 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 48866) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:52:52.844579 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-859cfbae-e95a-42f4-969f-59c466a5ef25 req-a4481033-9d46-4c1f-b7ab-904137dc0955 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:52:52.846742 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-859cfbae-e95a-42f4-969f-59c466a5ef25 req-a4481033-9d46-4c1f-b7ab-904137dc0955 service neutron] 10.222.0.125 "GET /v2.0/ports?network_id=7904a86e-e373-4117-97cd-a894d782e3e5&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0771513
May 25 17:52:52.888396 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-c5568da2-d3c6-4199-baad-51eaf92dcf9d tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify callbacks [] for security_group, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:52:52.911243 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvr_db [None req-81884d9d-e56a-447c-be18-0080f44b3eb1 None None] Set router ed6451cf-7a08-48a6-b823-dd9d01bcee79 gateway port host: dv-cinder-789564-2-iscsi {{(pid=99028) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 17:52:52.918404 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-c5568da2-d3c6-4199-baad-51eaf92dcf9d tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify callbacks [] for security_group, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:52:53.023885 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-859cfbae-e95a-42f4-969f-59c466a5ef25 req-2cac2d0d-de0f-476a-a422-a117f030e20c service neutron] 10.222.0.125 "GET /v2.0/networks/7904a86e-e373-4117-97cd-a894d782e3e5?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1607027
May 25 17:52:53.068915 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-c5568da2-d3c6-4199-baad-51eaf92dcf9d tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:52:53.074037 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-c5c95fb7-e8b8-4c6b-900f-7ac269a411f4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:52:53.093215 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5568da2-d3c6-4199-baad-51eaf92dcf9d tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=82248efd-bb41-43a8-9551-d25c3e3aa06c,revision_number=None']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:52:53.095683 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-c5568da2-d3c6-4199-baad-51eaf92dcf9d tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.022s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:52:53.165854 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-859cfbae-e95a-42f4-969f-59c466a5ef25 req-df667a80-e325-4f2d-919e-30f4de3438f9 service neutron] 10.222.0.125 "GET /v2.0/networks/7904a86e-e373-4117-97cd-a894d782e3e5?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1341069
May 25 17:52:53.194267 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-c5568da2-d3c6-4199-baad-51eaf92dcf9d tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify callbacks [] for security_group, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:52:53.195410 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-c5568da2-d3c6-4199-baad-51eaf92dcf9d tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] 10.222.0.122 "DELETE /v2.0/security-groups/82248efd-bb41-43a8-9551-d25c3e3aa06c HTTP/1.1" status: 204  len: 168 time: 0.3808730
May 25 17:52:53.198055 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 48872) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:52:53.218795 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Device 841b2456-1a8a-47bd-a481-929b9038fe0d no longer exists at agent hyperv_hv-cinder-78956 {{(pid=99028) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 17:52:53.290718 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.plugin [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] No Port match for: 841b2456-1a8a-47bd-a481-929b9038fe0d {{(pid=99028) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 25 17:52:53.291013 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Device 841b2456-1a8a-47bd-a481-929b9038fe0d not bound to the agent host hv-cinder-78956 {{(pid=99028) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 25 17:52:53.309388 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.api.v2.resource [None req-5add487b-9d79-4043-b580-5dfef70b53c2 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] show failed (client error): The resource could not be found.
May 25 17:52:53.310412 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-5add487b-9d79-4043-b580-5dfef70b53c2 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] 10.222.0.122 "GET /v2.0/security-groups/82248efd-bb41-43a8-9551-d25c3e3aa06c HTTP/1.1" status: 404  len: 347 time: 0.1114166
May 25 17:52:53.313602 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 48876) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:52:53.334206 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-81884d9d-e56a-447c-be18-0080f44b3eb1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcae6c80400>, [{'id': 'ed6451cf-7a08-48a6-b823-dd9d01bcee79', 'name': 'tempest-TestMinimumBasicScenario-1304633943-router', 'tenant_id': '79ce7e80f85a4c57896263e5974c8df8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.80'}], 'enable_snat': True}, 'gw_port_id': '6c066f26-0761-4bef-b612-661f04382074', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:48:09Z', 'updated_at': '2021-05-25T17:48:14Z', 'revision_number': 4, 'project_id': '79ce7e80f85a4c57896263e5974c8df8', 'gw_port': {'id': '6c066f26-0761-4bef-b612-661f04382074', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:0c:b5:ed', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ed6451cf-7a08-48a6-b823-dd9d01bcee79', 'device_owner': 'network:router_gateway', 'standard_attr_id': 478, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.80', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:48:10Z', 'updated_at': '2021-05-25T17:48:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi', '_interfaces': [{'id': '1d7a4034-86b0-49fb-bf45-68dda95544c2', 'name': '', 'network_id': '7904a86e-e373-4117-97cd-a894d782e3e5', 'tenant_id': '79ce7e80f85a4c57896263e5974c8df8', 'mac_address': 'fa:16:3e:46:21:20', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ed6451cf-7a08-48a6-b823-dd9d01bcee79', 'device_owner': 'network:router_interface', 'standard_attr_id': 479, 'fixed_ips': [{'subnet_id': '200f371a-f534-452e-9426-951e43bcffe5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:48:13Z', 'updated_at': '2021-05-25T17:48:19Z', 'revision_number': 5, 'project_id': '79ce7e80f85a4c57896263e5974c8df8', 'subnets': [{'id': '200f371a-f534-452e-9426-951e43bcffe5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-789564-2-iscsi', False) {} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:52:53.338290 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-81884d9d-e56a-447c-be18-0080f44b3eb1 None None] The sync data for ids ['ed6451cf-7a08-48a6-b823-dd9d01bcee79'] in dv-cinder-789564-2-iscsi is: [{'id': 'ed6451cf-7a08-48a6-b823-dd9d01bcee79', 'name': 'tempest-TestMinimumBasicScenario-1304633943-router', 'tenant_id': '79ce7e80f85a4c57896263e5974c8df8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.80'}], 'enable_snat': True}, 'gw_port_id': '6c066f26-0761-4bef-b612-661f04382074', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:48:09Z', 'updated_at': '2021-05-25T17:48:14Z', 'revision_number': 4, 'project_id': '79ce7e80f85a4c57896263e5974c8df8', 'gw_port': {'id': '6c066f26-0761-4bef-b612-661f04382074', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:0c:b5:ed', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ed6451cf-7a08-48a6-b823-dd9d01bcee79', 'device_owner': 'network:router_gateway', 'standard_attr_id': 478, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.80', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:48:10Z', 'updated_at': '2021-05-25T17:48:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi', '_interfaces': [{'id': '1d7a4034-86b0-49fb-bf45-68dda95544c2', 'name': '', 'network_id': '7904a86e-e373-4117-97cd-a894d782e3e5', 'tenant_id': '79ce7e80f85a4c57896263e5974c8df8', 'mac_address': 'fa:16:3e:46:21:20', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ed6451cf-7a08-48a6-b823-dd9d01bcee79', 'device_owner': 'network:router_interface', 'standard_attr_id': 479, 'fixed_ips': [{'subnet_id': '200f371a-f534-452e-9426-951e43bcffe5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:48:13Z', 'updated_at': '2021-05-25T17:48:19Z', 'revision_number': 5, 'project_id': '79ce7e80f85a4c57896263e5974c8df8', 'subnets': [{'id': '200f371a-f534-452e-9426-951e43bcffe5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=99028) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 25 17:52:53.387250 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-6df2b2a7-a54e-4d57-9be3-033078b9d5b3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:52:53.576553 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dd75fcdc-0552-4f7d-8041-ca9f92a73d9c None None] New status for floating IP 7340c255-1f10-4c35-9cef-b0b7daf08937: DOWN {{(pid=99029) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 25 17:52:53.656031 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.plugin [None req-b2d25bb2-cecb-4d35-a19d-7befdbb943d3 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Deleting port 2a26b78b-8465-42a9-8373-8418f6764e8d {{(pid=99026) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 17:52:53.656406 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-b2d25bb2-cecb-4d35-a19d-7befdbb943d3 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781841220419'] for port, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:52:53.778775 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-b2d25bb2-cecb-4d35-a19d-7befdbb943d3 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-418810'] for port, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:52:53.779116 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-b2d25bb2-cecb-4d35-a19d-7befdbb943d3 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:52:53.902548 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.plugin [None req-b2d25bb2-cecb-4d35-a19d-7befdbb943d3 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Calling delete_port for 2a26b78b-8465-42a9-8373-8418f6764e8d owned by network:floatingip {{(pid=99026) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 17:52:54.063304 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-b2d25bb2-cecb-4d35-a19d-7befdbb943d3 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781841222566', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781840788188', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15476536'] for port, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:52:54.067908 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-20656e40-86f4-4c3e-85c5-439b64c63cce admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:52:54.116742 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2d25bb2-cecb-4d35-a19d-7befdbb943d3 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Pushing event deleted for resources: {'Port': ['ID=2a26b78b-8465-42a9-8373-8418f6764e8d,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:52:54.119574 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-b2d25bb2-cecb-4d35-a19d-7befdbb943d3 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:52:54.210507 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-b2d25bb2-cecb-4d35-a19d-7befdbb943d3 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify callbacks [] for floatingip, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:52:54.225463 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-b2d25bb2-cecb-4d35-a19d-7befdbb943d3 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-239387'] for floatingip, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:52:54.233676 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-b2d25bb2-cecb-4d35-a19d-7befdbb943d3 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] 10.222.0.122 "DELETE /v2.0/floatingips/b8a63c59-5bb4-4dba-9942-ee1a0066a9c7 HTTP/1.1" status: 204  len: 168 time: 0.9120362
May 25 17:52:54.819754 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 48884) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:52:54.825134 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.v2.base [None req-21eef6b4-2021-4352-aacf-114f26e64a0c tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Request body: {'security_group': {'name': 'tempest-securitygroup--410326810', 'description': 'tempest-description--1208066004'}} {{(pid=99026) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:52:54.831709 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-21eef6b4-2021-4352-aacf-114f26e64a0c tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:52:54.835951 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-21eef6b4-2021-4352-aacf-114f26e64a0c tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Usage tracker for resource:security_group and tenant:b4cdc54b260f4e79b87fdf4a43b12e16 is out of sync, need to count used quota {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:52:54.839082 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-21eef6b4-2021-4352-aacf-114f26e64a0c tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:52:54.844841 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-21eef6b4-2021-4352-aacf-114f26e64a0c tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:52:54.926072 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-21eef6b4-2021-4352-aacf-114f26e64a0c tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify callbacks [] for security_group, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:52:54.946440 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-21eef6b4-2021-4352-aacf-114f26e64a0c tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:52:54.950379 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-21eef6b4-2021-4352-aacf-114f26e64a0c tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Usage tracker for resource:security_group_rule and tenant:b4cdc54b260f4e79b87fdf4a43b12e16 is out of sync, need to count used quota {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:52:54.953220 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-21eef6b4-2021-4352-aacf-114f26e64a0c tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:52:54.959644 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-21eef6b4-2021-4352-aacf-114f26e64a0c tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:52:55.030548 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-21eef6b4-2021-4352-aacf-114f26e64a0c tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify callbacks [] for security_group, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:52:55.114731 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-21eef6b4-2021-4352-aacf-114f26e64a0c tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:52:55.121232 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-6355b5de-e413-40e7-a277-fe70bbe6b268 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:52:55.163548 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21eef6b4-2021-4352-aacf-114f26e64a0c tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Pushing event updated for resources: {'SecurityGroup': ['ID=beb878a4-0349-4b8d-8e49-88c1a35c8216,revision_number=1']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:52:55.166422 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-21eef6b4-2021-4352-aacf-114f26e64a0c tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:52:55.267248 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-21eef6b4-2021-4352-aacf-114f26e64a0c tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify callbacks [] for security_group, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:52:55.269923 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-21eef6b4-2021-4352-aacf-114f26e64a0c tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] 10.222.0.122 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1779 time: 0.4490111
May 25 17:52:55.273170 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 48894) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:52:55.278429 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.v2.base [None req-ba7d8393-47b6-4ca7-ba09-773c64515fde tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Request body: {'security_group_rule': {'security_group_id': 'beb878a4-0349-4b8d-8e49-88c1a35c8216', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=99026) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:52:55.284645 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-ba7d8393-47b6-4ca7-ba09-773c64515fde tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:52:55.288745 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-ba7d8393-47b6-4ca7-ba09-773c64515fde tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Usage tracker for resource:security_group_rule and tenant:b4cdc54b260f4e79b87fdf4a43b12e16 is out of sync, need to count used quota {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:52:55.291716 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-ba7d8393-47b6-4ca7-ba09-773c64515fde tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:52:55.297487 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-ba7d8393-47b6-4ca7-ba09-773c64515fde tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:52:55.408698 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-ba7d8393-47b6-4ca7-ba09-773c64515fde tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify callbacks [] for security_group_rule, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:52:55.463779 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-ba7d8393-47b6-4ca7-ba09-773c64515fde tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:52:55.548832 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-ba7d8393-47b6-4ca7-ba09-773c64515fde tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459369'] for security_group_rule, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:52:55.551518 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:52:55.574230 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba7d8393-47b6-4ca7-ba09-773c64515fde tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e29c167b-0f6b-45a0-928f-9ce322ab622c,revision_number=0']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:52:55.576559 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-ba7d8393-47b6-4ca7-ba09-773c64515fde tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:52:55.668911 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-ba7d8393-47b6-4ca7-ba09-773c64515fde tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify callbacks [] for security_group_rule, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:52:55.675196 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-ba7d8393-47b6-4ca7-ba09-773c64515fde tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] 10.222.0.122 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 0.3961167
May 25 17:52:55.675196 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 48902) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:52:55.679037 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.v2.base [None req-eed45a4c-5f97-4543-a403-11718623dc55 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Request body: {'security_group_rule': {'security_group_id': 'beb878a4-0349-4b8d-8e49-88c1a35c8216', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=99026) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:52:55.684900 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-eed45a4c-5f97-4543-a403-11718623dc55 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:52:55.689027 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-eed45a4c-5f97-4543-a403-11718623dc55 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Usage tracker for resource:security_group_rule and tenant:b4cdc54b260f4e79b87fdf4a43b12e16 is out of sync, need to count used quota {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:52:55.692832 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-eed45a4c-5f97-4543-a403-11718623dc55 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:52:55.698551 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-eed45a4c-5f97-4543-a403-11718623dc55 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:52:55.766070 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-eed45a4c-5f97-4543-a403-11718623dc55 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify callbacks [] for security_group_rule, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:52:55.831494 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-eed45a4c-5f97-4543-a403-11718623dc55 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:52:55.912759 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-eed45a4c-5f97-4543-a403-11718623dc55 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459369'] for security_group_rule, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:52:55.914962 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-ba7d8393-47b6-4ca7-ba09-773c64515fde tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:52:55.937974 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eed45a4c-5f97-4543-a403-11718623dc55 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=ed1c5c53-eb87-4268-a836-621dc38dfeed,revision_number=0']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:52:55.940407 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-eed45a4c-5f97-4543-a403-11718623dc55 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:52:56.026981 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-eed45a4c-5f97-4543-a403-11718623dc55 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify callbacks [] for security_group_rule, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:52:56.028407 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-eed45a4c-5f97-4543-a403-11718623dc55 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] 10.222.0.122 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.3545380
May 25 17:52:56.031476 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 48906) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:52:56.037350 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.v2.base [None req-ec66aca7-c5a0-486f-8dbe-61a71963e47b tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Request body: {'floatingip': {'floating_network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb'}} {{(pid=99026) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:52:56.043286 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-ec66aca7-c5a0-486f-8dbe-61a71963e47b tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:52:56.046999 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-ec66aca7-c5a0-486f-8dbe-61a71963e47b tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Usage tracker for resource:floatingip and tenant:b4cdc54b260f4e79b87fdf4a43b12e16 is out of sync, need to count used quota {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:52:56.050651 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-ec66aca7-c5a0-486f-8dbe-61a71963e47b tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:52:56.056710 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-ec66aca7-c5a0-486f-8dbe-61a71963e47b tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:52:56.137724 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-ec66aca7-c5a0-486f-8dbe-61a71963e47b tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify callbacks [] for floatingip, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:52:56.285151 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-ec66aca7-c5a0-486f-8dbe-61a71963e47b tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:52:56.424949 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.db_base_plugin_common [None req-ec66aca7-c5a0-486f-8dbe-61a71963e47b tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Allocated IP 172.27.3.37 (eb7ec72b-a691-481b-8d7e-42c05e13a8cb/d6898f5f-da0b-4428-97b4-4cbe3e83caaa/471500a8-ede1-465b-89b9-3afa55aa0e36) {{(pid=99026) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 17:52:56.587050 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-ec66aca7-c5a0-486f-8dbe-61a71963e47b tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify callbacks [] for port, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:52:56.743898 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-ec66aca7-c5a0-486f-8dbe-61a71963e47b tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781840788179', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15476536'] for port, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:52:56.748028 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-e74312b5-520e-41a6-a834-099c9fe636b6 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:52:56.816974 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ec66aca7-c5a0-486f-8dbe-61a71963e47b tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Network eb7ec72b-a691-481b-8d7e-42c05e13a8cb is already hosted by enough agents. {{(pid=99026) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 17:52:56.819728 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.scheduler.base_scheduler [None req-ec66aca7-c5a0-486f-8dbe-61a71963e47b tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Resources bound (agent type, host, resource id):  {{(pid=99026) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 17:52:56.823466 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ec66aca7-c5a0-486f-8dbe-61a71963e47b tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Received port after_create {{(pid=99026) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 17:52:56.858315 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec66aca7-c5a0-486f-8dbe-61a71963e47b tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Pushing event updated for resources: {'Port': ['ID=471500a8-ede1-465b-89b9-3afa55aa0e36,revision_number=1']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:52:56.863472 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-ec66aca7-c5a0-486f-8dbe-61a71963e47b tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.115s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:52:56.914883 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-ec66aca7-c5a0-486f-8dbe-61a71963e47b tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify callbacks [] for floatingip, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:52:57.155766 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-ec66aca7-c5a0-486f-8dbe-61a71963e47b tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:52:57.429547 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-549ba8a5-d1c3-46c8-86d3-5a3a8173591a req-9287f9e9-c89b-4ba9-b103-d35c68ef16ae tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:52:57.430152 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [req-549ba8a5-d1c3-46c8-86d3-5a3a8173591a req-9287f9e9-c89b-4ba9-b103-d35c68ef16ae tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Synchronizing usage tracker for tenant:79ce7e80f85a4c57896263e5974c8df8 on resource:port {{(pid=99026) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 17:52:57.454044 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-ec66aca7-c5a0-486f-8dbe-61a71963e47b tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify callbacks [] for port, precommit_update {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:52:57.520505 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-ec66aca7-c5a0-486f-8dbe-61a71963e47b tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15476529'] for port, after_update {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:52:57.524388 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-ad7a4723-3d71-40f4-95ec-459fe91b5478 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:52:57.558317 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [req-549ba8a5-d1c3-46c8-86d3-5a3a8173591a req-9287f9e9-c89b-4ba9-b103-d35c68ef16ae tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Unset dirty status for tenant:79ce7e80f85a4c57896263e5974c8df8 on resource:port {{(pid=99026) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 17:52:57.559479 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-549ba8a5-d1c3-46c8-86d3-5a3a8173591a req-9287f9e9-c89b-4ba9-b103-d35c68ef16ae tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] 10.222.0.122 "GET /v2.0/ports?device_id=0065a651-57d4-42bb-a61b-5b33682e5abb HTTP/1.1" status: 200  len: 945 time: 0.2723091
May 25 17:52:57.669731 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec66aca7-c5a0-486f-8dbe-61a71963e47b tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Pushing event updated for resources: {'Port': ['ID=471500a8-ede1-465b-89b9-3afa55aa0e36,revision_number=2']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:52:57.676739 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-ec66aca7-c5a0-486f-8dbe-61a71963e47b tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.152s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:52:57.681888 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [req-549ba8a5-d1c3-46c8-86d3-5a3a8173591a req-a942e960-8a54-470c-aed0-c2bd6b19b8d7 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Synchronizing usage tracker for tenant:79ce7e80f85a4c57896263e5974c8df8 on resource:security_group {{(pid=99026) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 17:52:57.693799 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-ec66aca7-c5a0-486f-8dbe-61a71963e47b tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-419865'] for floatingip, after_update {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:52:57.809876 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [req-549ba8a5-d1c3-46c8-86d3-5a3a8173591a req-a942e960-8a54-470c-aed0-c2bd6b19b8d7 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Unset dirty status for tenant:79ce7e80f85a4c57896263e5974c8df8 on resource:security_group {{(pid=99026) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 17:52:57.811072 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-549ba8a5-d1c3-46c8-86d3-5a3a8173591a req-a942e960-8a54-470c-aed0-c2bd6b19b8d7 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] 10.222.0.122 "GET /v2.0/security-groups?id=f36e68fc-4038-4509-8aec-f49be290aa8b&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2351382
May 25 17:52:57.833457 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-ec66aca7-c5a0-486f-8dbe-61a71963e47b tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-239387'] for floatingip, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:52:57.834636 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-ec66aca7-c5a0-486f-8dbe-61a71963e47b tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] 10.222.0.122 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 692 time: 1.8021100
May 25 17:52:58.019369 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-7350dfd3-f18d-47f2-9bbe-8f2098a7108d req-d9297e0a-93cc-4a03-996e-1cf2c09b7a1d tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Synchronizing usage tracker for tenant:b4cdc54b260f4e79b87fdf4a43b12e16 on resource:security_group {{(pid=99027) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 17:52:58.095977 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-7350dfd3-f18d-47f2-9bbe-8f2098a7108d req-d9297e0a-93cc-4a03-996e-1cf2c09b7a1d tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Unset dirty status for tenant:b4cdc54b260f4e79b87fdf4a43b12e16 on resource:security_group {{(pid=99027) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 17:52:58.097738 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-7350dfd3-f18d-47f2-9bbe-8f2098a7108d req-d9297e0a-93cc-4a03-996e-1cf2c09b7a1d tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] 10.222.0.122 "GET /v2.0/security-groups?name=tempest-securitygroup--410326810&fields=id&tenant_id=b4cdc54b260f4e79b87fdf4a43b12e16 HTTP/1.1" status: 200  len: 267 time: 0.1187804
May 25 17:52:58.251167 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7350dfd3-f18d-47f2-9bbe-8f2098a7108d req-17a015d8-e903-44c3-9ef4-cf873e8749a7 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:52:58.253255 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-7350dfd3-f18d-47f2-9bbe-8f2098a7108d req-17a015d8-e903-44c3-9ef4-cf873e8749a7 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] 10.222.0.122 "GET /v2.0/networks?id=defaef08-c0f9-4608-b66d-b97e06e185bf HTTP/1.1" status: 200  len: 811 time: 0.1483109
May 25 17:52:58.269221 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-7350dfd3-f18d-47f2-9bbe-8f2098a7108d req-9db6df5d-d692-47b3-a130-da8f56b7c73c tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] 10.222.0.122 "GET /v2.0/quotas/b4cdc54b260f4e79b87fdf4a43b12e16 HTTP/1.1" status: 200  len: 375 time: 0.0097723
May 25 17:52:58.353696 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-7350dfd3-f18d-47f2-9bbe-8f2098a7108d req-19374c2a-7834-4180-98de-46ad73623cec tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Synchronizing usage tracker for tenant:b4cdc54b260f4e79b87fdf4a43b12e16 on resource:port {{(pid=99027) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 17:52:58.451761 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-7350dfd3-f18d-47f2-9bbe-8f2098a7108d req-19374c2a-7834-4180-98de-46ad73623cec tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Unset dirty status for tenant:b4cdc54b260f4e79b87fdf4a43b12e16 on resource:port {{(pid=99027) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 17:52:58.453110 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-7350dfd3-f18d-47f2-9bbe-8f2098a7108d req-19374c2a-7834-4180-98de-46ad73623cec tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] 10.222.0.122 "GET /v2.0/ports?tenant_id=b4cdc54b260f4e79b87fdf4a43b12e16&fields=id HTTP/1.1" status: 200  len: 348 time: 0.1784420
May 25 17:52:58.513109 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [req-7350dfd3-f18d-47f2-9bbe-8f2098a7108d req-e606adc1-7c02-4889-8297-f5baad3141b9 service neutron] http://10.222.0.122:9696/v2.0/extensions returned with HTTP 200 {{(pid=99027) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 25 17:52:58.514033 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-7350dfd3-f18d-47f2-9bbe-8f2098a7108d req-e606adc1-7c02-4889-8297-f5baad3141b9 service neutron] 10.222.0.122 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.0489678
May 25 17:52:58.635571 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c0fd750-8d4b-4450-96e4-867d0e941410 req-ea79c259-517b-4ccb-87ae-3c25e9ae0767 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:52:58.637068 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-0c0fd750-8d4b-4450-96e4-867d0e941410 req-ea79c259-517b-4ccb-87ae-3c25e9ae0767 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] 10.222.0.125 "GET /v2.0/ports?device_id=0065a651-57d4-42bb-a61b-5b33682e5abb HTTP/1.1" status: 200  len: 945 time: 0.0829701
May 25 17:52:58.651712 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-7350dfd3-f18d-47f2-9bbe-8f2098a7108d req-df8c4887-7ec8-4a2d-b14a-ffd1e66b185e service neutron] 10.222.0.122 "GET /v2.0/networks/defaef08-c0f9-4608-b66d-b97e06e185bf?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1309679
May 25 17:52:58.778894 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.plugin [req-0c0fd750-8d4b-4450-96e4-867d0e941410 req-42b60104-981a-415c-a8cb-60572dc4e0cc tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Deleting port 2f574cd3-1bb5-44f2-895b-c48b9d8c6c8f {{(pid=99026) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 17:52:58.779121 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [req-0c0fd750-8d4b-4450-96e4-867d0e941410 req-42b60104-981a-415c-a8cb-60572dc4e0cc tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781841220419'] for port, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:52:58.787797 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-7350dfd3-f18d-47f2-9bbe-8f2098a7108d req-1d2edd23-1483-4583-8c0f-6fa4162d5c03 service neutron] 10.222.0.122 "GET /v2.0/networks/defaef08-c0f9-4608-b66d-b97e06e185bf?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1300361
May 25 17:52:58.916536 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.db [req-0c0fd750-8d4b-4450-96e4-867d0e941410 req-42b60104-981a-415c-a8cb-60572dc4e0cc tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] For port 2f574cd3-1bb5-44f2-895b-c48b9d8c6c8f, host hv-cinder-78956, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=2f574cd3-1bb5-44f2-895b-c48b9d8c6c8f,segment=NetworkSegment(343b7bea-3acc-4c9d-939f-d8bc9eea2e5e),segment_id=343b7bea-3acc-4c9d-939f-d8bc9eea2e5e)] {{(pid=99026) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:52:58.916883 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [req-0c0fd750-8d4b-4450-96e4-867d0e941410 req-42b60104-981a-415c-a8cb-60572dc4e0cc tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-418810'] for port, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:52:59.084124 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.plugin [req-0c0fd750-8d4b-4450-96e4-867d0e941410 req-42b60104-981a-415c-a8cb-60572dc4e0cc tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Calling delete_port for 2f574cd3-1bb5-44f2-895b-c48b9d8c6c8f owned by compute:nova {{(pid=99026) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 17:52:59.086381 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-66141c5d-4e22-437d-b156-bdc0d862b7d3 req-43767219-456c-4371-99aa-02e66d6a8957 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] 10.222.0.122 "GET /v2.0/ports?device_id=13642fad-7755-444a-9c6e-d179ce91d0f4 HTTP/1.1" status: 200  len: 210 time: 0.0520704
May 25 17:52:59.145800 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e45fca3d-4122-4f4e-95ec-8257b300f02f req-f7883020-51da-4470-947b-1d15ee9f5747 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:52:59.147298 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-e45fca3d-4122-4f4e-95ec-8257b300f02f req-f7883020-51da-4470-947b-1d15ee9f5747 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] 10.222.0.122 "GET /v2.0/ports?device_id=0065a651-57d4-42bb-a61b-5b33682e5abb HTTP/1.1" status: 200  len: 945 time: 0.2177863
May 25 17:52:59.235274 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-e45fca3d-4122-4f4e-95ec-8257b300f02f req-1f78f0d6-3b25-4e67-a4a4-20337dc621d7 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] 10.222.0.122 "GET /v2.0/security-groups?id=f36e68fc-4038-4509-8aec-f49be290aa8b&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0772083
May 25 17:52:59.353196 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [req-0c0fd750-8d4b-4450-96e4-867d0e941410 req-42b60104-981a-415c-a8cb-60572dc4e0cc tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781841222566', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781840788188', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15476536'] for port, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:52:59.359661 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:52:59.367938 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] get_ports_and_sgs() called for port_ids ['2f574cd3-1bb5-44f2-895b-c48b9d8c6c8f'] {{(pid=99028) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 25 17:52:59.408023 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42b60104-981a-415c-a8cb-60572dc4e0cc tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Pushing event deleted for resources: {'Port': ['ID=2f574cd3-1bb5-44f2-895b-c48b9d8c6c8f,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:52:59.413835 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-42b60104-981a-415c-a8cb-60572dc4e0cc tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:52:59.488354 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.l3_dvrscheduler_db [req-0c0fd750-8d4b-4450-96e4-867d0e941410 req-42b60104-981a-415c-a8cb-60572dc4e0cc tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] No DVR routers for this DVR port 2f574cd3-1bb5-44f2-895b-c48b9d8c6c8f on host hv-cinder-78956 {{(pid=99026) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 25 17:52:59.490926 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [req-0c0fd750-8d4b-4450-96e4-867d0e941410 req-42b60104-981a-415c-a8cb-60572dc4e0cc tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-239387'] for port, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:52:59.493658 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0065a651-57d4-42bb-a61b-5b33682e5abb', 'name': 'network-vif-deleted', 'tag': '2f574cd3-1bb5-44f2-895b-c48b9d8c6c8f'}] {{(pid=99026) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 17:52:59.543683 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0065a651-57d4-42bb-a61b-5b33682e5abb', 'name': 'network-vif-deleted', 'tag': '2f574cd3-1bb5-44f2-895b-c48b9d8c6c8f', 'status': 'completed', 'code': 200}
May 25 17:52:59.616509 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-0c0fd750-8d4b-4450-96e4-867d0e941410 req-42b60104-981a-415c-a8cb-60572dc4e0cc tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] 10.222.0.125 "DELETE /v2.0/ports/2f574cd3-1bb5-44f2-895b-c48b9d8c6c8f HTTP/1.1" status: 204  len: 173 time: 0.9718649
May 25 17:53:00.237027 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [req-913bea9c-87f0-4710-a262-f92da800eead req-20ff866a-148d-4bba-85fb-15e031d91ace tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Synchronizing usage tracker for tenant:b4cdc54b260f4e79b87fdf4a43b12e16 on resource:port {{(pid=99026) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 17:53:00.249165 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [req-913bea9c-87f0-4710-a262-f92da800eead req-20ff866a-148d-4bba-85fb-15e031d91ace tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Unset dirty status for tenant:b4cdc54b260f4e79b87fdf4a43b12e16 on resource:port {{(pid=99026) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 17:53:00.250832 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-913bea9c-87f0-4710-a262-f92da800eead req-20ff866a-148d-4bba-85fb-15e031d91ace tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] 10.222.0.122 "GET /v2.0/ports?device_id=13642fad-7755-444a-9c6e-d179ce91d0f4 HTTP/1.1" status: 200  len: 210 time: 0.0566263
May 25 17:53:00.403447 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-8eedbd1c-6eec-4d39-9218-b82d27ce4f7f req-b9a7f8d8-a2f8-4e12-b1f3-df9d600cbeb7 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] 10.222.0.122 "GET /v2.0/ports?device_id=0065a651-57d4-42bb-a61b-5b33682e5abb HTTP/1.1" status: 200  len: 210 time: 0.0441978
May 25 17:53:01.405937 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-50ed4cae-2d55-4e30-84aa-552e1952dc51 req-d3f7fff2-f0c8-459c-b1b9-a0e2354ca920 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] 10.222.0.122 "GET /v2.0/ports?device_id=13642fad-7755-444a-9c6e-d179ce91d0f4 HTTP/1.1" status: 200  len: 210 time: 0.0461698
May 25 17:53:01.699892 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7350dfd3-f18d-47f2-9bbe-8f2098a7108d req-109d5e67-0a8b-4c0a-b9c6-bd1afdd146c3 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:53:01.699892 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-7350dfd3-f18d-47f2-9bbe-8f2098a7108d req-109d5e67-0a8b-4c0a-b9c6-bd1afdd146c3 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] 10.222.0.125 "GET /v2.0/networks?id=defaef08-c0f9-4608-b66d-b97e06e185bf HTTP/1.1" status: 200  len: 811 time: 0.1512678
May 25 17:53:01.753160 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [req-7350dfd3-f18d-47f2-9bbe-8f2098a7108d req-3bdd13db-8139-44fa-b77f-8cf3a327c096 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Synchronizing usage tracker for tenant:b4cdc54b260f4e79b87fdf4a43b12e16 on resource:security_group {{(pid=99026) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 17:53:01.765139 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [req-7350dfd3-f18d-47f2-9bbe-8f2098a7108d req-3bdd13db-8139-44fa-b77f-8cf3a327c096 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Unset dirty status for tenant:b4cdc54b260f4e79b87fdf4a43b12e16 on resource:security_group {{(pid=99026) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 17:53:01.766400 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-7350dfd3-f18d-47f2-9bbe-8f2098a7108d req-3bdd13db-8139-44fa-b77f-8cf3a327c096 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] 10.222.0.125 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=b4cdc54b260f4e79b87fdf4a43b12e16 HTTP/1.1" status: 200  len: 379 time: 0.0552132
May 25 17:53:01.777171 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.v2.base [req-7350dfd3-f18d-47f2-9bbe-8f2098a7108d req-0c6a402d-29c0-4b71-840d-cd5d229884ab tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Request body: {'port': {'device_id': '13642fad-7755-444a-9c6e-d179ce91d0f4', 'network_id': 'defaef08-c0f9-4608-b66d-b97e06e185bf', 'admin_state_up': True, 'tenant_id': 'b4cdc54b260f4e79b87fdf4a43b12e16', 'security_groups': ['beb878a4-0349-4b8d-8e49-88c1a35c8216']}} {{(pid=99026) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:53:02.021843 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [req-7350dfd3-f18d-47f2-9bbe-8f2098a7108d req-0c6a402d-29c0-4b71-840d-cd5d229884ab tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:53:02.031338 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [req-7350dfd3-f18d-47f2-9bbe-8f2098a7108d req-0c6a402d-29c0-4b71-840d-cd5d229884ab tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:53:02.148730 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-7350dfd3-f18d-47f2-9bbe-8f2098a7108d req-0c6a402d-29c0-4b71-840d-cd5d229884ab tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Made reservation on behalf of b4cdc54b260f4e79b87fdf4a43b12e16 for: {'port': 1} {{(pid=99026) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 17:53:02.152300 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [req-7350dfd3-f18d-47f2-9bbe-8f2098a7108d req-0c6a402d-29c0-4b71-840d-cd5d229884ab tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:02.319791 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.db_base_plugin_common [req-7350dfd3-f18d-47f2-9bbe-8f2098a7108d req-0c6a402d-29c0-4b71-840d-cd5d229884ab tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Allocated IP 172.20.0.6 (defaef08-c0f9-4608-b66d-b97e06e185bf/5be08358-9d04-4ee9-91ac-104e66e66e20/0d0462ae-dc68-4a19-b6a6-bfdd10328c4c) {{(pid=99026) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 17:53:02.521429 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [req-7350dfd3-f18d-47f2-9bbe-8f2098a7108d req-0c6a402d-29c0-4b71-840d-cd5d229884ab tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify callbacks [] for port, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:02.538007 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.provisioning_blocks [req-7350dfd3-f18d-47f2-9bbe-8f2098a7108d req-0c6a402d-29c0-4b71-840d-cd5d229884ab tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Transition to ACTIVE for port object 0d0462ae-dc68-4a19-b6a6-bfdd10328c4c will not be triggered until provisioned by entity DHCP. {{(pid=99026) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 17:53:02.560297 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-0e88a3d1-14c2-46c9-8333-7c27c999d955 req-162a4742-73ed-4385-a54a-94d268a19de4 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] 10.222.0.122 "GET /v2.0/ports?device_id=13642fad-7755-444a-9c6e-d179ce91d0f4 HTTP/1.1" status: 200  len: 210 time: 0.0445268
May 25 17:53:02.638976 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [req-7350dfd3-f18d-47f2-9bbe-8f2098a7108d req-0c6a402d-29c0-4b71-840d-cd5d229884ab tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781840788179', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15476536'] for port, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:02.646436 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:53:02.711281 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-7350dfd3-f18d-47f2-9bbe-8f2098a7108d req-0c6a402d-29c0-4b71-840d-cd5d229884ab tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Network defaef08-c0f9-4608-b66d-b97e06e185bf is already hosted by enough agents. {{(pid=99026) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 17:53:02.714567 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.scheduler.base_scheduler [req-7350dfd3-f18d-47f2-9bbe-8f2098a7108d req-0c6a402d-29c0-4b71-840d-cd5d229884ab tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Resources bound (agent type, host, resource id):  {{(pid=99026) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 17:53:02.717304 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.l3_dvrscheduler_db [req-7350dfd3-f18d-47f2-9bbe-8f2098a7108d req-0c6a402d-29c0-4b71-840d-cd5d229884ab tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Received port after_create {{(pid=99026) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 17:53:02.773126 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c6a402d-29c0-4b71-840d-cd5d229884ab tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Pushing event updated for resources: {'Port': ['ID=0d0462ae-dc68-4a19-b6a6-bfdd10328c4c,revision_number=1']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:53:02.778525 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-0c6a402d-29c0-4b71-840d-cd5d229884ab tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.132s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:53:02.798378 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7350dfd3-f18d-47f2-9bbe-8f2098a7108d req-0c6a402d-29c0-4b71-840d-cd5d229884ab tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:53:02.805987 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [req-7350dfd3-f18d-47f2-9bbe-8f2098a7108d req-0c6a402d-29c0-4b71-840d-cd5d229884ab tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-239387'] for port, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:02.888683 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 49002) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:53:02.946040 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-7350dfd3-f18d-47f2-9bbe-8f2098a7108d req-0c6a402d-29c0-4b71-840d-cd5d229884ab tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] 10.222.0.125 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.1727021
May 25 17:53:02.965900 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.v2.base [req-7350dfd3-f18d-47f2-9bbe-8f2098a7108d req-25cb6cf7-9991-4e18-94bc-e4a706422f6b service neutron] Request body: {'port': {'device_id': '13642fad-7755-444a-9c6e-d179ce91d0f4', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78956'}} {{(pid=99026) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:53:03.017355 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-6cab4ae8-e507-40a7-bbe2-9c69adb611b4 None None] Provisioning for port 0d0462ae-dc68-4a19-b6a6-bfdd10328c4c completed by entity DHCP. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 17:53:03.022433 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-6cab4ae8-e507-40a7-bbe2-9c69adb611b4 None None] Provisioning complete for port 0d0462ae-dc68-4a19-b6a6-bfdd10328c4c triggered by entity DHCP. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 17:53:03.022822 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-6cab4ae8-e507-40a7-bbe2-9c69adb611b4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:03.110999 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.plugin [None req-6cab4ae8-e507-40a7-bbe2-9c69adb611b4 None None] Port 0d0462ae-dc68-4a19-b6a6-bfdd10328c4c cannot update to ACTIVE because it is not bound. {{(pid=99028) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 25 17:53:03.221908 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [req-7350dfd3-f18d-47f2-9bbe-8f2098a7108d req-25cb6cf7-9991-4e18-94bc-e4a706422f6b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:03.242549 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Device 2f574cd3-1bb5-44f2-895b-c48b9d8c6c8f no longer exists at agent hyperv_hv-cinder-78956 {{(pid=99028) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 17:53:03.277267 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.plugin [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] No Port match for: 2f574cd3-1bb5-44f2-895b-c48b9d8c6c8f {{(pid=99028) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 25 17:53:03.277667 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Device 2f574cd3-1bb5-44f2-895b-c48b9d8c6c8f not bound to the agent host hv-cinder-78956 {{(pid=99028) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 25 17:53:03.936905 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.notifiers.nova [req-7350dfd3-f18d-47f2-9bbe-8f2098a7108d req-25cb6cf7-9991-4e18-94bc-e4a706422f6b service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 0d0462ae-dc68-4a19-b6a6-bfdd10328c4c {{(pid=99026) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 25 17:53:03.970197 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [req-7350dfd3-f18d-47f2-9bbe-8f2098a7108d req-25cb6cf7-9991-4e18-94bc-e4a706422f6b service neutron] Notify callbacks [] for port, precommit_update {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:03.997764 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c53a3c88-3504-406f-8c41-68552acda290 req-05311a6c-9e80-4d21-b0dc-3256040cd9c8 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:53:03.998930 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [req-c53a3c88-3504-406f-8c41-68552acda290 req-05311a6c-9e80-4d21-b0dc-3256040cd9c8 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Synchronizing usage tracker for tenant:b4cdc54b260f4e79b87fdf4a43b12e16 on resource:port {{(pid=99026) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 17:53:04.019678 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.provisioning_blocks [req-7350dfd3-f18d-47f2-9bbe-8f2098a7108d req-25cb6cf7-9991-4e18-94bc-e4a706422f6b service neutron] Transition to ACTIVE for port object 0d0462ae-dc68-4a19-b6a6-bfdd10328c4c will not be triggered until provisioned by entity L2. {{(pid=99026) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 17:53:04.050149 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-c2d17867-e845-4ac4-9244-2160970f1a18 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-420907'] for router_interface, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:04.124358 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [req-7350dfd3-f18d-47f2-9bbe-8f2098a7108d req-25cb6cf7-9991-4e18-94bc-e4a706422f6b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15476529'] for port, after_update {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:04.131573 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-ec66aca7-c5a0-486f-8dbe-61a71963e47b tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:53:04.159565 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [req-c53a3c88-3504-406f-8c41-68552acda290 req-05311a6c-9e80-4d21-b0dc-3256040cd9c8 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Unset dirty status for tenant:b4cdc54b260f4e79b87fdf4a43b12e16 on resource:port {{(pid=99026) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 17:53:04.160713 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-c53a3c88-3504-406f-8c41-68552acda290 req-05311a6c-9e80-4d21-b0dc-3256040cd9c8 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] 10.222.0.122 "GET /v2.0/ports?device_id=13642fad-7755-444a-9c6e-d179ce91d0f4 HTTP/1.1" status: 200  len: 931 time: 0.4848161
May 25 17:53:04.371694 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25cb6cf7-9991-4e18-94bc-e4a706422f6b service neutron] Pushing event updated for resources: {'Port': ['ID=0d0462ae-dc68-4a19-b6a6-bfdd10328c4c,revision_number=2']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:53:04.381286 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-25cb6cf7-9991-4e18-94bc-e4a706422f6b service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.250s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:53:04.421846 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-c53a3c88-3504-406f-8c41-68552acda290 req-41543ae8-de1f-4f60-bf1a-6d3a8ad02fb3 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] 10.222.0.122 "GET /v2.0/security-groups?id=beb878a4-0349-4b8d-8e49-88c1a35c8216&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.2527804
May 25 17:53:04.606740 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.managers [req-7350dfd3-f18d-47f2-9bbe-8f2098a7108d req-25cb6cf7-9991-4e18-94bc-e4a706422f6b service neutron] Attempting to bind port 0d0462ae-dc68-4a19-b6a6-bfdd10328c4c on host hv-cinder-78956 for vnic_type normal with profile  {{(pid=99026) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 17:53:04.606949 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.managers [req-7350dfd3-f18d-47f2-9bbe-8f2098a7108d req-25cb6cf7-9991-4e18-94bc-e4a706422f6b service neutron] Attempting to bind port 0d0462ae-dc68-4a19-b6a6-bfdd10328c4c by drivers openvswitch,hyperv on host hv-cinder-78956 at level 0 using segments [{'id': '9ffd894c-b357-4c03-93af-a222f8984466', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1316, 'network_id': 'defaef08-c0f9-4608-b66d-b97e06e185bf'}] {{(pid=99026) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 17:53:04.607281 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7350dfd3-f18d-47f2-9bbe-8f2098a7108d req-25cb6cf7-9991-4e18-94bc-e4a706422f6b service neutron] Attempting to bind port 0d0462ae-dc68-4a19-b6a6-bfdd10328c4c on network defaef08-c0f9-4608-b66d-b97e06e185bf {{(pid=99026) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 17:53:04.615667 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7350dfd3-f18d-47f2-9bbe-8f2098a7108d req-25cb6cf7-9991-4e18-94bc-e4a706422f6b service neutron] Port 0d0462ae-dc68-4a19-b6a6-bfdd10328c4c on network defaef08-c0f9-4608-b66d-b97e06e185bf not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78956 {{(pid=99026) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 25 17:53:04.618406 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7350dfd3-f18d-47f2-9bbe-8f2098a7108d req-25cb6cf7-9991-4e18-94bc-e4a706422f6b service neutron] Attempting to bind port 0d0462ae-dc68-4a19-b6a6-bfdd10328c4c on network defaef08-c0f9-4608-b66d-b97e06e185bf {{(pid=99026) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 17:53:04.623385 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7350dfd3-f18d-47f2-9bbe-8f2098a7108d req-25cb6cf7-9991-4e18-94bc-e4a706422f6b service neutron] Checking agent: {'id': '4d02a528-6a0e-4977-985f-4bcff1ca6cb7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78956', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 17, 40, 41), 'started_at': datetime.datetime(2021, 5, 25, 17, 40, 41), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 17, 52, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=99026) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 17:53:04.623714 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7350dfd3-f18d-47f2-9bbe-8f2098a7108d req-25cb6cf7-9991-4e18-94bc-e4a706422f6b service neutron] Checking segment: {'id': '9ffd894c-b357-4c03-93af-a222f8984466', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1316, 'network_id': 'defaef08-c0f9-4608-b66d-b97e06e185bf'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=99026) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 17:53:04.624091 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7350dfd3-f18d-47f2-9bbe-8f2098a7108d req-25cb6cf7-9991-4e18-94bc-e4a706422f6b service neutron] Bound using segment: {'id': '9ffd894c-b357-4c03-93af-a222f8984466', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1316, 'network_id': 'defaef08-c0f9-4608-b66d-b97e06e185bf'} {{(pid=99026) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 17:53:04.624512 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.managers [req-7350dfd3-f18d-47f2-9bbe-8f2098a7108d req-25cb6cf7-9991-4e18-94bc-e4a706422f6b service neutron] Bound port: 0d0462ae-dc68-4a19-b6a6-bfdd10328c4c, host: hv-cinder-78956, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '9ffd894c-b357-4c03-93af-a222f8984466', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1316, 'network_id': 'defaef08-c0f9-4608-b66d-b97e06e185bf'}}] {{(pid=99026) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 17:53:04.624852 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [req-7350dfd3-f18d-47f2-9bbe-8f2098a7108d req-25cb6cf7-9991-4e18-94bc-e4a706422f6b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:04.810317 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.db [req-7350dfd3-f18d-47f2-9bbe-8f2098a7108d req-25cb6cf7-9991-4e18-94bc-e4a706422f6b service neutron] For port 0d0462ae-dc68-4a19-b6a6-bfdd10328c4c, host hv-cinder-78956, cleared binding levels {{(pid=99026) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 17:53:04.813804 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.db [req-7350dfd3-f18d-47f2-9bbe-8f2098a7108d req-25cb6cf7-9991-4e18-94bc-e4a706422f6b service neutron] For port 0d0462ae-dc68-4a19-b6a6-bfdd10328c4c, host hv-cinder-78956, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=0d0462ae-dc68-4a19-b6a6-bfdd10328c4c,segment=NetworkSegment(9ffd894c-b357-4c03-93af-a222f8984466),segment_id=9ffd894c-b357-4c03-93af-a222f8984466)] {{(pid=99026) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 17:53:04.832775 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.plugin [None req-c2d17867-e845-4ac4-9244-2160970f1a18 admin admin] Deleting port 1d7a4034-86b0-49fb-bf45-68dda95544c2 {{(pid=99026) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 17:53:04.833234 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-c2d17867-e845-4ac4-9244-2160970f1a18 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781841220419'] for port, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:04.910043 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [req-7350dfd3-f18d-47f2-9bbe-8f2098a7108d req-25cb6cf7-9991-4e18-94bc-e4a706422f6b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15476529'] for port, after_update {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:04.915735 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-0c6a402d-29c0-4b71-840d-cd5d229884ab tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:53:04.994761 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7350dfd3-f18d-47f2-9bbe-8f2098a7108d req-25cb6cf7-9991-4e18-94bc-e4a706422f6b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:53:04.995376 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [req-7350dfd3-f18d-47f2-9bbe-8f2098a7108d req-25cb6cf7-9991-4e18-94bc-e4a706422f6b service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-239387'] for port, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:04.996738 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-7350dfd3-f18d-47f2-9bbe-8f2098a7108d req-25cb6cf7-9991-4e18-94bc-e4a706422f6b service neutron] 10.222.0.125 "PUT /v2.0/ports/0d0462ae-dc68-4a19-b6a6-bfdd10328c4c HTTP/1.1" status: 200  len: 1093 time: 2.0352514
May 25 17:53:04.997271 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '13642fad-7755-444a-9c6e-d179ce91d0f4', 'tag': '0d0462ae-dc68-4a19-b6a6-bfdd10328c4c'}] {{(pid=99026) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 17:53:05.040299 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.db [None req-c2d17867-e845-4ac4-9244-2160970f1a18 admin admin] For port 1d7a4034-86b0-49fb-bf45-68dda95544c2, host dv-cinder-789564-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=1d7a4034-86b0-49fb-bf45-68dda95544c2,segment=NetworkSegment(343b7bea-3acc-4c9d-939f-d8bc9eea2e5e),segment_id=343b7bea-3acc-4c9d-939f-d8bc9eea2e5e)] {{(pid=99026) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:53:05.040663 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-c2d17867-e845-4ac4-9244-2160970f1a18 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-418810'] for port, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:05.048555 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25cb6cf7-9991-4e18-94bc-e4a706422f6b service neutron] Pushing event updated for resources: {'Port': ['ID=0d0462ae-dc68-4a19-b6a6-bfdd10328c4c,revision_number=3']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:53:05.062117 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '13642fad-7755-444a-9c6e-d179ce91d0f4', 'tag': '0d0462ae-dc68-4a19-b6a6-bfdd10328c4c', 'status': 'completed', 'code': 200}
May 25 17:53:05.063791 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-25cb6cf7-9991-4e18-94bc-e4a706422f6b service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.148s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:53:05.215314 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.plugin [None req-c2d17867-e845-4ac4-9244-2160970f1a18 admin admin] Calling delete_port for 1d7a4034-86b0-49fb-bf45-68dda95544c2 owned by network:router_interface {{(pid=99026) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 17:53:05.267945 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4216e3c6-44f1-42b9-bb70-a42251960376 req-6fea8c75-518e-4c2e-b905-96c040ba761c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:53:05.270022 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-4216e3c6-44f1-42b9-bb70-a42251960376 req-6fea8c75-518e-4c2e-b905-96c040ba761c service neutron] 10.222.0.125 "GET /v2.0/ports?tenant_id=b4cdc54b260f4e79b87fdf4a43b12e16&device_id=13642fad-7755-444a-9c6e-d179ce91d0f4 HTTP/1.1" status: 200  len: 1096 time: 0.1562619
May 25 17:53:05.579323 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4216e3c6-44f1-42b9-bb70-a42251960376 req-e80f920e-e7ef-4d65-9472-a8c2135bf73d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:53:05.581450 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-4216e3c6-44f1-42b9-bb70-a42251960376 req-e80f920e-e7ef-4d65-9472-a8c2135bf73d service neutron] 10.222.0.125 "GET /v2.0/networks?tenant_id=b4cdc54b260f4e79b87fdf4a43b12e16&shared=False HTTP/1.1" status: 200  len: 913 time: 0.2957304
May 25 17:53:05.808348 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6691fc5d-6245-450c-bcbe-42332a493908 req-db395f1f-8014-4a1d-9d5d-c1d4d44e7875 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:53:05.809803 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-6691fc5d-6245-450c-bcbe-42332a493908 req-db395f1f-8014-4a1d-9d5d-c1d4d44e7875 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] 10.222.0.122 "GET /v2.0/ports?device_id=13642fad-7755-444a-9c6e-d179ce91d0f4 HTTP/1.1" status: 200  len: 943 time: 0.2654521
May 25 17:53:05.810960 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4216e3c6-44f1-42b9-bb70-a42251960376 req-a23622c3-7747-4aa1-8980-49e7ac1a7ec6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:53:05.812263 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-4216e3c6-44f1-42b9-bb70-a42251960376 req-a23622c3-7747-4aa1-8980-49e7ac1a7ec6 service neutron] 10.222.0.125 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 871 time: 0.2250962
May 25 17:53:05.836268 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-c2d17867-e845-4ac4-9244-2160970f1a18 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781841222566', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781840788188', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15476536'] for port, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:05.842545 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-1698d07d-e63b-4b1b-90f3-e9630bbfdbe3 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:53:05.936555 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2d17867-e845-4ac4-9244-2160970f1a18 admin admin] Pushing event deleted for resources: {'Port': ['ID=1d7a4034-86b0-49fb-bf45-68dda95544c2,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:53:05.950053 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-c2d17867-e845-4ac4-9244-2160970f1a18 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.107s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:53:05.994855 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-6691fc5d-6245-450c-bcbe-42332a493908 req-c809a14c-1318-4041-bfb9-d48d52ab74ba tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] 10.222.0.122 "GET /v2.0/security-groups?id=beb878a4-0349-4b8d-8e49-88c1a35c8216&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1770961
May 25 17:53:06.135509 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7350dfd3-f18d-47f2-9bbe-8f2098a7108d req-de9e6dcc-bb96-4875-9a8f-523ed505b924 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:53:06.136997 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-7350dfd3-f18d-47f2-9bbe-8f2098a7108d req-de9e6dcc-bb96-4875-9a8f-523ed505b924 service neutron] 10.222.0.125 "GET /v2.0/ports?tenant_id=b4cdc54b260f4e79b87fdf4a43b12e16&device_id=13642fad-7755-444a-9c6e-d179ce91d0f4 HTTP/1.1" status: 200  len: 1096 time: 0.2651215
May 25 17:53:06.218963 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-7350dfd3-f18d-47f2-9bbe-8f2098a7108d req-396e2726-e1e2-4789-9153-8a1e8cce33e6 service neutron] 10.222.0.125 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=0d0462ae-dc68-4a19-b6a6-bfdd10328c4c HTTP/1.1" status: 200  len: 217 time: 0.0699544
May 25 17:53:06.355481 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7350dfd3-f18d-47f2-9bbe-8f2098a7108d req-1aec18c0-147d-47e9-a4ec-d273edb2f45c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:53:06.356841 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-7350dfd3-f18d-47f2-9bbe-8f2098a7108d req-1aec18c0-147d-47e9-a4ec-d273edb2f45c service neutron] 10.222.0.125 "GET /v2.0/subnets?id=5be08358-9d04-4ee9-91ac-104e66e66e20 HTTP/1.1" status: 200  len: 850 time: 0.0855124
May 25 17:53:06.357568 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-c2d17867-e845-4ac4-9244-2160970f1a18 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-551393', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-420795'] for router_interface, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:06.593885 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7350dfd3-f18d-47f2-9bbe-8f2098a7108d req-3e40cf44-6149-4f39-afb3-07d2185fd171 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:53:06.595377 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-7350dfd3-f18d-47f2-9bbe-8f2098a7108d req-3e40cf44-6149-4f39-afb3-07d2185fd171 service neutron] 10.222.0.125 "GET /v2.0/ports?network_id=defaef08-c0f9-4608-b66d-b97e06e185bf&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.2292242
May 25 17:53:06.766089 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.agents_db [None req-14fae233-15dc-4576-836b-621c5f95b584 None None] Agent healthcheck: found 6 active agents {{(pid=99029) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 17:53:06.985088 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-7350dfd3-f18d-47f2-9bbe-8f2098a7108d req-3b9f9341-c926-4c57-9f03-5f4a2ffe85c7 service neutron] 10.222.0.125 "GET /v2.0/networks/defaef08-c0f9-4608-b66d-b97e06e185bf?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3360529
May 25 17:53:06.990536 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c2d17867-e845-4ac4-9244-2160970f1a18 admin admin] Router ed6451cf-7a08-48a6-b823-dd9d01bcee79 has already been hosted by L3 agent eaeb6875-c4ed-43b6-8658-aa4e52324fdf {{(pid=99026) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 25 17:53:07.188841 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-866782df-c050-4bd9-ae09-ece2a48fdbbc req-864cadd5-69fa-480c-b190-d15037803577 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:53:07.190871 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-866782df-c050-4bd9-ae09-ece2a48fdbbc req-864cadd5-69fa-480c-b190-d15037803577 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] 10.222.0.122 "GET /v2.0/ports?device_id=13642fad-7755-444a-9c6e-d179ce91d0f4 HTTP/1.1" status: 200  len: 943 time: 0.0867326
May 25 17:53:07.235754 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-866782df-c050-4bd9-ae09-ece2a48fdbbc req-bb773036-e1f6-40b2-9000-6af2ef72f26d tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] 10.222.0.122 "GET /v2.0/security-groups?id=beb878a4-0349-4b8d-8e49-88c1a35c8216&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0391607
May 25 17:53:07.272876 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-7350dfd3-f18d-47f2-9bbe-8f2098a7108d req-3867baa2-b8fc-4385-89e9-b814aca11546 service neutron] 10.222.0.125 "GET /v2.0/networks/defaef08-c0f9-4608-b66d-b97e06e185bf?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2812355
May 25 17:53:07.285660 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c2d17867-e845-4ac4-9244-2160970f1a18 admin admin] Notify agent at l3_agent.dv-cinder-789564-2-iscsi the message routers_updated {{(pid=99026) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 25 17:53:07.293904 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7cfd39e0-96ac-46c6-ae43-069e6b1aab6d None None] Sync routers for ids ['ed6451cf-7a08-48a6-b823-dd9d01bcee79'] in dv-cinder-789564-2-iscsi {{(pid=99028) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 25 17:53:07.297503 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-c2d17867-e845-4ac4-9244-2160970f1a18 admin admin] 10.222.0.122 "PUT /v2.0/routers/ed6451cf-7a08-48a6-b823-dd9d01bcee79/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 4.4128613
May 25 17:53:07.303897 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7cfd39e0-96ac-46c6-ae43-069e6b1aab6d None None] Routers {'ed6451cf-7a08-48a6-b823-dd9d01bcee79'} bound to L3 agent in host dv-cinder-789564-2-iscsi {{(pid=99028) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 17:53:07.304509 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-7cfd39e0-96ac-46c6-ae43-069e6b1aab6d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcae6f06580>, 'dv-cinder-789564-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T17:34:21Z,description=<?>,heartbeat_timestamp=2021-05-25T17:52:51Z,host='dv-cinder-789564-2-iscsi',id=eaeb6875-c4ed-43b6-8658-aa4e52324fdf,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T17:34:21Z,topic='l3_agent')) {'router_ids': ['ed6451cf-7a08-48a6-b823-dd9d01bcee79'], 'active': True} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:53:07.307747 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 49014) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:53:07.490437 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvr_db [None req-7cfd39e0-96ac-46c6-ae43-069e6b1aab6d None None] Set router ed6451cf-7a08-48a6-b823-dd9d01bcee79 gateway port host: dv-cinder-789564-2-iscsi {{(pid=99028) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 17:53:07.603267 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-fd2a33f7-32bb-47b3-afdf-dcb463f6abb9 admin admin] Notify callbacks [] for router, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:07.783061 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-7cfd39e0-96ac-46c6-ae43-069e6b1aab6d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcae6f06580>, [{'id': 'ed6451cf-7a08-48a6-b823-dd9d01bcee79', 'name': 'tempest-TestMinimumBasicScenario-1304633943-router', 'tenant_id': '79ce7e80f85a4c57896263e5974c8df8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.80'}], 'enable_snat': True}, 'gw_port_id': '6c066f26-0761-4bef-b612-661f04382074', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:48:09Z', 'updated_at': '2021-05-25T17:53:05Z', 'revision_number': 5, 'project_id': '79ce7e80f85a4c57896263e5974c8df8', 'gw_port': {'id': '6c066f26-0761-4bef-b612-661f04382074', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:0c:b5:ed', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ed6451cf-7a08-48a6-b823-dd9d01bcee79', 'device_owner': 'network:router_gateway', 'standard_attr_id': 478, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.80', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:48:10Z', 'updated_at': '2021-05-25T17:48:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi'}], 'dv-cinder-789564-2-iscsi', False) {} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:53:07.790378 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-fd2a33f7-32bb-47b3-afdf-dcb463f6abb9 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:07.794035 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7cfd39e0-96ac-46c6-ae43-069e6b1aab6d None None] Checking router: ed6451cf-7a08-48a6-b823-dd9d01bcee79 for host: dv-cinder-789564-2-iscsi {{(pid=99028) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 25 17:53:07.803916 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7cfd39e0-96ac-46c6-ae43-069e6b1aab6d None None] Routers {'ed6451cf-7a08-48a6-b823-dd9d01bcee79'} bound to L3 agent in host dv-cinder-789564-2-iscsi {{(pid=99028) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 17:53:07.809115 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-7cfd39e0-96ac-46c6-ae43-069e6b1aab6d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcae6f06580>, 'dv-cinder-789564-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T17:34:21Z,description=<?>,heartbeat_timestamp=2021-05-25T17:52:51Z,host='dv-cinder-789564-2-iscsi',id=eaeb6875-c4ed-43b6-8658-aa4e52324fdf,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T17:34:21Z,topic='l3_agent')) {'router_ids': ['ed6451cf-7a08-48a6-b823-dd9d01bcee79'], 'active': True} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:53:07.929489 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.plugin [None req-fd2a33f7-32bb-47b3-afdf-dcb463f6abb9 admin admin] Deleting port 6c066f26-0761-4bef-b612-661f04382074 {{(pid=99026) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 17:53:07.929834 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-fd2a33f7-32bb-47b3-afdf-dcb463f6abb9 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781841220419'] for port, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:07.991836 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvr_db [None req-7cfd39e0-96ac-46c6-ae43-069e6b1aab6d None None] Set router ed6451cf-7a08-48a6-b823-dd9d01bcee79 gateway port host: dv-cinder-789564-2-iscsi {{(pid=99028) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 17:53:08.057255 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.db [None req-fd2a33f7-32bb-47b3-afdf-dcb463f6abb9 admin admin] For port 6c066f26-0761-4bef-b612-661f04382074, host dv-cinder-789564-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=6c066f26-0761-4bef-b612-661f04382074,segment=NetworkSegment(471771f9-c462-4865-800d-0d5029e9eb3e),segment_id=471771f9-c462-4865-800d-0d5029e9eb3e)] {{(pid=99026) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:53:08.057483 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-fd2a33f7-32bb-47b3-afdf-dcb463f6abb9 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-418810'] for port, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:08.186616 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.plugin [None req-fd2a33f7-32bb-47b3-afdf-dcb463f6abb9 admin admin] Calling delete_port for 6c066f26-0761-4bef-b612-661f04382074 owned by network:router_gateway {{(pid=99026) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 17:53:08.294121 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-7cfd39e0-96ac-46c6-ae43-069e6b1aab6d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcae6f06580>, [{'id': 'ed6451cf-7a08-48a6-b823-dd9d01bcee79', 'name': 'tempest-TestMinimumBasicScenario-1304633943-router', 'tenant_id': '79ce7e80f85a4c57896263e5974c8df8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.80'}], 'enable_snat': True}, 'gw_port_id': '6c066f26-0761-4bef-b612-661f04382074', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:48:09Z', 'updated_at': '2021-05-25T17:53:05Z', 'revision_number': 5, 'project_id': '79ce7e80f85a4c57896263e5974c8df8', 'gw_port': {'id': '6c066f26-0761-4bef-b612-661f04382074', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:0c:b5:ed', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ed6451cf-7a08-48a6-b823-dd9d01bcee79', 'device_owner': 'network:router_gateway', 'standard_attr_id': 478, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.80', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:48:10Z', 'updated_at': '2021-05-25T17:48:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi'}], 'dv-cinder-789564-2-iscsi', False) {} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:53:08.298289 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7cfd39e0-96ac-46c6-ae43-069e6b1aab6d None None] The sync data for ids ['ed6451cf-7a08-48a6-b823-dd9d01bcee79'] in dv-cinder-789564-2-iscsi is: [{'id': 'ed6451cf-7a08-48a6-b823-dd9d01bcee79', 'name': 'tempest-TestMinimumBasicScenario-1304633943-router', 'tenant_id': '79ce7e80f85a4c57896263e5974c8df8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.80'}], 'enable_snat': True}, 'gw_port_id': '6c066f26-0761-4bef-b612-661f04382074', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:48:09Z', 'updated_at': '2021-05-25T17:53:05Z', 'revision_number': 5, 'project_id': '79ce7e80f85a4c57896263e5974c8df8', 'gw_port': {'id': '6c066f26-0761-4bef-b612-661f04382074', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:0c:b5:ed', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ed6451cf-7a08-48a6-b823-dd9d01bcee79', 'device_owner': 'network:router_gateway', 'standard_attr_id': 478, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.80', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:48:10Z', 'updated_at': '2021-05-25T17:48:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi'}] {{(pid=99028) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 25 17:53:08.385448 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-fd2a33f7-32bb-47b3-afdf-dcb463f6abb9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781841222566', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781840788188', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15476536'] for port, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:08.394964 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-b611e140-088e-47fd-bbe8-b23e0caa8988 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:53:08.582383 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd2a33f7-32bb-47b3-afdf-dcb463f6abb9 admin admin] Pushing event deleted for resources: {'Port': ['ID=6c066f26-0761-4bef-b612-661f04382074,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:53:08.590434 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-fd2a33f7-32bb-47b3-afdf-dcb463f6abb9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.196s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:53:08.672031 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc6a1e67-a72d-4f37-b866-aa414cb0b8c5 req-c0fc398f-b5f5-4c3a-a5a6-65dd45d2cdd1 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:53:08.673620 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-bc6a1e67-a72d-4f37-b866-aa414cb0b8c5 req-c0fc398f-b5f5-4c3a-a5a6-65dd45d2cdd1 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] 10.222.0.122 "GET /v2.0/ports?device_id=13642fad-7755-444a-9c6e-d179ce91d0f4 HTTP/1.1" status: 200  len: 943 time: 0.3232672
May 25 17:53:08.674590 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-fd2a33f7-32bb-47b3-afdf-dcb463f6abb9 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-419894'] for router_gateway, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:08.877255 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-fd2a33f7-32bb-47b3-afdf-dcb463f6abb9 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-415163', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-6965'] for router, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:08.882341 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-fd2a33f7-32bb-47b3-afdf-dcb463f6abb9 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:08.892768 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-bc6a1e67-a72d-4f37-b866-aa414cb0b8c5 req-5bcf8613-8e48-446c-b943-7411181194d1 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] 10.222.0.122 "GET /v2.0/security-groups?id=beb878a4-0349-4b8d-8e49-88c1a35c8216&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1738546
May 25 17:53:08.983468 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-fd2a33f7-32bb-47b3-afdf-dcb463f6abb9 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-414855'] for router, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:08.984037 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fd2a33f7-32bb-47b3-afdf-dcb463f6abb9 admin admin] Fanout notify agent at l3_agent the message router_deleted on router ed6451cf-7a08-48a6-b823-dd9d01bcee79 {{(pid=99026) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
May 25 17:53:08.999334 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-fd2a33f7-32bb-47b3-afdf-dcb463f6abb9 admin admin] Notify callbacks [] for router, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:09.000479 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-fd2a33f7-32bb-47b3-afdf-dcb463f6abb9 admin admin] 10.222.0.122 "DELETE /v2.0/routers/ed6451cf-7a08-48a6-b823-dd9d01bcee79 HTTP/1.1" status: 204  len: 168 time: 1.6917450
May 25 17:53:09.004372 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 49024) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:53:09.065823 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.db_base_plugin_v2 [None req-ce86a490-135b-4598-bce7-b0404fffaec6 admin admin] Deleting subnet 200f371a-f534-452e-9426-951e43bcffe5 {{(pid=99026) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 25 17:53:09.069430 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-ce86a490-135b-4598-bce7-b0404fffaec6 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:09.121860 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-ce86a490-135b-4598-bce7-b0404fffaec6 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-14735050'] for subnet, precommit_delete_associations {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:09.236364 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-ce86a490-135b-4598-bce7-b0404fffaec6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1474503'] for subnet, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:09.465317 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device 6c066f26-0761-4bef-b612-661f04382074 no longer exists at agent ovs-agent-dv-cinder-789564-2-iscsi {{(pid=99028) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 17:53:09.505984 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.plugin [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] No Port match for: 6c066f26-0761-4bef-b612-661f04382074 {{(pid=99028) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 25 17:53:09.506339 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device 6c066f26-0761-4bef-b612-661f04382074 not bound to the agent host dv-cinder-789564-2-iscsi {{(pid=99028) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 25 17:53:09.506764 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device 1d7a4034-86b0-49fb-bf45-68dda95544c2 no longer exists at agent ovs-agent-dv-cinder-789564-2-iscsi {{(pid=99028) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 17:53:09.540124 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.plugin [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] No Port match for: 1d7a4034-86b0-49fb-bf45-68dda95544c2 {{(pid=99028) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 25 17:53:09.540468 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device 1d7a4034-86b0-49fb-bf45-68dda95544c2 not bound to the agent host dv-cinder-789564-2-iscsi {{(pid=99028) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 25 17:53:09.572130 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-ce86a490-135b-4598-bce7-b0404fffaec6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1473138', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114466', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-15477963', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-14794250'] for subnet, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:09.576279 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:53:09.610446 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce86a490-135b-4598-bce7-b0404fffaec6 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=200f371a-f534-452e-9426-951e43bcffe5,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:53:09.614175 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-ce86a490-135b-4598-bce7-b0404fffaec6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:53:09.615151 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-ce86a490-135b-4598-bce7-b0404fffaec6 admin admin] Notify callbacks [] for subnet, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:09.619767 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-27bb5a62-9438-4e36-afc3-0c5203486b35 None None] Network 7904a86e-e373-4117-97cd-a894d782e3e5 requested from dv-cinder-789564-2-iscsi {{(pid=99028) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 17:53:09.622435 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-ce86a490-135b-4598-bce7-b0404fffaec6 admin admin] 10.222.0.122 "DELETE /v2.0/subnets/200f371a-f534-452e-9426-951e43bcffe5 HTTP/1.1" status: 204  len: 168 time: 0.6169245
May 25 17:53:09.624844 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 49028) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:53:09.733435 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-188dee88-fd48-4a36-95fa-8b8ad5243051 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1492659'] for network, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:09.816255 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.plugin [None req-188dee88-fd48-4a36-95fa-8b8ad5243051 admin admin] Deleting port 32dce052-f792-42ff-94f7-ee823910dc0b {{(pid=99026) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 17:53:09.816602 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-188dee88-fd48-4a36-95fa-8b8ad5243051 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781841220419'] for port, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:09.908672 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dace9e9e-80bb-4933-88ad-4396446ba675 None None] DHCP port deletion for 7904a86e-e373-4117-97cd-a894d782e3e5 request from dv-cinder-789564-2-iscsi {{(pid=99028) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
May 25 17:53:09.929175 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.db [None req-188dee88-fd48-4a36-95fa-8b8ad5243051 admin admin] For port 32dce052-f792-42ff-94f7-ee823910dc0b, host dv-cinder-789564-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=32dce052-f792-42ff-94f7-ee823910dc0b,segment=NetworkSegment(343b7bea-3acc-4c9d-939f-d8bc9eea2e5e),segment_id=343b7bea-3acc-4c9d-939f-d8bc9eea2e5e)] {{(pid=99026) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:53:09.929653 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-188dee88-fd48-4a36-95fa-8b8ad5243051 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-418810'] for port, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:09.976702 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.plugin [None req-dace9e9e-80bb-4933-88ad-4396446ba675 None None] Deleting port 32dce052-f792-42ff-94f7-ee823910dc0b {{(pid=99028) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 17:53:09.977073 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-dace9e9e-80bb-4933-88ad-4396446ba675 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781841220419'] for port, before_delete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:10.068174 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.plugin [None req-188dee88-fd48-4a36-95fa-8b8ad5243051 admin admin] Calling delete_port for 32dce052-f792-42ff-94f7-ee823910dc0b owned by network:dhcp {{(pid=99026) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 17:53:10.079025 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-dace9e9e-80bb-4933-88ad-4396446ba675 None None] For port 32dce052-f792-42ff-94f7-ee823910dc0b, host dv-cinder-789564-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=32dce052-f792-42ff-94f7-ee823910dc0b,segment=NetworkSegment(343b7bea-3acc-4c9d-939f-d8bc9eea2e5e),segment_id=343b7bea-3acc-4c9d-939f-d8bc9eea2e5e)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:53:10.079444 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-dace9e9e-80bb-4933-88ad-4396446ba675 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-418810'] for port, precommit_delete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:10.084104 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1b85101-ee55-4333-a6a3-faef25798493 req-fe54bca4-7f9a-4abe-b5f7-690ae64436e9 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:53:10.085697 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-f1b85101-ee55-4333-a6a3-faef25798493 req-fe54bca4-7f9a-4abe-b5f7-690ae64436e9 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] 10.222.0.122 "GET /v2.0/ports?device_id=13642fad-7755-444a-9c6e-d179ce91d0f4 HTTP/1.1" status: 200  len: 943 time: 0.0844619
May 25 17:53:10.136343 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-f1b85101-ee55-4333-a6a3-faef25798493 req-12a6d28a-cc17-4da0-9fa0-2350a3b2b55b tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] 10.222.0.122 "GET /v2.0/security-groups?id=beb878a4-0349-4b8d-8e49-88c1a35c8216&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0442972
May 25 17:53:10.189138 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-188dee88-fd48-4a36-95fa-8b8ad5243051 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781841222566', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781840788188', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15476536'] for port, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:10.194515 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-d3114731-2418-4131-86c3-d050ff11c3bb tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:53:10.206707 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.plugin [None req-dace9e9e-80bb-4933-88ad-4396446ba675 None None] Calling delete_port for 32dce052-f792-42ff-94f7-ee823910dc0b owned by network:dhcp {{(pid=99028) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 17:53:10.239123 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-188dee88-fd48-4a36-95fa-8b8ad5243051 admin admin] Pushing event deleted for resources: {'Port': ['ID=32dce052-f792-42ff-94f7-ee823910dc0b,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:53:10.242366 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-188dee88-fd48-4a36-95fa-8b8ad5243051 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:53:10.243262 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.l3_dvrscheduler_db [None req-188dee88-fd48-4a36-95fa-8b8ad5243051 admin admin] No DVR routers for this DVR port 32dce052-f792-42ff-94f7-ee823910dc0b on host dv-cinder-789564-2-iscsi {{(pid=99026) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 25 17:53:10.341709 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-dace9e9e-80bb-4933-88ad-4396446ba675 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781841222566', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781840788188'] for port, after_delete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:10.345512 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-22651512-fc64-4305-995b-985ad1d3d588 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:53:10.392344 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dace9e9e-80bb-4933-88ad-4396446ba675 None None] Pushing event deleted for resources: {'Port': ['ID=32dce052-f792-42ff-94f7-ee823910dc0b,revision_number=None']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:53:10.397957 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dace9e9e-80bb-4933-88ad-4396446ba675 None None] No DVR routers for this DVR port 32dce052-f792-42ff-94f7-ee823910dc0b on host dv-cinder-789564-2-iscsi {{(pid=99028) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 25 17:53:10.403420 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dace9e9e-80bb-4933-88ad-4396446ba675 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:53:10.403770 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dace9e9e-80bb-4933-88ad-4396446ba675 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:53:10.404106 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dace9e9e-80bb-4933-88ad-4396446ba675 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:53:10.404439 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dace9e9e-80bb-4933-88ad-4396446ba675 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:53:10.404768 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dace9e9e-80bb-4933-88ad-4396446ba675 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:53:10.405108 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dace9e9e-80bb-4933-88ad-4396446ba675 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:53:10.405436 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dace9e9e-80bb-4933-88ad-4396446ba675 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:53:10.405761 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dace9e9e-80bb-4933-88ad-4396446ba675 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:53:10.406084 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dace9e9e-80bb-4933-88ad-4396446ba675 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:53:10.406474 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dace9e9e-80bb-4933-88ad-4396446ba675 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:53:10.407168 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dace9e9e-80bb-4933-88ad-4396446ba675 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:53:10.407168 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dace9e9e-80bb-4933-88ad-4396446ba675 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:53:10.411512 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-dace9e9e-80bb-4933-88ad-4396446ba675 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.066s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:53:10.465820 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-188dee88-fd48-4a36-95fa-8b8ad5243051 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1470792', 'neutron.services.segments.db._delete_segments_for_network-8781841233116'] for network, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:10.479845 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.services.segments.db [None req-188dee88-fd48-4a36-95fa-8b8ad5243051 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fcae6d41880>,) {'filters': {'network_id': ['7904a86e-e373-4117-97cd-a894d782e3e5']}} {{(pid=99026) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:53:10.491861 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.services.segments.db [None req-188dee88-fd48-4a36-95fa-8b8ad5243051 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fcae6d41880>, '343b7bea-3acc-4c9d-939f-d8bc9eea2e5e') {'for_net_delete': True} {{(pid=99026) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:53:10.492157 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.services.segments.db [None req-188dee88-fd48-4a36-95fa-8b8ad5243051 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fcae6d41880>, '343b7bea-3acc-4c9d-939f-d8bc9eea2e5e') {} {{(pid=99026) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:53:10.503596 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-188dee88-fd48-4a36-95fa-8b8ad5243051 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8781841242525', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-14735041'] for segment, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:10.520170 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-188dee88-fd48-4a36-95fa-8b8ad5243051 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1469168'] for segment, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:10.526278 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-188dee88-fd48-4a36-95fa-8b8ad5243051 admin admin] Releasing vlan 1319 on physical network physnet1 to pool {{(pid=99026) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 25 17:53:10.526654 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-188dee88-fd48-4a36-95fa-8b8ad5243051 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1469168', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-15476589'] for segment, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:10.540262 dv-cinder-789564-2-iscsi neutron-server[99026]: Traceback (most recent call last):
May 25 17:53:10.540262 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 25 17:53:10.540262 dv-cinder-789564-2-iscsi neutron-server[99026]:     timer()
May 25 17:53:10.540262 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 25 17:53:10.540262 dv-cinder-789564-2-iscsi neutron-server[99026]:     cb(*args, **kw)
May 25 17:53:10.540262 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 25 17:53:10.540262 dv-cinder-789564-2-iscsi neutron-server[99026]:     return func(*args, **kwargs)
May 25 17:53:10.540262 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 25 17:53:10.540262 dv-cinder-789564-2-iscsi neutron-server[99026]:     self._notify()
May 25 17:53:10.540262 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 25 17:53:10.540262 dv-cinder-789564-2-iscsi neutron-server[99026]:     self.callback(batched_events)
May 25 17:53:10.540262 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 25 17:53:10.540262 dv-cinder-789564-2-iscsi neutron-server[99026]:     event.method(event)
May 25 17:53:10.540262 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 25 17:53:10.540262 dv-cinder-789564-2-iscsi neutron-server[99026]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 25 17:53:10.540262 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 25 17:53:10.540262 dv-cinder-789564-2-iscsi neutron-server[99026]:     aggregate_uuid = self.p_client.list_aggregates(
May 25 17:53:10.540262 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 25 17:53:10.540262 dv-cinder-789564-2-iscsi neutron-server[99026]:     return f(self, *a, **k)
May 25 17:53:10.540262 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 25 17:53:10.540262 dv-cinder-789564-2-iscsi neutron-server[99026]:     return self._get(url).json()
May 25 17:53:10.540262 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 25 17:53:10.540262 dv-cinder-789564-2-iscsi neutron-server[99026]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 25 17:53:10.540262 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 25 17:53:10.540262 dv-cinder-789564-2-iscsi neutron-server[99026]:     return self.request(url, 'GET', **kwargs)
May 25 17:53:10.540262 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 25 17:53:10.540262 dv-cinder-789564-2-iscsi neutron-server[99026]:     base_url = self.get_endpoint(auth, allow=allow,
May 25 17:53:10.540262 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 25 17:53:10.540262 dv-cinder-789564-2-iscsi neutron-server[99026]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 25 17:53:10.540262 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 25 17:53:10.540262 dv-cinder-789564-2-iscsi neutron-server[99026]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 25 17:53:10.540262 dv-cinder-789564-2-iscsi neutron-server[99026]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 25 17:53:10.763957 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-188dee88-fd48-4a36-95fa-8b8ad5243051 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1470785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-459299', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551400', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-419883'] for network, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:10.767709 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-2df73c1c-d247-42d9-b20c-a29c61b901d5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:53:10.780894 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-188dee88-fd48-4a36-95fa-8b8ad5243051 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for network, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:10.793286 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-188dee88-fd48-4a36-95fa-8b8ad5243051 admin admin] Pushing event deleted for resources: {'Network': ['ID=7904a86e-e373-4117-97cd-a894d782e3e5,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:53:10.797434 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-188dee88-fd48-4a36-95fa-8b8ad5243051 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:53:10.881187 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-188dee88-fd48-4a36-95fa-8b8ad5243051 admin admin] 10.222.0.122 "DELETE /v2.0/networks/7904a86e-e373-4117-97cd-a894d782e3e5 HTTP/1.1" status: 204  len: 168 time: 1.2552440
May 25 17:53:10.884005 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 49034) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:53:11.271644 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Device 0d0462ae-dc68-4a19-b6a6-bfdd10328c4c details requested by agent hyperv_hv-cinder-78956 with host hv-cinder-78956 {{(pid=99028) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 25 17:53:11.405544 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] For port 0d0462ae-dc68-4a19-b6a6-bfdd10328c4c, host hv-cinder-78956, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=0d0462ae-dc68-4a19-b6a6-bfdd10328c4c,segment=NetworkSegment(9ffd894c-b357-4c03-93af-a222f8984466),segment_id=9ffd894c-b357-4c03-93af-a222f8984466)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:53:11.416275 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4b31bf6-44c8-4639-af97-426429278785 req-3c858f20-ca21-4c32-a374-3bee4cae71bc tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:53:11.417758 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-f4b31bf6-44c8-4639-af97-426429278785 req-3c858f20-ca21-4c32-a374-3bee4cae71bc tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] 10.222.0.122 "GET /v2.0/ports?device_id=13642fad-7755-444a-9c6e-d179ce91d0f4 HTTP/1.1" status: 200  len: 943 time: 0.1532133
May 25 17:53:11.420269 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Returning: {'device': '0d0462ae-dc68-4a19-b6a6-bfdd10328c4c', 'network_id': 'defaef08-c0f9-4608-b66d-b97e06e185bf', 'port_id': '0d0462ae-dc68-4a19-b6a6-bfdd10328c4c', 'mac_address': 'fa:16:3e:1b:3b:9d', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1316, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '5be08358-9d04-4ee9-91ac-104e66e66e20', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=99028) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 25 17:53:11.480431 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-f4b31bf6-44c8-4639-af97-426429278785 req-8fb96b98-b3c9-406f-937f-0b337509429b tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] 10.222.0.122 "GET /v2.0/security-groups?id=beb878a4-0349-4b8d-8e49-88c1a35c8216&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0532525
May 25 17:53:11.482906 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device 32dce052-f792-42ff-94f7-ee823910dc0b no longer exists at agent ovs-agent-dv-cinder-789564-2-iscsi {{(pid=99028) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 17:53:11.526175 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:11.538479 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.plugin [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] No Port match for: 32dce052-f792-42ff-94f7-ee823910dc0b {{(pid=99028) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 25 17:53:11.538830 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device 32dce052-f792-42ff-94f7-ee823910dc0b not bound to the agent host dv-cinder-789564-2-iscsi {{(pid=99028) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 25 17:53:11.551397 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.notifiers.nova [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 0d0462ae-dc68-4a19-b6a6-bfdd10328c4c {{(pid=99028) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 25 17:53:11.551820 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-e339a247-5c98-4e34-8514-4785d769f78c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-420907'] for router_interface, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:11.568346 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] For port 0d0462ae-dc68-4a19-b6a6-bfdd10328c4c, host hv-cinder-78956, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=0d0462ae-dc68-4a19-b6a6-bfdd10328c4c,segment=NetworkSegment(9ffd894c-b357-4c03-93af-a222f8984466),segment_id=9ffd894c-b357-4c03-93af-a222f8984466)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:53:11.667163 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:11.703505 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:11.705327 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:53:11.772851 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Pushing event updated for resources: {'Port': ['ID=0d0462ae-dc68-4a19-b6a6-bfdd10328c4c,revision_number=4']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:53:11.776050 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:53:11.974174 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.plugin [None req-e339a247-5c98-4e34-8514-4785d769f78c admin admin] Deleting port b9d25e74-356d-4468-b89b-65b6dcd07430 {{(pid=99026) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 17:53:11.974786 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-e339a247-5c98-4e34-8514-4785d769f78c admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781841220419'] for port, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:12.022272 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] get_ports_and_sgs() called for port_ids ['0d0462ae-dc68-4a19-b6a6-bfdd10328c4c'] {{(pid=99028) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 25 17:53:12.221263 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.db [None req-e339a247-5c98-4e34-8514-4785d769f78c admin admin] For port b9d25e74-356d-4468-b89b-65b6dcd07430, host dv-cinder-789564-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=b9d25e74-356d-4468-b89b-65b6dcd07430,segment=NetworkSegment(5489ccf8-d699-4f3b-b799-d731b364f968),segment_id=5489ccf8-d699-4f3b-b799-d731b364f968)] {{(pid=99026) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:53:12.221629 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-e339a247-5c98-4e34-8514-4785d769f78c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-418810'] for port, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:12.352011 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.plugin [None req-e339a247-5c98-4e34-8514-4785d769f78c admin admin] Calling delete_port for b9d25e74-356d-4468-b89b-65b6dcd07430 owned by network:router_interface {{(pid=99026) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 17:53:12.672084 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e8349fd-d2c4-473b-834d-c25e6a0cf119 req-c1e52c64-debf-4b2c-9def-c5dd6709a0c2 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:53:12.673558 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-1e8349fd-d2c4-473b-834d-c25e6a0cf119 req-c1e52c64-debf-4b2c-9def-c5dd6709a0c2 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] 10.222.0.122 "GET /v2.0/ports?device_id=13642fad-7755-444a-9c6e-d179ce91d0f4 HTTP/1.1" status: 200  len: 944 time: 0.0811629
May 25 17:53:12.718502 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-1e8349fd-d2c4-473b-834d-c25e6a0cf119 req-f88036ee-e6f2-4a86-83d9-0fc2ff91ebec tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] 10.222.0.122 "GET /v2.0/security-groups?id=beb878a4-0349-4b8d-8e49-88c1a35c8216&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0390000
May 25 17:53:12.839507 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-e339a247-5c98-4e34-8514-4785d769f78c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781841222566', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781840788188', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15476536'] for port, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:12.844413 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:53:12.927033 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e339a247-5c98-4e34-8514-4785d769f78c admin admin] Pushing event deleted for resources: {'Port': ['ID=b9d25e74-356d-4468-b89b-65b6dcd07430,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:53:12.955991 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-e339a247-5c98-4e34-8514-4785d769f78c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.090s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:53:13.193777 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-e339a247-5c98-4e34-8514-4785d769f78c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-551393', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-420795'] for router_interface, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:13.273275 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Device 0d0462ae-dc68-4a19-b6a6-bfdd10328c4c up at agent hyperv_hv-cinder-78956 {{(pid=99028) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 17:53:13.458641 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Provisioning for port 0d0462ae-dc68-4a19-b6a6-bfdd10328c4c completed by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 17:53:13.458641 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Provisioning complete for port 0d0462ae-dc68-4a19-b6a6-bfdd10328c4c triggered by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 17:53:13.458641 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:13.558733 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e339a247-5c98-4e34-8514-4785d769f78c admin admin] Router f5989ab6-97cf-4e25-b382-1dbcb19a08fa has already been hosted by L3 agent eaeb6875-c4ed-43b6-8658-aa4e52324fdf {{(pid=99026) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 25 17:53:13.570036 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:13.596832 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '13642fad-7755-444a-9c6e-d179ce91d0f4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0d0462ae-dc68-4a19-b6a6-bfdd10328c4c'}] {{(pid=99028) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 17:53:13.607164 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] For port 0d0462ae-dc68-4a19-b6a6-bfdd10328c4c, host hv-cinder-78956, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=0d0462ae-dc68-4a19-b6a6-bfdd10328c4c,segment=NetworkSegment(9ffd894c-b357-4c03-93af-a222f8984466),segment_id=9ffd894c-b357-4c03-93af-a222f8984466)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:53:13.641384 dv-cinder-789564-2-iscsi neutron-server[99028]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '13642fad-7755-444a-9c6e-d179ce91d0f4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0d0462ae-dc68-4a19-b6a6-bfdd10328c4c', 'code': 200}
May 25 17:53:13.741563 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e339a247-5c98-4e34-8514-4785d769f78c admin admin] Notify agent at l3_agent.dv-cinder-789564-2-iscsi the message routers_updated {{(pid=99026) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 25 17:53:13.750576 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:13.764876 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-25bf6fe1-4bff-41ad-b5cf-5e8ed08acad0 None None] Sync routers for ids ['f5989ab6-97cf-4e25-b382-1dbcb19a08fa'] in dv-cinder-789564-2-iscsi {{(pid=99029) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 25 17:53:13.765852 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:53:13.765952 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_dvrscheduler_db [None req-25bf6fe1-4bff-41ad-b5cf-5e8ed08acad0 None None] Routers {'f5989ab6-97cf-4e25-b382-1dbcb19a08fa'} bound to L3 agent in host dv-cinder-789564-2-iscsi {{(pid=99029) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 17:53:13.765952 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_hamode_db [None req-25bf6fe1-4bff-41ad-b5cf-5e8ed08acad0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcae6e5cfd0>, 'dv-cinder-789564-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T17:34:21Z,description=<?>,heartbeat_timestamp=2021-05-25T17:52:51Z,host='dv-cinder-789564-2-iscsi',id=eaeb6875-c4ed-43b6-8658-aa4e52324fdf,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T17:34:21Z,topic='l3_agent')) {'router_ids': ['f5989ab6-97cf-4e25-b382-1dbcb19a08fa'], 'active': True} {{(pid=99029) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:53:13.828029 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Pushing event updated for resources: {'Port': ['ID=0d0462ae-dc68-4a19-b6a6-bfdd10328c4c,revision_number=5']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:53:13.839758 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:53:13.925953 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5378df84-eab1-44ef-991c-2069de9d939e req-68e89721-4ee5-4996-9a08-cc49f5ce2bb8 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:53:13.928246 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-5378df84-eab1-44ef-991c-2069de9d939e req-68e89721-4ee5-4996-9a08-cc49f5ce2bb8 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] 10.222.0.122 "GET /v2.0/ports?device_id=13642fad-7755-444a-9c6e-d179ce91d0f4 HTTP/1.1" status: 200  len: 945 time: 0.0933223
May 25 17:53:13.954362 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-e339a247-5c98-4e34-8514-4785d769f78c admin admin] 10.222.0.122 "PUT /v2.0/routers/f5989ab6-97cf-4e25-b382-1dbcb19a08fa/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 3.0692840
May 25 17:53:13.957010 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 49046) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:53:13.978918 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_dvr_db [None req-25bf6fe1-4bff-41ad-b5cf-5e8ed08acad0 None None] Set router f5989ab6-97cf-4e25-b382-1dbcb19a08fa gateway port host: dv-cinder-789564-2-iscsi {{(pid=99029) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 17:53:14.056491 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-5378df84-eab1-44ef-991c-2069de9d939e req-7e894bf0-124e-4222-b082-7682d9b9a686 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] 10.222.0.122 "GET /v2.0/security-groups?id=beb878a4-0349-4b8d-8e49-88c1a35c8216&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1221681
May 25 17:53:14.155484 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-8dae9941-91d4-4ce4-acf9-025ee2341832 admin admin] Notify callbacks [] for router, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:14.237183 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea3881dc-2aab-4463-9c43-bed15001d9eb req-17852866-8fd3-413a-8f89-11b4555aa73e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:53:14.238948 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-ea3881dc-2aab-4463-9c43-bed15001d9eb req-17852866-8fd3-413a-8f89-11b4555aa73e service neutron] 10.222.0.125 "GET /v2.0/ports?device_id=13642fad-7755-444a-9c6e-d179ce91d0f4 HTTP/1.1" status: 200  len: 1098 time: 0.0807891
May 25 17:53:14.275678 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_hamode_db [None req-25bf6fe1-4bff-41ad-b5cf-5e8ed08acad0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcae6e5cfd0>, [{'id': 'f5989ab6-97cf-4e25-b382-1dbcb19a08fa', 'name': 'tempest-TestMinimumBasicScenario-1194480117-router', 'tenant_id': '97633fb362914841abbdf8ac783702ad', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.96'}], 'enable_snat': True}, 'gw_port_id': 'd0e14de1-78ba-4be4-ab01-9637fae4743c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:48:18Z', 'updated_at': '2021-05-25T17:53:12Z', 'revision_number': 5, 'project_id': '97633fb362914841abbdf8ac783702ad', 'gw_port': {'id': 'd0e14de1-78ba-4be4-ab01-9637fae4743c', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:71:d4:5b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f5989ab6-97cf-4e25-b382-1dbcb19a08fa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 490, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.96', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:48:19Z', 'updated_at': '2021-05-25T17:48:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi'}], 'dv-cinder-789564-2-iscsi', False) {} {{(pid=99029) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:53:14.279592 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-25bf6fe1-4bff-41ad-b5cf-5e8ed08acad0 None None] Checking router: f5989ab6-97cf-4e25-b382-1dbcb19a08fa for host: dv-cinder-789564-2-iscsi {{(pid=99029) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 25 17:53:14.283861 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-ea3881dc-2aab-4463-9c43-bed15001d9eb req-802df8a0-1514-4b63-a205-86a9457700f5 service neutron] 10.222.0.125 "GET /v2.0/security-groups?id=beb878a4-0349-4b8d-8e49-88c1a35c8216&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0365698
May 25 17:53:14.288284 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_dvrscheduler_db [None req-25bf6fe1-4bff-41ad-b5cf-5e8ed08acad0 None None] Routers {'f5989ab6-97cf-4e25-b382-1dbcb19a08fa'} bound to L3 agent in host dv-cinder-789564-2-iscsi {{(pid=99029) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 17:53:14.288879 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_hamode_db [None req-25bf6fe1-4bff-41ad-b5cf-5e8ed08acad0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcae6e5cfd0>, 'dv-cinder-789564-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T17:34:21Z,description=<?>,heartbeat_timestamp=2021-05-25T17:52:51Z,host='dv-cinder-789564-2-iscsi',id=eaeb6875-c4ed-43b6-8658-aa4e52324fdf,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T17:34:21Z,topic='l3_agent')) {'router_ids': ['f5989ab6-97cf-4e25-b382-1dbcb19a08fa'], 'active': True} {{(pid=99029) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:53:14.335082 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-8dae9941-91d4-4ce4-acf9-025ee2341832 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:14.466363 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_dvr_db [None req-25bf6fe1-4bff-41ad-b5cf-5e8ed08acad0 None None] Set router f5989ab6-97cf-4e25-b382-1dbcb19a08fa gateway port host: dv-cinder-789564-2-iscsi {{(pid=99029) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 17:53:14.495465 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.plugin [None req-8dae9941-91d4-4ce4-acf9-025ee2341832 admin admin] Deleting port d0e14de1-78ba-4be4-ab01-9637fae4743c {{(pid=99027) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 17:53:14.495795 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-8dae9941-91d4-4ce4-acf9-025ee2341832 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781841220419'] for port, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:14.705262 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.db [None req-8dae9941-91d4-4ce4-acf9-025ee2341832 admin admin] For port d0e14de1-78ba-4be4-ab01-9637fae4743c, host dv-cinder-789564-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=d0e14de1-78ba-4be4-ab01-9637fae4743c,segment=NetworkSegment(471771f9-c462-4865-800d-0d5029e9eb3e),segment_id=471771f9-c462-4865-800d-0d5029e9eb3e)] {{(pid=99027) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:53:14.705767 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-8dae9941-91d4-4ce4-acf9-025ee2341832 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-418810'] for port, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:14.758150 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_hamode_db [None req-25bf6fe1-4bff-41ad-b5cf-5e8ed08acad0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcae6e5cfd0>, [{'id': 'f5989ab6-97cf-4e25-b382-1dbcb19a08fa', 'name': 'tempest-TestMinimumBasicScenario-1194480117-router', 'tenant_id': '97633fb362914841abbdf8ac783702ad', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.96'}], 'enable_snat': True}, 'gw_port_id': 'd0e14de1-78ba-4be4-ab01-9637fae4743c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:48:18Z', 'updated_at': '2021-05-25T17:53:12Z', 'revision_number': 5, 'project_id': '97633fb362914841abbdf8ac783702ad', 'gw_port': {'id': 'd0e14de1-78ba-4be4-ab01-9637fae4743c', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:71:d4:5b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f5989ab6-97cf-4e25-b382-1dbcb19a08fa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 490, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.96', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:48:19Z', 'updated_at': '2021-05-25T17:48:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi'}], 'dv-cinder-789564-2-iscsi', False) {} {{(pid=99029) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:53:14.762150 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-25bf6fe1-4bff-41ad-b5cf-5e8ed08acad0 None None] The sync data for ids ['f5989ab6-97cf-4e25-b382-1dbcb19a08fa'] in dv-cinder-789564-2-iscsi is: [{'id': 'f5989ab6-97cf-4e25-b382-1dbcb19a08fa', 'name': 'tempest-TestMinimumBasicScenario-1194480117-router', 'tenant_id': '97633fb362914841abbdf8ac783702ad', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.96'}], 'enable_snat': True}, 'gw_port_id': 'd0e14de1-78ba-4be4-ab01-9637fae4743c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:48:18Z', 'updated_at': '2021-05-25T17:53:12Z', 'revision_number': 5, 'project_id': '97633fb362914841abbdf8ac783702ad', 'gw_port': {'id': 'd0e14de1-78ba-4be4-ab01-9637fae4743c', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:71:d4:5b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f5989ab6-97cf-4e25-b382-1dbcb19a08fa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 490, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.96', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:48:19Z', 'updated_at': '2021-05-25T17:48:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi'}] {{(pid=99029) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 25 17:53:14.829676 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.plugin [None req-8dae9941-91d4-4ce4-acf9-025ee2341832 admin admin] Calling delete_port for d0e14de1-78ba-4be4-ab01-9637fae4743c owned by network:router_gateway {{(pid=99027) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 17:53:15.218574 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-8dae9941-91d4-4ce4-acf9-025ee2341832 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781841222566', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781840788188', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15468986'] for port, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:15.229167 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-a10dbed3-284d-490b-8736-4b8f03b88811 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:53:15.277610 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dae9941-91d4-4ce4-acf9-025ee2341832 admin admin] Pushing event deleted for resources: {'Port': ['ID=d0e14de1-78ba-4be4-ab01-9637fae4743c,revision_number=None']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:53:15.304496 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-8dae9941-91d4-4ce4-acf9-025ee2341832 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:53:15.370365 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-8dae9941-91d4-4ce4-acf9-025ee2341832 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-419894'] for router_gateway, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:15.491825 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device b9d25e74-356d-4468-b89b-65b6dcd07430 no longer exists at agent ovs-agent-dv-cinder-789564-2-iscsi {{(pid=99028) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 17:53:15.527768 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d9e917b-5bce-4be3-be82-f1756c33ea12 req-ce75cc1b-752a-47aa-b400-d6f61cd2db1b tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:53:15.529290 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.plugin [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] No Port match for: b9d25e74-356d-4468-b89b-65b6dcd07430 {{(pid=99028) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 25 17:53:15.529431 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-8d9e917b-5bce-4be3-be82-f1756c33ea12 req-ce75cc1b-752a-47aa-b400-d6f61cd2db1b tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] 10.222.0.122 "GET /v2.0/ports?device_id=13642fad-7755-444a-9c6e-d179ce91d0f4 HTTP/1.1" status: 200  len: 945 time: 0.2019434
May 25 17:53:15.529796 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device b9d25e74-356d-4468-b89b-65b6dcd07430 not bound to the agent host dv-cinder-789564-2-iscsi {{(pid=99028) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 25 17:53:15.559029 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-8dae9941-91d4-4ce4-acf9-025ee2341832 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-415163', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-6965'] for router, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:15.561753 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-8dae9941-91d4-4ce4-acf9-025ee2341832 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:15.578452 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-8d9e917b-5bce-4be3-be82-f1756c33ea12 req-7ec57571-75e3-411b-82a3-699ee555cd36 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] 10.222.0.122 "GET /v2.0/security-groups?id=beb878a4-0349-4b8d-8e49-88c1a35c8216&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0418694
May 25 17:53:15.721026 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-8dae9941-91d4-4ce4-acf9-025ee2341832 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-414855'] for router, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:15.721526 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8dae9941-91d4-4ce4-acf9-025ee2341832 admin admin] Fanout notify agent at l3_agent the message router_deleted on router f5989ab6-97cf-4e25-b382-1dbcb19a08fa {{(pid=99027) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
May 25 17:53:15.750796 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-8dae9941-91d4-4ce4-acf9-025ee2341832 admin admin] Notify callbacks [] for router, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:15.754401 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-8dae9941-91d4-4ce4-acf9-025ee2341832 admin admin] 10.222.0.122 "DELETE /v2.0/routers/f5989ab6-97cf-4e25-b382-1dbcb19a08fa HTTP/1.1" status: 204  len: 168 time: 1.7925594
May 25 17:53:15.755708 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 49054) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:53:15.779126 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f34aa85-216d-4877-b809-8e2135c538b8 req-141e31ea-2a4a-488c-9421-3ab214b6803d tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:53:15.780680 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-5f34aa85-216d-4877-b809-8e2135c538b8 req-141e31ea-2a4a-488c-9421-3ab214b6803d tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] 10.222.0.122 "GET /v2.0/ports?device_id=13642fad-7755-444a-9c6e-d179ce91d0f4 HTTP/1.1" status: 200  len: 945 time: 0.0945911
May 25 17:53:15.789651 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 49058) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:53:15.794949 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.v2.base [None req-156cf0fa-2798-42ad-ae0c-694dfe5e139e tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Request body: {'floatingip': {'port_id': '0d0462ae-dc68-4a19-b6a6-bfdd10328c4c'}} {{(pid=99027) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:53:15.824363 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.db_base_plugin_v2 [None req-13feabac-220c-4709-9be0-178ecdbeb918 admin admin] Deleting subnet f9276786-22d3-46c6-86c0-89de64dcd673 {{(pid=99026) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 25 17:53:15.841374 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-13feabac-220c-4709-9be0-178ecdbeb918 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:15.883333 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-156cf0fa-2798-42ad-ae0c-694dfe5e139e tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify callbacks [] for floatingip, before_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:15.885525 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-13feabac-220c-4709-9be0-178ecdbeb918 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-14735050'] for subnet, precommit_delete_associations {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:15.969328 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-13feabac-220c-4709-9be0-178ecdbeb918 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1474503'] for subnet, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:16.315543 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-13feabac-220c-4709-9be0-178ecdbeb918 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1473138', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114466', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-15477963', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-14794250'] for subnet, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:16.323632 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-fa0f8d19-7c4d-4e4b-9f51-344e7f99bdcd admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:53:16.364262 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13feabac-220c-4709-9be0-178ecdbeb918 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=f9276786-22d3-46c6-86c0-89de64dcd673,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:53:16.366340 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-13feabac-220c-4709-9be0-178ecdbeb918 admin admin] Notify callbacks [] for subnet, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:16.371101 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-13feabac-220c-4709-9be0-178ecdbeb918 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:53:16.376304 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c2973d81-da71-4c00-9ded-b27d65024393 None None] Network 0c323e60-9fa9-440d-b8b6-7d4cb3856e61 requested from dv-cinder-789564-2-iscsi {{(pid=99028) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 17:53:16.378594 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-13feabac-220c-4709-9be0-178ecdbeb918 admin admin] 10.222.0.122 "DELETE /v2.0/subnets/f9276786-22d3-46c6-86c0-89de64dcd673 HTTP/1.1" status: 204  len: 168 time: 0.6215241
May 25 17:53:16.379585 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 49062) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:53:16.509646 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-55691888-e362-4405-97f4-5703f50d23a2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1492659'] for network, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:16.603763 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.plugin [None req-55691888-e362-4405-97f4-5703f50d23a2 admin admin] Deleting port 32d152f0-cc43-4ae9-97e2-62ce1b0f21cf {{(pid=99026) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 17:53:16.604878 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-55691888-e362-4405-97f4-5703f50d23a2 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781841220419'] for port, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:16.666421 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-156cf0fa-2798-42ad-ae0c-694dfe5e139e tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify callbacks [] for floatingip, precommit_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:16.675771 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ae7b0e51-685d-4f6d-8d32-419e8bd52ea1 None None] DHCP port deletion for 0c323e60-9fa9-440d-b8b6-7d4cb3856e61 request from dv-cinder-789564-2-iscsi {{(pid=99028) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
May 25 17:53:16.724838 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.db [None req-55691888-e362-4405-97f4-5703f50d23a2 admin admin] For port 32d152f0-cc43-4ae9-97e2-62ce1b0f21cf, host dv-cinder-789564-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=32d152f0-cc43-4ae9-97e2-62ce1b0f21cf,segment=NetworkSegment(5489ccf8-d699-4f3b-b799-d731b364f968),segment_id=5489ccf8-d699-4f3b-b799-d731b364f968)] {{(pid=99026) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:53:16.725138 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-55691888-e362-4405-97f4-5703f50d23a2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-418810'] for port, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:16.755698 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-156cf0fa-2798-42ad-ae0c-694dfe5e139e tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-419865'] for floatingip, after_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:16.793063 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.plugin [None req-ae7b0e51-685d-4f6d-8d32-419e8bd52ea1 None None] Deleting port 32d152f0-cc43-4ae9-97e2-62ce1b0f21cf {{(pid=99028) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 17:53:16.793442 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-ae7b0e51-685d-4f6d-8d32-419e8bd52ea1 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781841220419'] for port, before_delete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:16.876927 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.plugin [None req-55691888-e362-4405-97f4-5703f50d23a2 admin admin] Calling delete_port for 32d152f0-cc43-4ae9-97e2-62ce1b0f21cf owned by network:dhcp {{(pid=99026) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 17:53:16.907734 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-ae7b0e51-685d-4f6d-8d32-419e8bd52ea1 None None] For port 32d152f0-cc43-4ae9-97e2-62ce1b0f21cf, host dv-cinder-789564-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=32d152f0-cc43-4ae9-97e2-62ce1b0f21cf,segment=NetworkSegment(5489ccf8-d699-4f3b-b799-d731b364f968),segment_id=5489ccf8-d699-4f3b-b799-d731b364f968)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:53:16.908044 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-ae7b0e51-685d-4f6d-8d32-419e8bd52ea1 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-418810'] for port, precommit_delete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:16.949290 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.db.l3_db [None req-156cf0fa-2798-42ad-ae0c-694dfe5e139e tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Floating IP 4f3dd01e-d02b-4d74-a3a3-2b672f5cc2e4 associated. External IP: 172.27.3.37, port: 0d0462ae-dc68-4a19-b6a6-bfdd10328c4c.
May 25 17:53:17.021830 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-55691888-e362-4405-97f4-5703f50d23a2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781841222566', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781840788188', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15476536'] for port, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:17.032465 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-650f39c4-e288-4d9d-93fd-6eb70c75b81e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:53:17.052217 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.plugin [None req-ae7b0e51-685d-4f6d-8d32-419e8bd52ea1 None None] Calling delete_port for 32d152f0-cc43-4ae9-97e2-62ce1b0f21cf owned by network:dhcp {{(pid=99028) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 17:53:17.101631 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55691888-e362-4405-97f4-5703f50d23a2 admin admin] Pushing event deleted for resources: {'Port': ['ID=32d152f0-cc43-4ae9-97e2-62ce1b0f21cf,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:53:17.105397 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.l3_dvrscheduler_db [None req-55691888-e362-4405-97f4-5703f50d23a2 admin admin] No DVR routers for this DVR port 32d152f0-cc43-4ae9-97e2-62ce1b0f21cf on host dv-cinder-789564-2-iscsi {{(pid=99026) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 25 17:53:17.107988 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-55691888-e362-4405-97f4-5703f50d23a2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:53:17.108396 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-ae7b0e51-685d-4f6d-8d32-419e8bd52ea1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781841222566', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781840788188'] for port, after_delete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:17.113346 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-cf99e660-9af1-46cc-87aa-177a195e457e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:53:17.174546 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae7b0e51-685d-4f6d-8d32-419e8bd52ea1 None None] Pushing event deleted for resources: {'Port': ['ID=32d152f0-cc43-4ae9-97e2-62ce1b0f21cf,revision_number=None']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:53:17.176189 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ae7b0e51-685d-4f6d-8d32-419e8bd52ea1 None None] No DVR routers for this DVR port 32d152f0-cc43-4ae9-97e2-62ce1b0f21cf on host dv-cinder-789564-2-iscsi {{(pid=99028) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 25 17:53:17.180048 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-ae7b0e51-685d-4f6d-8d32-419e8bd52ea1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.067s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:53:17.251581 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-55691888-e362-4405-97f4-5703f50d23a2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1470792', 'neutron.services.segments.db._delete_segments_for_network-8781841233116'] for network, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:17.266379 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.services.segments.db [None req-55691888-e362-4405-97f4-5703f50d23a2 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fcae55fbee0>,) {'filters': {'network_id': ['0c323e60-9fa9-440d-b8b6-7d4cb3856e61']}} {{(pid=99026) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:53:17.279028 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.services.segments.db [None req-55691888-e362-4405-97f4-5703f50d23a2 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fcae55fbee0>, '5489ccf8-d699-4f3b-b799-d731b364f968') {'for_net_delete': True} {{(pid=99026) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:53:17.279357 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.services.segments.db [None req-55691888-e362-4405-97f4-5703f50d23a2 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fcae55fbee0>, '5489ccf8-d699-4f3b-b799-d731b364f968') {} {{(pid=99026) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:53:17.291086 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-55691888-e362-4405-97f4-5703f50d23a2 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8781841242525', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-14735041'] for segment, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:17.309337 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-55691888-e362-4405-97f4-5703f50d23a2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1469168'] for segment, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:17.316705 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-55691888-e362-4405-97f4-5703f50d23a2 admin admin] Releasing vlan 1322 on physical network physnet1 to pool {{(pid=99026) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 25 17:53:17.318399 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-55691888-e362-4405-97f4-5703f50d23a2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1469168', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-15476589'] for segment, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:17.330764 dv-cinder-789564-2-iscsi neutron-server[99026]: Traceback (most recent call last):
May 25 17:53:17.330764 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 25 17:53:17.330764 dv-cinder-789564-2-iscsi neutron-server[99026]:     timer()
May 25 17:53:17.330764 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 25 17:53:17.330764 dv-cinder-789564-2-iscsi neutron-server[99026]:     cb(*args, **kw)
May 25 17:53:17.330764 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 25 17:53:17.330764 dv-cinder-789564-2-iscsi neutron-server[99026]:     return func(*args, **kwargs)
May 25 17:53:17.330764 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 25 17:53:17.330764 dv-cinder-789564-2-iscsi neutron-server[99026]:     self._notify()
May 25 17:53:17.330764 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 25 17:53:17.330764 dv-cinder-789564-2-iscsi neutron-server[99026]:     self.callback(batched_events)
May 25 17:53:17.330764 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 25 17:53:17.330764 dv-cinder-789564-2-iscsi neutron-server[99026]:     event.method(event)
May 25 17:53:17.330764 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 25 17:53:17.330764 dv-cinder-789564-2-iscsi neutron-server[99026]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 25 17:53:17.330764 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 25 17:53:17.330764 dv-cinder-789564-2-iscsi neutron-server[99026]:     aggregate_uuid = self.p_client.list_aggregates(
May 25 17:53:17.330764 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 25 17:53:17.330764 dv-cinder-789564-2-iscsi neutron-server[99026]:     return f(self, *a, **k)
May 25 17:53:17.330764 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 25 17:53:17.330764 dv-cinder-789564-2-iscsi neutron-server[99026]:     return self._get(url).json()
May 25 17:53:17.330764 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 25 17:53:17.330764 dv-cinder-789564-2-iscsi neutron-server[99026]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 25 17:53:17.330764 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 25 17:53:17.330764 dv-cinder-789564-2-iscsi neutron-server[99026]:     return self.request(url, 'GET', **kwargs)
May 25 17:53:17.330764 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 25 17:53:17.330764 dv-cinder-789564-2-iscsi neutron-server[99026]:     base_url = self.get_endpoint(auth, allow=allow,
May 25 17:53:17.330764 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 25 17:53:17.330764 dv-cinder-789564-2-iscsi neutron-server[99026]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 25 17:53:17.330764 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 25 17:53:17.330764 dv-cinder-789564-2-iscsi neutron-server[99026]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 25 17:53:17.330764 dv-cinder-789564-2-iscsi neutron-server[99026]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 25 17:53:17.345126 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-156cf0fa-2798-42ad-ae0c-694dfe5e139e tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Router d71e624d-d858-442b-b878-577be49edd03 has already been hosted by L3 agent eaeb6875-c4ed-43b6-8658-aa4e52324fdf {{(pid=99027) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 25 17:53:17.465834 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device 32d152f0-cc43-4ae9-97e2-62ce1b0f21cf no longer exists at agent ovs-agent-dv-cinder-789564-2-iscsi {{(pid=99028) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 17:53:17.501200 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.plugin [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] No Port match for: 32d152f0-cc43-4ae9-97e2-62ce1b0f21cf {{(pid=99028) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 25 17:53:17.501639 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device 32d152f0-cc43-4ae9-97e2-62ce1b0f21cf not bound to the agent host dv-cinder-789564-2-iscsi {{(pid=99028) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 25 17:53:17.502054 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device d0e14de1-78ba-4be4-ab01-9637fae4743c no longer exists at agent ovs-agent-dv-cinder-789564-2-iscsi {{(pid=99028) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 17:53:17.520479 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-55691888-e362-4405-97f4-5703f50d23a2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1470785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-459299', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551400', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-419883'] for network, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:17.525128 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-07fdd2a5-c7b8-406a-ab3e-2c880faccdf1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:53:17.537977 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.plugin [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] No Port match for: d0e14de1-78ba-4be4-ab01-9637fae4743c {{(pid=99028) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 25 17:53:17.538346 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device d0e14de1-78ba-4be4-ab01-9637fae4743c not bound to the agent host dv-cinder-789564-2-iscsi {{(pid=99028) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 25 17:53:17.539570 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-55691888-e362-4405-97f4-5703f50d23a2 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for network, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:17.546701 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-156cf0fa-2798-42ad-ae0c-694dfe5e139e tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify agent at l3_agent.dv-cinder-789564-2-iscsi the message routers_updated {{(pid=99027) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 25 17:53:17.551977 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-156cf0fa-2798-42ad-ae0c-694dfe5e139e tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-239387'] for floatingip, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:17.560444 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6ec96e48-093e-4a0b-bb0a-76ca272f0e9a None None] Sync routers for ids ['d71e624d-d858-442b-b878-577be49edd03'] in dv-cinder-789564-2-iscsi {{(pid=99028) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 25 17:53:17.560638 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55691888-e362-4405-97f4-5703f50d23a2 admin admin] Pushing event deleted for resources: {'Network': ['ID=0c323e60-9fa9-440d-b8b6-7d4cb3856e61,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:53:17.563603 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-55691888-e362-4405-97f4-5703f50d23a2 admin admin] 10.222.0.122 "DELETE /v2.0/networks/0c323e60-9fa9-440d-b8b6-7d4cb3856e61 HTTP/1.1" status: 204  len: 168 time: 1.1827648
May 25 17:53:17.565284 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-55691888-e362-4405-97f4-5703f50d23a2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:53:17.569982 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6ec96e48-093e-4a0b-bb0a-76ca272f0e9a None None] Routers {'d71e624d-d858-442b-b878-577be49edd03'} bound to L3 agent in host dv-cinder-789564-2-iscsi {{(pid=99028) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 17:53:17.570616 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-6ec96e48-093e-4a0b-bb0a-76ca272f0e9a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcae6d2abe0>, 'dv-cinder-789564-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T17:34:21Z,description=<?>,heartbeat_timestamp=2021-05-25T17:52:51Z,host='dv-cinder-789564-2-iscsi',id=eaeb6875-c4ed-43b6-8658-aa4e52324fdf,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T17:34:21Z,topic='l3_agent')) {'router_ids': ['d71e624d-d858-442b-b878-577be49edd03'], 'active': True} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:53:17.612827 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-156cf0fa-2798-42ad-ae0c-694dfe5e139e tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] 10.222.0.122 "PUT /v2.0/floatingips/4f3dd01e-d02b-4d74-a3a3-2b672f5cc2e4 HTTP/1.1" status: 200  len: 990 time: 1.8220699
May 25 17:53:17.614305 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '13642fad-7755-444a-9c6e-d179ce91d0f4', 'tag': '0d0462ae-dc68-4a19-b6a6-bfdd10328c4c'}] {{(pid=99027) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 17:53:17.672843 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '13642fad-7755-444a-9c6e-d179ce91d0f4', 'tag': '0d0462ae-dc68-4a19-b6a6-bfdd10328c4c', 'status': 'completed', 'code': 200}
May 25 17:53:17.761393 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvr_db [None req-6ec96e48-093e-4a0b-bb0a-76ca272f0e9a None None] Set router d71e624d-d858-442b-b878-577be49edd03 gateway port host: dv-cinder-789564-2-iscsi {{(pid=99028) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 17:53:17.767998 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8029834-b3f3-4b04-b63f-6040c15c7bc9 req-6a976922-d984-4492-8677-4fed5a4b0f26 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:53:17.769567 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-c8029834-b3f3-4b04-b63f-6040c15c7bc9 req-6a976922-d984-4492-8677-4fed5a4b0f26 service neutron] 10.222.0.125 "GET /v2.0/ports?tenant_id=b4cdc54b260f4e79b87fdf4a43b12e16&device_id=13642fad-7755-444a-9c6e-d179ce91d0f4 HTTP/1.1" status: 200  len: 1098 time: 0.0766156
May 25 17:53:17.997244 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 49072) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:53:18.046514 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8029834-b3f3-4b04-b63f-6040c15c7bc9 req-d18ba0ff-d231-44f7-8d53-099275c893c8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:53:18.047974 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-c8029834-b3f3-4b04-b63f-6040c15c7bc9 req-d18ba0ff-d231-44f7-8d53-099275c893c8 service neutron] 10.222.0.125 "GET /v2.0/networks?id=defaef08-c0f9-4608-b66d-b97e06e185bf HTTP/1.1" status: 200  len: 913 time: 0.2743065
May 25 17:53:18.147604 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-d0f6885f-3e39-402c-9540-63c31ae1c9fb admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=79ce7e80f85a4c57896263e5974c8df8&name=default HTTP/1.1" status: 200  len: 2979 time: 0.1488245
May 25 17:53:18.147901 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-6ec96e48-093e-4a0b-bb0a-76ca272f0e9a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcae6d2abe0>, [{'id': 'd71e624d-d858-442b-b878-577be49edd03', 'name': 'tempest-AttachVolumeTestJSON-1986395052-router', 'tenant_id': 'b4cdc54b260f4e79b87fdf4a43b12e16', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.176'}], 'enable_snat': True}, 'gw_port_id': '9635c7b0-eb08-41ee-980e-3da56221f88d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:42:22Z', 'updated_at': '2021-05-25T17:42:34Z', 'revision_number': 4, 'project_id': 'b4cdc54b260f4e79b87fdf4a43b12e16', 'gw_port': {'id': '9635c7b0-eb08-41ee-980e-3da56221f88d', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:44:59', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd71e624d-d858-442b-b878-577be49edd03', 'device_owner': 'network:router_gateway', 'standard_attr_id': 80, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.176', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:42:23Z', 'updated_at': '2021-05-25T17:42:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi', '_floatingips': [{'id': '4f3dd01e-d02b-4d74-a3a3-2b672f5cc2e4', 'tenant_id': 'b4cdc54b260f4e79b87fdf4a43b12e16', 'floating_ip_address': '172.27.3.37', 'floating_network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'router_id': 'd71e624d-d858-442b-b878-577be49edd03', 'port_id': '0d0462ae-dc68-4a19-b6a6-bfdd10328c4c', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 515, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'defaef08-c0f9-4608-b66d-b97e06e185bf', 'mac_address': 'fa:16:3e:1b:3b:9d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '13642fad-7755-444a-9c6e-d179ce91d0f4', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T17:52:56Z', 'updated_at': '2021-05-25T17:53:16Z', 'revision_number': 1, 'project_id': 'b4cdc54b260f4e79b87fdf4a43b12e16', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'd13f3233-9e09-41c7-8315-4eae735fe605', 'name': '', 'network_id': 'defaef08-c0f9-4608-b66d-b97e06e185bf', 'tenant_id': 'b4cdc54b260f4e79b87fdf4a43b12e16', 'mac_address': 'fa:16:3e:87:b7:74', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd71e624d-d858-442b-b878-577be49edd03', 'device_owner': 'network:router_interface', 'standard_attr_id': 106, 'fixed_ips': [{'subnet_id': '5be08358-9d04-4ee9-91ac-104e66e66e20', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:42:29Z', 'updated_at': '2021-05-25T17:42:46Z', 'revision_number': 5, 'project_id': 'b4cdc54b260f4e79b87fdf4a43b12e16', 'subnets': [{'id': '5be08358-9d04-4ee9-91ac-104e66e66e20', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-789564-2-iscsi', False) {} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:53:18.149997 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 49076) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:53:18.153404 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6ec96e48-093e-4a0b-bb0a-76ca272f0e9a None None] Checking router: d71e624d-d858-442b-b878-577be49edd03 for host: dv-cinder-789564-2-iscsi {{(pid=99028) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 25 17:53:18.163918 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6ec96e48-093e-4a0b-bb0a-76ca272f0e9a None None] Routers {'d71e624d-d858-442b-b878-577be49edd03'} bound to L3 agent in host dv-cinder-789564-2-iscsi {{(pid=99028) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 17:53:18.165117 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-6ec96e48-093e-4a0b-bb0a-76ca272f0e9a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcae6d2abe0>, 'dv-cinder-789564-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T17:34:21Z,description=<?>,heartbeat_timestamp=2021-05-25T17:52:51Z,host='dv-cinder-789564-2-iscsi',id=eaeb6875-c4ed-43b6-8658-aa4e52324fdf,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T17:34:21Z,topic='l3_agent')) {'router_ids': ['d71e624d-d858-442b-b878-577be49edd03'], 'active': True} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:53:18.176332 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-c8029834-b3f3-4b04-b63f-6040c15c7bc9 req-16bad15f-26f7-43ff-a5c7-528630d14f25 service neutron] 10.222.0.125 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=0d0462ae-dc68-4a19-b6a6-bfdd10328c4c HTTP/1.1" status: 200  len: 998 time: 0.1158242
May 25 17:53:18.211380 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-eb4c9589-7466-4222-b508-1c440d9cf4c7 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:18.218930 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-fc89d2f7-8f59-4d3c-95c8-cab4432c52d0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:18.242885 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-eb4c9589-7466-4222-b508-1c440d9cf4c7 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:18.252880 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8029834-b3f3-4b04-b63f-6040c15c7bc9 req-a855e50b-3cd9-4d31-a848-2de2ee01eb9d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:53:18.254230 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-c8029834-b3f3-4b04-b63f-6040c15c7bc9 req-a855e50b-3cd9-4d31-a848-2de2ee01eb9d service neutron] 10.222.0.125 "GET /v2.0/subnets?id=5be08358-9d04-4ee9-91ac-104e66e66e20 HTTP/1.1" status: 200  len: 850 time: 0.0705943
May 25 17:53:18.339445 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8029834-b3f3-4b04-b63f-6040c15c7bc9 req-df77deec-0454-44ca-b017-4e06f4cbd3c0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:53:18.341248 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-c8029834-b3f3-4b04-b63f-6040c15c7bc9 req-df77deec-0454-44ca-b017-4e06f4cbd3c0 service neutron] 10.222.0.125 "GET /v2.0/ports?network_id=defaef08-c0f9-4608-b66d-b97e06e185bf&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0792880
May 25 17:53:18.355922 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvr_db [None req-6ec96e48-093e-4a0b-bb0a-76ca272f0e9a None None] Set router d71e624d-d858-442b-b878-577be49edd03 gateway port host: dv-cinder-789564-2-iscsi {{(pid=99028) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 17:53:18.444381 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-eb4c9589-7466-4222-b508-1c440d9cf4c7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:18.449640 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-975874a4-be18-4081-b5c9-1bb3d2736b49 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:53:18.488166 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-c8029834-b3f3-4b04-b63f-6040c15c7bc9 req-4ac40c6f-b18d-45c3-8914-768b05fa93d1 service neutron] 10.222.0.125 "GET /v2.0/networks/defaef08-c0f9-4608-b66d-b97e06e185bf?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1387355
May 25 17:53:18.575432 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb4c9589-7466-4222-b508-1c440d9cf4c7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f36e68fc-4038-4509-8aec-f49be290aa8b,revision_number=None']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:53:18.581145 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-eb4c9589-7466-4222-b508-1c440d9cf4c7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.131s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:53:18.642119 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-c8029834-b3f3-4b04-b63f-6040c15c7bc9 req-315cb745-faea-4c95-9478-392757c9506a service neutron] 10.222.0.125 "GET /v2.0/networks/defaef08-c0f9-4608-b66d-b97e06e185bf?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1452754
May 25 17:53:18.667748 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-eb4c9589-7466-4222-b508-1c440d9cf4c7 admin admin] Notify callbacks [] for security_group, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:18.668899 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-eb4c9589-7466-4222-b508-1c440d9cf4c7 admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/f36e68fc-4038-4509-8aec-f49be290aa8b HTTP/1.1" status: 204  len: 168 time: 0.5179358
May 25 17:53:18.794355 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-6ec96e48-093e-4a0b-bb0a-76ca272f0e9a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcae6d2abe0>, [{'id': 'd71e624d-d858-442b-b878-577be49edd03', 'name': 'tempest-AttachVolumeTestJSON-1986395052-router', 'tenant_id': 'b4cdc54b260f4e79b87fdf4a43b12e16', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.176'}], 'enable_snat': True}, 'gw_port_id': '9635c7b0-eb08-41ee-980e-3da56221f88d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:42:22Z', 'updated_at': '2021-05-25T17:42:34Z', 'revision_number': 4, 'project_id': 'b4cdc54b260f4e79b87fdf4a43b12e16', 'gw_port': {'id': '9635c7b0-eb08-41ee-980e-3da56221f88d', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:44:59', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd71e624d-d858-442b-b878-577be49edd03', 'device_owner': 'network:router_gateway', 'standard_attr_id': 80, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.176', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:42:23Z', 'updated_at': '2021-05-25T17:42:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi', '_floatingips': [{'id': '4f3dd01e-d02b-4d74-a3a3-2b672f5cc2e4', 'tenant_id': 'b4cdc54b260f4e79b87fdf4a43b12e16', 'floating_ip_address': '172.27.3.37', 'floating_network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'router_id': 'd71e624d-d858-442b-b878-577be49edd03', 'port_id': '0d0462ae-dc68-4a19-b6a6-bfdd10328c4c', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 515, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'defaef08-c0f9-4608-b66d-b97e06e185bf', 'mac_address': 'fa:16:3e:1b:3b:9d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '13642fad-7755-444a-9c6e-d179ce91d0f4', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T17:52:56Z', 'updated_at': '2021-05-25T17:53:16Z', 'revision_number': 1, 'project_id': 'b4cdc54b260f4e79b87fdf4a43b12e16', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'd13f3233-9e09-41c7-8315-4eae735fe605', 'name': '', 'network_id': 'defaef08-c0f9-4608-b66d-b97e06e185bf', 'tenant_id': 'b4cdc54b260f4e79b87fdf4a43b12e16', 'mac_address': 'fa:16:3e:87:b7:74', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd71e624d-d858-442b-b878-577be49edd03', 'device_owner': 'network:router_interface', 'standard_attr_id': 106, 'fixed_ips': [{'subnet_id': '5be08358-9d04-4ee9-91ac-104e66e66e20', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:42:29Z', 'updated_at': '2021-05-25T17:42:46Z', 'revision_number': 5, 'project_id': 'b4cdc54b260f4e79b87fdf4a43b12e16', 'subnets': [{'id': '5be08358-9d04-4ee9-91ac-104e66e66e20', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-789564-2-iscsi', False) {} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:53:18.799518 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6ec96e48-093e-4a0b-bb0a-76ca272f0e9a None None] The sync data for ids ['d71e624d-d858-442b-b878-577be49edd03'] in dv-cinder-789564-2-iscsi is: [{'id': 'd71e624d-d858-442b-b878-577be49edd03', 'name': 'tempest-AttachVolumeTestJSON-1986395052-router', 'tenant_id': 'b4cdc54b260f4e79b87fdf4a43b12e16', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.176'}], 'enable_snat': True}, 'gw_port_id': '9635c7b0-eb08-41ee-980e-3da56221f88d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:42:22Z', 'updated_at': '2021-05-25T17:42:34Z', 'revision_number': 4, 'project_id': 'b4cdc54b260f4e79b87fdf4a43b12e16', 'gw_port': {'id': '9635c7b0-eb08-41ee-980e-3da56221f88d', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:44:59', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd71e624d-d858-442b-b878-577be49edd03', 'device_owner': 'network:router_gateway', 'standard_attr_id': 80, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.176', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:42:23Z', 'updated_at': '2021-05-25T17:42:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi', '_floatingips': [{'id': '4f3dd01e-d02b-4d74-a3a3-2b672f5cc2e4', 'tenant_id': 'b4cdc54b260f4e79b87fdf4a43b12e16', 'floating_ip_address': '172.27.3.37', 'floating_network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'router_id': 'd71e624d-d858-442b-b878-577be49edd03', 'port_id': '0d0462ae-dc68-4a19-b6a6-bfdd10328c4c', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 515, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'defaef08-c0f9-4608-b66d-b97e06e185bf', 'mac_address': 'fa:16:3e:1b:3b:9d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '13642fad-7755-444a-9c6e-d179ce91d0f4', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T17:52:56Z', 'updated_at': '2021-05-25T17:53:16Z', 'revision_number': 1, 'project_id': 'b4cdc54b260f4e79b87fdf4a43b12e16', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'd13f3233-9e09-41c7-8315-4eae735fe605', 'name': '', 'network_id': 'defaef08-c0f9-4608-b66d-b97e06e185bf', 'tenant_id': 'b4cdc54b260f4e79b87fdf4a43b12e16', 'mac_address': 'fa:16:3e:87:b7:74', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd71e624d-d858-442b-b878-577be49edd03', 'device_owner': 'network:router_interface', 'standard_attr_id': 106, 'fixed_ips': [{'subnet_id': '5be08358-9d04-4ee9-91ac-104e66e66e20', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:42:29Z', 'updated_at': '2021-05-25T17:42:46Z', 'revision_number': 5, 'project_id': 'b4cdc54b260f4e79b87fdf4a43b12e16', 'subnets': [{'id': '5be08358-9d04-4ee9-91ac-104e66e66e20', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=99028) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 25 17:53:19.001782 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8ad802b9-fef0-40cb-a50d-5dc653185bd5 None None] New status for floating IP 4f3dd01e-d02b-4d74-a3a3-2b672f5cc2e4: ACTIVE {{(pid=99029) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 25 17:53:19.390695 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 49086) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:53:19.441856 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-3a0b118e-ca95-44ce-a124-83caf282a7b4 admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=97633fb362914841abbdf8ac783702ad&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0499406
May 25 17:53:19.453248 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 49090) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:53:19.518913 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-f936b5bb-9fe3-44d3-b21a-339891173761 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:19.544396 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-f936b5bb-9fe3-44d3-b21a-339891173761 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:19.663359 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-f936b5bb-9fe3-44d3-b21a-339891173761 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:19.669430 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-5166ae01-8b24-4c7c-90b0-f2a8d5f75247 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:53:19.683140 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f936b5bb-9fe3-44d3-b21a-339891173761 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=384beb6e-ce7f-4b38-a839-d2e81038fc88,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:53:19.686160 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-f936b5bb-9fe3-44d3-b21a-339891173761 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:53:19.689289 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-f936b5bb-9fe3-44d3-b21a-339891173761 admin admin] Notify callbacks [] for security_group, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:19.691048 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-f936b5bb-9fe3-44d3-b21a-339891173761 admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/384beb6e-ce7f-4b38-a839-d2e81038fc88 HTTP/1.1" status: 204  len: 168 time: 0.2368906
May 25 17:53:20.667347 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-3e72b2b8-2ccc-421a-a9d8-6852b1ad1609 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:20.754490 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 49116) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:53:20.855699 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:20.864599 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.v2.base [None req-5e5acf79-6380-4c55-856d-2753d3444b5f admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-236747542-network', 'tenant_id': 'b32a0178e35546828deb4b131cde3201'}} {{(pid=99026) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:53:20.869346 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-5e5acf79-6380-4c55-856d-2753d3444b5f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:53:20.873151 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-5e5acf79-6380-4c55-856d-2753d3444b5f admin admin] Usage tracker for resource:network and tenant:b32a0178e35546828deb4b131cde3201 is out of sync, need to count used quota {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:53:20.876044 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-5e5acf79-6380-4c55-856d-2753d3444b5f admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:53:20.882689 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-5e5acf79-6380-4c55-856d-2753d3444b5f admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:53:20.977683 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5e5acf79-6380-4c55-856d-2753d3444b5f admin admin] Made reservation on behalf of b32a0178e35546828deb4b131cde3201 for: {'network': 1} {{(pid=99026) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 17:53:20.980095 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-5e5acf79-6380-4c55-856d-2753d3444b5f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-1465344'] for network, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:20.993136 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-5e5acf79-6380-4c55-856d-2753d3444b5f admin admin] Notify callbacks [] for security_group, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:21.009439 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-5e5acf79-6380-4c55-856d-2753d3444b5f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:53:21.014098 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-5e5acf79-6380-4c55-856d-2753d3444b5f admin admin] Usage tracker for resource:security_group_rule and tenant:b32a0178e35546828deb4b131cde3201 is out of sync, need to count used quota {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:53:21.017017 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-5e5acf79-6380-4c55-856d-2753d3444b5f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:53:21.023040 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-5e5acf79-6380-4c55-856d-2753d3444b5f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:53:21.106297 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-5e5acf79-6380-4c55-856d-2753d3444b5f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:21.188646 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-5e5acf79-6380-4c55-856d-2753d3444b5f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:21.192478 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-236dde84-c929-4505-9df8-41f0524922b3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:53:21.222764 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-5e5acf79-6380-4c55-856d-2753d3444b5f admin admin] vlan segment allocate from pool success with {'vlan_id': 1321, 'physical_network': 'physnet1'}  {{(pid=99026) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 25 17:53:21.231521 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e5acf79-6380-4c55-856d-2753d3444b5f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8e6f725e-0056-4b9b-a856-453c550e6fb7,revision_number=1']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:53:21.235339 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-5e5acf79-6380-4c55-856d-2753d3444b5f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:53:21.238076 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-5e5acf79-6380-4c55-856d-2753d3444b5f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1469168'] for segment, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:21.238407 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.db.segments_db [None req-5e5acf79-6380-4c55-856d-2753d3444b5f admin admin] Added segment 66d2a99c-6c47-4a92-ac51-31e984766b29 of type vlan for network 0293f9ff-afda-47ba-aab9-1aac8ea6403d
May 25 17:53:21.265695 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-5e5acf79-6380-4c55-856d-2753d3444b5f admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8781840806997'] for network, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:21.365821 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-5e5acf79-6380-4c55-856d-2753d3444b5f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-459299', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551400'] for network, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:21.367070 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5e5acf79-6380-4c55-856d-2753d3444b5f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:53:21.367680 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-5e5acf79-6380-4c55-856d-2753d3444b5f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for network, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:21.371252 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-854e62fb-cdaa-403c-a14e-f1470ce7895e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:53:21.473046 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e5acf79-6380-4c55-856d-2753d3444b5f admin admin] Pushing event updated for resources: {'Network': ['ID=0293f9ff-afda-47ba-aab9-1aac8ea6403d,revision_number=1']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:53:21.475657 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-5e5acf79-6380-4c55-856d-2753d3444b5f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.104s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:53:21.482591 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Network 0293f9ff-afda-47ba-aab9-1aac8ea6403d details requested by agent ovs-agent-dv-cinder-789564-2-iscsi with host dv-cinder-789564-2-iscsi {{(pid=99028) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 25 17:53:21.532460 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-5e5acf79-6380-4c55-856d-2753d3444b5f admin admin] 10.222.0.122 "POST /v2.0/networks HTTP/1.1" status: 201  len: 882 time: 0.7766948
May 25 17:53:21.535590 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 49124) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:53:21.541295 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.v2.base [None req-31ba91b4-270a-4ff5-85fd-306cd0869807 admin admin] Request body: {'subnet': {'network_id': '0293f9ff-afda-47ba-aab9-1aac8ea6403d', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-236747542-subnet', 'tenant_id': 'b32a0178e35546828deb4b131cde3201', 'ip_version': 4}} {{(pid=99026) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:53:21.546424 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-31ba91b4-270a-4ff5-85fd-306cd0869807 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:53:21.550595 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-31ba91b4-270a-4ff5-85fd-306cd0869807 admin admin] Usage tracker for resource:subnet and tenant:b32a0178e35546828deb4b131cde3201 is out of sync, need to count used quota {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:53:21.553820 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-31ba91b4-270a-4ff5-85fd-306cd0869807 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:53:21.559601 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-31ba91b4-270a-4ff5-85fd-306cd0869807 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:53:21.653624 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-31ba91b4-270a-4ff5-85fd-306cd0869807 admin admin] Made reservation on behalf of b32a0178e35546828deb4b131cde3201 for: {'subnet': 1} {{(pid=99026) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 17:53:21.655876 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-31ba91b4-270a-4ff5-85fd-306cd0869807 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-14794261'] for subnet, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:21.771773 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-7e261f94-b84f-443e-be49-3bc1ac903b55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:22.108013 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-31ba91b4-270a-4ff5-85fd-306cd0869807 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114466', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-15477896', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-14794243'] for subnet, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:22.113413 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:53:22.192193 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31ba91b4-270a-4ff5-85fd-306cd0869807 admin admin] Pushing event updated for resources: {'Subnet': ['ID=69cd9818-8734-45ed-94ad-ee676be865a2,revision_number=0']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:53:22.195905 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-31ba91b4-270a-4ff5-85fd-306cd0869807 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:53:22.198778 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-31ba91b4-270a-4ff5-85fd-306cd0869807 admin admin] Checking segment: {'id': '66d2a99c-6c47-4a92-ac51-31e984766b29', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1321, 'network_id': '0293f9ff-afda-47ba-aab9-1aac8ea6403d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=99026) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 17:53:22.198920 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-31ba91b4-270a-4ff5-85fd-306cd0869807 admin admin] Network hostable DHCP agents. Network: 0293f9ff-afda-47ba-aab9-1aac8ea6403d, hostable agents: ['c8b0a350-254b-4562-874b-120ecdef0e25'], hosted agents: [] {{(pid=99026) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 25 17:53:22.297467 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-31ba91b4-270a-4ff5-85fd-306cd0869807 admin admin] Network 0293f9ff-afda-47ba-aab9-1aac8ea6403d is scheduled to be hosted by DHCP agent c8b0a350-254b-4562-874b-120ecdef0e25 with binding_index 1 {{(pid=99026) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 25 17:53:22.377128 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.scheduler.base_scheduler [None req-31ba91b4-270a-4ff5-85fd-306cd0869807 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-789564-2-iscsi, 0293f9ff-afda-47ba-aab9-1aac8ea6403d) {{(pid=99026) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 17:53:22.389311 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-31ba91b4-270a-4ff5-85fd-306cd0869807 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:53:22.389614 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-54a063eb-d4c9-4031-bfc2-4404620d1a0d None None] Network 0293f9ff-afda-47ba-aab9-1aac8ea6403d requested from dv-cinder-789564-2-iscsi {{(pid=99028) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 17:53:22.389908 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-31ba91b4-270a-4ff5-85fd-306cd0869807 admin admin] Notify callbacks [] for subnet, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:22.469805 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-31ba91b4-270a-4ff5-85fd-306cd0869807 admin admin] 10.222.0.122 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 844 time: 0.9331152
May 25 17:53:22.472631 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 49130) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:53:22.477963 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.v2.base [None req-12bc1c78-4e3b-4a49-a8c0-4f1c67932f9d admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-236747542-router', 'tenant_id': 'b32a0178e35546828deb4b131cde3201', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb'}}} {{(pid=99026) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:53:22.482699 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-12bc1c78-4e3b-4a49-a8c0-4f1c67932f9d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:53:22.487854 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-12bc1c78-4e3b-4a49-a8c0-4f1c67932f9d admin admin] Usage tracker for resource:router and tenant:b32a0178e35546828deb4b131cde3201 is out of sync, need to count used quota {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:53:22.490733 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-12bc1c78-4e3b-4a49-a8c0-4f1c67932f9d admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:53:22.496778 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-12bc1c78-4e3b-4a49-a8c0-4f1c67932f9d admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:53:22.571700 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-12bc1c78-4e3b-4a49-a8c0-4f1c67932f9d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-415064', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-6983'] for router, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:22.572849 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-12bc1c78-4e3b-4a49-a8c0-4f1c67932f9d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-414296', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-419975', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-491114', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-6988'] for router, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:22.588786 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-12bc1c78-4e3b-4a49-a8c0-4f1c67932f9d admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:22.614794 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1f3565c1-1d93-4062-9085-bfa0b292cffd None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpe415bc4a-81ee-5198-a7be-1f5e4adc5586-0293f9ff-afda-47ba-aab9-1aac8ea6403d', 'network_id': '0293f9ff-afda-47ba-aab9-1aac8ea6403d', 'tenant_id': 'b32a0178e35546828deb4b131cde3201', 'fixed_ips': [{'subnet_id': '69cd9818-8734-45ed-94ad-ee676be865a2'}]}} from dv-cinder-789564-2-iscsi. {{(pid=99028) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
May 25 17:53:22.615634 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-1f3565c1-1d93-4062-9085-bfa0b292cffd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_create {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:22.775382 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.db_base_plugin_common [None req-1f3565c1-1d93-4062-9085-bfa0b292cffd None None] Allocated IP 172.20.0.2 (0293f9ff-afda-47ba-aab9-1aac8ea6403d/69cd9818-8734-45ed-94ad-ee676be865a2/ab1cd90a-dd09-419b-a6d3-0042229602bc) {{(pid=99028) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 17:53:22.985232 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-1f3565c1-1d93-4062-9085-bfa0b292cffd None None] Notify callbacks [] for port, precommit_create {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:22.996104 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-1f3565c1-1d93-4062-9085-bfa0b292cffd None None] Transition to ACTIVE for port object ab1cd90a-dd09-419b-a6d3-0042229602bc will not be triggered until provisioned by entity L2. {{(pid=99028) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 17:53:23.014579 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-1f3565c1-1d93-4062-9085-bfa0b292cffd None None] Transition to ACTIVE for port object ab1cd90a-dd09-419b-a6d3-0042229602bc will not be triggered until provisioned by entity DHCP. {{(pid=99028) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 17:53:23.090742 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-12bc1c78-4e3b-4a49-a8c0-4f1c67932f9d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-420002', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-415082', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-6970'] for router, precommit_update {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:23.109385 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-1f3565c1-1d93-4062-9085-bfa0b292cffd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781840788179'] for port, after_create {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:23.114630 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-59fd63d7-e8a8-4884-b762-b9a1f7fd1111 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:53:23.178112 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1f3565c1-1d93-4062-9085-bfa0b292cffd None None] Network 0293f9ff-afda-47ba-aab9-1aac8ea6403d is already hosted by enough agents. {{(pid=99028) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 17:53:23.180997 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.scheduler.base_scheduler [None req-1f3565c1-1d93-4062-9085-bfa0b292cffd None None] Resources bound (agent type, host, resource id):  {{(pid=99028) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 17:53:23.184505 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1f3565c1-1d93-4062-9085-bfa0b292cffd None None] Received port after_create {{(pid=99028) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 17:53:23.193510 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f3565c1-1d93-4062-9085-bfa0b292cffd None None] Pushing event updated for resources: {'Port': ['ID=ab1cd90a-dd09-419b-a6d3-0042229602bc,revision_number=1']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:53:23.219692 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-1f3565c1-1d93-4062-9085-bfa0b292cffd None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.105s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:53:23.294989 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.managers [None req-1f3565c1-1d93-4062-9085-bfa0b292cffd None None] Attempting to bind port ab1cd90a-dd09-419b-a6d3-0042229602bc on host dv-cinder-789564-2-iscsi for vnic_type normal with profile  {{(pid=99028) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 17:53:23.296034 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.managers [None req-1f3565c1-1d93-4062-9085-bfa0b292cffd None None] Attempting to bind port ab1cd90a-dd09-419b-a6d3-0042229602bc by drivers openvswitch,hyperv on host dv-cinder-789564-2-iscsi at level 0 using segments [{'id': '66d2a99c-6c47-4a92-ac51-31e984766b29', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1321, 'network_id': '0293f9ff-afda-47ba-aab9-1aac8ea6403d'}] {{(pid=99028) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 17:53:23.296393 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1f3565c1-1d93-4062-9085-bfa0b292cffd None None] Attempting to bind port ab1cd90a-dd09-419b-a6d3-0042229602bc on network 0293f9ff-afda-47ba-aab9-1aac8ea6403d {{(pid=99028) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 17:53:23.302259 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1f3565c1-1d93-4062-9085-bfa0b292cffd None None] Checking agent: {'id': '7bb67520-1e97-4ad9-9b97-101068bbe1a3', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-789564-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 17, 34, 21), 'started_at': datetime.datetime(2021, 5, 25, 17, 34, 51), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 17, 53, 21), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-789564-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=99028) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 17:53:23.305675 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1f3565c1-1d93-4062-9085-bfa0b292cffd None None] Checking segment: {'id': '66d2a99c-6c47-4a92-ac51-31e984766b29', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1321, 'network_id': '0293f9ff-afda-47ba-aab9-1aac8ea6403d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=99028) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 17:53:23.305675 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-1f3565c1-1d93-4062-9085-bfa0b292cffd None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:23.305675 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1f3565c1-1d93-4062-9085-bfa0b292cffd None None] Bound using segment: {'id': '66d2a99c-6c47-4a92-ac51-31e984766b29', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1321, 'network_id': '0293f9ff-afda-47ba-aab9-1aac8ea6403d'} {{(pid=99028) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 17:53:23.305675 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.managers [None req-1f3565c1-1d93-4062-9085-bfa0b292cffd None None] Bound port: ab1cd90a-dd09-419b-a6d3-0042229602bc, host: dv-cinder-789564-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '66d2a99c-6c47-4a92-ac51-31e984766b29', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1321, 'network_id': '0293f9ff-afda-47ba-aab9-1aac8ea6403d'}}] {{(pid=99028) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 17:53:23.305675 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-1f3565c1-1d93-4062-9085-bfa0b292cffd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:23.388276 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-6df2b2a7-a54e-4d57-9be3-033078b9d5b3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:23.402750 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-1f3565c1-1d93-4062-9085-bfa0b292cffd None None] For port ab1cd90a-dd09-419b-a6d3-0042229602bc, host dv-cinder-789564-2-iscsi, cleared binding levels {{(pid=99028) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 17:53:23.405988 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-1f3565c1-1d93-4062-9085-bfa0b292cffd None None] For port ab1cd90a-dd09-419b-a6d3-0042229602bc, host dv-cinder-789564-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=ab1cd90a-dd09-419b-a6d3-0042229602bc,segment=NetworkSegment(66d2a99c-6c47-4a92-ac51-31e984766b29),segment_id=66d2a99c-6c47-4a92-ac51-31e984766b29)] {{(pid=99028) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 17:53:23.498757 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-12bc1c78-4e3b-4a49-a8c0-4f1c67932f9d admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:23.521100 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-1f3565c1-1d93-4062-9085-bfa0b292cffd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:23.525991 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-3d35ebac-72d2-4683-8434-7c10cdd203cb None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:53:23.529047 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-12bc1c78-4e3b-4a49-a8c0-4f1c67932f9d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:23.613569 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f3565c1-1d93-4062-9085-bfa0b292cffd None None] Pushing event updated for resources: {'Port': ['ID=ab1cd90a-dd09-419b-a6d3-0042229602bc,revision_number=2']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:53:23.616955 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-1f3565c1-1d93-4062-9085-bfa0b292cffd None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:53:23.678225 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.db_base_plugin_common [None req-12bc1c78-4e3b-4a49-a8c0-4f1c67932f9d admin admin] Allocated IP 172.27.3.219 (eb7ec72b-a691-481b-8d7e-42c05e13a8cb/d6898f5f-da0b-4428-97b4-4cbe3e83caaa/81c38a52-f89b-442f-a887-1536464ac16e) {{(pid=99026) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 17:53:23.848288 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-12bc1c78-4e3b-4a49-a8c0-4f1c67932f9d admin admin] Notify callbacks [] for port, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:23.949511 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-12bc1c78-4e3b-4a49-a8c0-4f1c67932f9d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781840788179', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15476536'] for port, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:23.953361 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-e339a247-5c98-4e34-8514-4785d769f78c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:53:24.014662 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-12bc1c78-4e3b-4a49-a8c0-4f1c67932f9d admin admin] Network eb7ec72b-a691-481b-8d7e-42c05e13a8cb is already hosted by enough agents. {{(pid=99026) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 17:53:24.017616 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.scheduler.base_scheduler [None req-12bc1c78-4e3b-4a49-a8c0-4f1c67932f9d admin admin] Resources bound (agent type, host, resource id):  {{(pid=99026) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 17:53:24.021468 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.l3_dvrscheduler_db [None req-12bc1c78-4e3b-4a49-a8c0-4f1c67932f9d admin admin] Received port after_create {{(pid=99026) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 17:53:24.058525 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12bc1c78-4e3b-4a49-a8c0-4f1c67932f9d admin admin] Pushing event updated for resources: {'Port': ['ID=81c38a52-f89b-442f-a887-1536464ac16e,revision_number=1']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:53:24.062601 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-12bc1c78-4e3b-4a49-a8c0-4f1c67932f9d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.109s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:53:24.447415 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-446c59d3-f865-4409-91bc-d933cfdcbc88 None None] Network 0293f9ff-afda-47ba-aab9-1aac8ea6403d requested from dv-cinder-789564-2-iscsi {{(pid=99028) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 17:53:24.614717 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-24820fb7-a8de-4411-80c8-34b655e138c5 None None] Provisioning for port ab1cd90a-dd09-419b-a6d3-0042229602bc completed by entity DHCP. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 17:53:24.644657 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-12bc1c78-4e3b-4a49-a8c0-4f1c67932f9d admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:24.991894 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-12bc1c78-4e3b-4a49-a8c0-4f1c67932f9d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-415057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-420065'] for router, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:25.272733 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-12bc1c78-4e3b-4a49-a8c0-4f1c67932f9d admin admin] Router e7c0703b-bced-4496-8da6-09afc21d0c08 is scheduled to L3 agent eaeb6875-c4ed-43b6-8658-aa4e52324fdf with binding_index 1 {{(pid=99026) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
May 25 17:53:25.456364 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-12bc1c78-4e3b-4a49-a8c0-4f1c67932f9d admin admin] Notify agent at l3_agent.dv-cinder-789564-2-iscsi the message routers_updated {{(pid=99026) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 25 17:53:25.465012 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-421e279e-3e61-4c92-801d-193c0ce4bf18 None None] Sync routers for ids ['e7c0703b-bced-4496-8da6-09afc21d0c08'] in dv-cinder-789564-2-iscsi {{(pid=99028) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 25 17:53:25.474785 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvrscheduler_db [None req-421e279e-3e61-4c92-801d-193c0ce4bf18 None None] Routers {'e7c0703b-bced-4496-8da6-09afc21d0c08'} bound to L3 agent in host dv-cinder-789564-2-iscsi {{(pid=99028) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 17:53:25.475312 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-421e279e-3e61-4c92-801d-193c0ce4bf18 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcae6e81d00>, 'dv-cinder-789564-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-25T17:34:21Z,description=<?>,heartbeat_timestamp=2021-05-25T17:53:21Z,host='dv-cinder-789564-2-iscsi',id=eaeb6875-c4ed-43b6-8658-aa4e52324fdf,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T17:34:21Z,topic='l3_agent')) {'router_ids': ['e7c0703b-bced-4496-8da6-09afc21d0c08'], 'active': True} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:53:25.543487 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-12bc1c78-4e3b-4a49-a8c0-4f1c67932f9d admin admin] Notify callbacks [] for router, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:25.547360 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-12bc1c78-4e3b-4a49-a8c0-4f1c67932f9d admin admin] 10.222.0.122 "POST /v2.0/routers HTTP/1.1" status: 201  len: 920 time: 3.0711124
May 25 17:53:25.548773 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 49140) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:53:25.567888 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device ab1cd90a-dd09-419b-a6d3-0042229602bc up at agent ovs-agent-dv-cinder-789564-2-iscsi {{(pid=99028) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 17:53:25.751639 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvr_db [None req-421e279e-3e61-4c92-801d-193c0ce4bf18 None None] Set router e7c0703b-bced-4496-8da6-09afc21d0c08 gateway port host: dv-cinder-789564-2-iscsi {{(pid=99028) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 17:53:25.853758 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Provisioning for port ab1cd90a-dd09-419b-a6d3-0042229602bc completed by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 17:53:25.882795 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Provisioning complete for port ab1cd90a-dd09-419b-a6d3-0042229602bc triggered by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 17:53:25.883175 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:26.134309 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:26.179796 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] For port ab1cd90a-dd09-419b-a6d3-0042229602bc, host dv-cinder-789564-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=ab1cd90a-dd09-419b-a6d3-0042229602bc,segment=NetworkSegment(66d2a99c-6c47-4a92-ac51-31e984766b29),segment_id=66d2a99c-6c47-4a92-ac51-31e984766b29)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:53:26.187962 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-421e279e-3e61-4c92-801d-193c0ce4bf18 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcae6e81d00>, [{'id': 'e7c0703b-bced-4496-8da6-09afc21d0c08', 'name': 'tempest-TestShelveInstance-236747542-router', 'tenant_id': 'b32a0178e35546828deb4b131cde3201', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.219'}], 'enable_snat': True}, 'gw_port_id': '81c38a52-f89b-442f-a887-1536464ac16e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:53:22Z', 'updated_at': '2021-05-25T17:53:24Z', 'revision_number': 3, 'project_id': 'b32a0178e35546828deb4b131cde3201', 'gw_port': {'id': '81c38a52-f89b-442f-a887-1536464ac16e', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:58:82:cf', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e7c0703b-bced-4496-8da6-09afc21d0c08', 'device_owner': 'network:router_gateway', 'standard_attr_id': 527, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.219', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:53:23Z', 'updated_at': '2021-05-25T17:53:23Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi'}], 'dv-cinder-789564-2-iscsi', False) {} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:53:26.192560 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-421e279e-3e61-4c92-801d-193c0ce4bf18 None None] Checking router: e7c0703b-bced-4496-8da6-09afc21d0c08 for host: dv-cinder-789564-2-iscsi {{(pid=99028) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 25 17:53:26.192919 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-421e279e-3e61-4c92-801d-193c0ce4bf18 None None] Updating router e7c0703b-bced-4496-8da6-09afc21d0c08 port 81c38a52-f89b-442f-a887-1536464ac16e binding host dv-cinder-789564-2-iscsi {{(pid=99028) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 25 17:53:26.240728 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-4042612e-03a0-46d3-85ac-bdb052b06f36 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:26.246975 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-421e279e-3e61-4c92-801d-193c0ce4bf18 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:26.276216 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:26.289646 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:53:26.421175 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Pushing event updated for resources: {'Port': ['ID=ab1cd90a-dd09-419b-a6d3-0042229602bc,revision_number=3']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:53:26.424838 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.135s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:53:26.448619 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.db_base_plugin_common [None req-4042612e-03a0-46d3-85ac-bdb052b06f36 admin admin] Allocated IP 172.20.0.1 (0293f9ff-afda-47ba-aab9-1aac8ea6403d/69cd9818-8734-45ed-94ad-ee676be865a2/d42b2822-3e3c-4030-974d-4cd1a0ba238f) {{(pid=99027) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 17:53:26.597363 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-4042612e-03a0-46d3-85ac-bdb052b06f36 admin admin] Notify callbacks [] for port, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:26.613181 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.provisioning_blocks [None req-4042612e-03a0-46d3-85ac-bdb052b06f36 admin admin] Transition to ACTIVE for port object d42b2822-3e3c-4030-974d-4cd1a0ba238f will not be triggered until provisioned by entity DHCP. {{(pid=99027) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 17:53:26.648870 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-421e279e-3e61-4c92-801d-193c0ce4bf18 None None] Notify callbacks [] for port, precommit_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:26.660300 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-421e279e-3e61-4c92-801d-193c0ce4bf18 None None] Transition to ACTIVE for port object 81c38a52-f89b-442f-a887-1536464ac16e will not be triggered until provisioned by entity L2. {{(pid=99028) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 17:53:26.715088 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-4042612e-03a0-46d3-85ac-bdb052b06f36 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781840788179', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15468986'] for port, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:26.718976 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-bb173b33-f9c4-4b17-8d72-6e9babb2e272 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:53:26.743189 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-421e279e-3e61-4c92-801d-193c0ce4bf18 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:26.749452 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-ae7b0e51-685d-4f6d-8d32-419e8bd52ea1 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:53:26.785019 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4042612e-03a0-46d3-85ac-bdb052b06f36 admin admin] Network 0293f9ff-afda-47ba-aab9-1aac8ea6403d is already hosted by enough agents. {{(pid=99027) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 17:53:26.787825 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.base_scheduler [None req-4042612e-03a0-46d3-85ac-bdb052b06f36 admin admin] Resources bound (agent type, host, resource id):  {{(pid=99027) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 17:53:26.792192 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4042612e-03a0-46d3-85ac-bdb052b06f36 admin admin] Received port after_create {{(pid=99027) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 17:53:26.828074 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4042612e-03a0-46d3-85ac-bdb052b06f36 admin admin] Pushing event updated for resources: {'Port': ['ID=d42b2822-3e3c-4030-974d-4cd1a0ba238f,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:53:26.828727 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.managers [None req-421e279e-3e61-4c92-801d-193c0ce4bf18 None None] Attempting to bind port 81c38a52-f89b-442f-a887-1536464ac16e on host dv-cinder-789564-2-iscsi for vnic_type normal with profile  {{(pid=99028) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 17:53:26.829165 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.managers [None req-421e279e-3e61-4c92-801d-193c0ce4bf18 None None] Attempting to bind port 81c38a52-f89b-442f-a887-1536464ac16e by drivers openvswitch,hyperv on host dv-cinder-789564-2-iscsi at level 0 using segments [{'id': '471771f9-c462-4865-800d-0d5029e9eb3e', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb'}] {{(pid=99028) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 17:53:26.829636 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-421e279e-3e61-4c92-801d-193c0ce4bf18 None None] Attempting to bind port 81c38a52-f89b-442f-a887-1536464ac16e on network eb7ec72b-a691-481b-8d7e-42c05e13a8cb {{(pid=99028) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 17:53:26.833547 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d16f39f4-30fc-4b2c-8411-64bb4bf9e96e None None] Pushing event updated for resources: {'Port': ['ID=81c38a52-f89b-442f-a887-1536464ac16e,revision_number=2']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:53:26.836329 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-d16f39f4-30fc-4b2c-8411-64bb4bf9e96e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:53:26.841167 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-421e279e-3e61-4c92-801d-193c0ce4bf18 None None] Checking agent: {'id': '7bb67520-1e97-4ad9-9b97-101068bbe1a3', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-789564-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 17, 34, 21), 'started_at': datetime.datetime(2021, 5, 25, 17, 34, 51), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 17, 53, 21), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-789564-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=99028) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 17:53:26.841526 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-421e279e-3e61-4c92-801d-193c0ce4bf18 None None] Checking segment: {'id': '471771f9-c462-4865-800d-0d5029e9eb3e', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=99028) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 17:53:26.841940 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-421e279e-3e61-4c92-801d-193c0ce4bf18 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:26.842331 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-421e279e-3e61-4c92-801d-193c0ce4bf18 None None] Bound using segment: {'id': '471771f9-c462-4865-800d-0d5029e9eb3e', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb'} {{(pid=99028) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 17:53:26.842802 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.managers [None req-421e279e-3e61-4c92-801d-193c0ce4bf18 None None] Bound port: 81c38a52-f89b-442f-a887-1536464ac16e, host: dv-cinder-789564-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '471771f9-c462-4865-800d-0d5029e9eb3e', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb'}}] {{(pid=99028) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 17:53:26.843181 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-421e279e-3e61-4c92-801d-193c0ce4bf18 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:26.849525 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-4042612e-03a0-46d3-85ac-bdb052b06f36 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.130s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:53:26.852531 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-4042612e-03a0-46d3-85ac-bdb052b06f36 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-421008'] for router_interface, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:26.927163 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-421e279e-3e61-4c92-801d-193c0ce4bf18 None None] For port 81c38a52-f89b-442f-a887-1536464ac16e, host dv-cinder-789564-2-iscsi, cleared binding levels {{(pid=99028) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 17:53:26.930569 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-421e279e-3e61-4c92-801d-193c0ce4bf18 None None] For port 81c38a52-f89b-442f-a887-1536464ac16e, host dv-cinder-789564-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=81c38a52-f89b-442f-a887-1536464ac16e,segment=NetworkSegment(471771f9-c462-4865-800d-0d5029e9eb3e),segment_id=471771f9-c462-4865-800d-0d5029e9eb3e)] {{(pid=99028) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 17:53:27.023569 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-421e279e-3e61-4c92-801d-193c0ce4bf18 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:27.027158 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:53:27.075672 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-0a3c964d-9dd9-4263-9b1e-44f37070417d None None] Provisioning for port d42b2822-3e3c-4030-974d-4cd1a0ba238f completed by entity DHCP. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 17:53:27.091791 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-0a3c964d-9dd9-4263-9b1e-44f37070417d None None] Provisioning complete for port d42b2822-3e3c-4030-974d-4cd1a0ba238f triggered by entity DHCP. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 17:53:27.092168 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-0a3c964d-9dd9-4263-9b1e-44f37070417d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:27.152320 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvrscheduler_db [None req-421e279e-3e61-4c92-801d-193c0ce4bf18 None None] Routers {'e7c0703b-bced-4496-8da6-09afc21d0c08'} bound to L3 agent in host dv-cinder-789564-2-iscsi {{(pid=99028) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 17:53:27.152963 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-421e279e-3e61-4c92-801d-193c0ce4bf18 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcae6e81d00>, 'dv-cinder-789564-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-25T17:34:21Z,description=<?>,heartbeat_timestamp=2021-05-25T17:53:21Z,host='dv-cinder-789564-2-iscsi',id=eaeb6875-c4ed-43b6-8658-aa4e52324fdf,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T17:34:21Z,topic='l3_agent')) {'router_ids': ['e7c0703b-bced-4496-8da6-09afc21d0c08'], 'active': True} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:53:27.222320 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d16f39f4-30fc-4b2c-8411-64bb4bf9e96e None None] Pushing event updated for resources: {'Port': ['ID=81c38a52-f89b-442f-a887-1536464ac16e,revision_number=3']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:53:27.237976 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-d16f39f4-30fc-4b2c-8411-64bb4bf9e96e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.211s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:53:27.242118 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.plugin [None req-0a3c964d-9dd9-4263-9b1e-44f37070417d None None] Port d42b2822-3e3c-4030-974d-4cd1a0ba238f cannot update to ACTIVE because it is not bound. {{(pid=99028) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 25 17:53:27.306942 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-4042612e-03a0-46d3-85ac-bdb052b06f36 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:27.391412 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvr_db [None req-421e279e-3e61-4c92-801d-193c0ce4bf18 None None] Set router e7c0703b-bced-4496-8da6-09afc21d0c08 gateway port host: dv-cinder-789564-2-iscsi {{(pid=99028) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 17:53:27.524906 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device ab1cd90a-dd09-419b-a6d3-0042229602bc up at agent ovs-agent-dv-cinder-789564-2-iscsi {{(pid=99028) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 17:53:27.547599 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-4042612e-03a0-46d3-85ac-bdb052b06f36 admin admin] Notify callbacks [] for port, precommit_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:27.611937 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-4042612e-03a0-46d3-85ac-bdb052b06f36 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15468979'] for port, after_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:27.636994 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-d6f6e584-b7af-4130-b297-831ae646f5f8 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:53:27.711227 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Provisioning complete for port ab1cd90a-dd09-419b-a6d3-0042229602bc triggered by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 17:53:27.711808 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:27.723070 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-4042612e-03a0-46d3-85ac-bdb052b06f36 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-549394', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-420925'] for router_interface, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:27.726606 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4042612e-03a0-46d3-85ac-bdb052b06f36 admin admin] Pushing event updated for resources: {'Port': ['ID=d42b2822-3e3c-4030-974d-4cd1a0ba238f,revision_number=2']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:53:27.729941 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-4042612e-03a0-46d3-85ac-bdb052b06f36 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.093s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:53:27.884701 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4042612e-03a0-46d3-85ac-bdb052b06f36 admin admin] Network 0293f9ff-afda-47ba-aab9-1aac8ea6403d is already hosted by enough agents. {{(pid=99027) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 17:53:27.885972 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.base_scheduler [None req-4042612e-03a0-46d3-85ac-bdb052b06f36 admin admin] Resources bound (agent type, host, resource id):  {{(pid=99027) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 17:53:27.932199 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-421e279e-3e61-4c92-801d-193c0ce4bf18 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcae6e81d00>, [{'id': 'e7c0703b-bced-4496-8da6-09afc21d0c08', 'name': 'tempest-TestShelveInstance-236747542-router', 'tenant_id': 'b32a0178e35546828deb4b131cde3201', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.219'}], 'enable_snat': True}, 'gw_port_id': '81c38a52-f89b-442f-a887-1536464ac16e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:53:22Z', 'updated_at': '2021-05-25T17:53:27Z', 'revision_number': 4, 'project_id': 'b32a0178e35546828deb4b131cde3201', 'gw_port': {'id': '81c38a52-f89b-442f-a887-1536464ac16e', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:58:82:cf', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e7c0703b-bced-4496-8da6-09afc21d0c08', 'device_owner': 'network:router_gateway', 'standard_attr_id': 527, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.219', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:53:23Z', 'updated_at': '2021-05-25T17:53:26Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi', '_interfaces': [{'id': 'd42b2822-3e3c-4030-974d-4cd1a0ba238f', 'name': '', 'network_id': '0293f9ff-afda-47ba-aab9-1aac8ea6403d', 'tenant_id': 'b32a0178e35546828deb4b131cde3201', 'mac_address': 'fa:16:3e:99:2a:b9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e7c0703b-bced-4496-8da6-09afc21d0c08', 'device_owner': 'network:router_interface', 'standard_attr_id': 528, 'fixed_ips': [{'subnet_id': '69cd9818-8734-45ed-94ad-ee676be865a2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:53:26Z', 'updated_at': '2021-05-25T17:53:26Z', 'revision_number': 1, 'project_id': 'b32a0178e35546828deb4b131cde3201', 'subnets': [{'id': '69cd9818-8734-45ed-94ad-ee676be865a2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-789564-2-iscsi', False) {} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:53:27.937501 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-421e279e-3e61-4c92-801d-193c0ce4bf18 None None] The sync data for ids ['e7c0703b-bced-4496-8da6-09afc21d0c08'] in dv-cinder-789564-2-iscsi is: [{'id': 'e7c0703b-bced-4496-8da6-09afc21d0c08', 'name': 'tempest-TestShelveInstance-236747542-router', 'tenant_id': 'b32a0178e35546828deb4b131cde3201', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.219'}], 'enable_snat': True}, 'gw_port_id': '81c38a52-f89b-442f-a887-1536464ac16e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:53:22Z', 'updated_at': '2021-05-25T17:53:27Z', 'revision_number': 4, 'project_id': 'b32a0178e35546828deb4b131cde3201', 'gw_port': {'id': '81c38a52-f89b-442f-a887-1536464ac16e', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:58:82:cf', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e7c0703b-bced-4496-8da6-09afc21d0c08', 'device_owner': 'network:router_gateway', 'standard_attr_id': 527, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.219', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:53:23Z', 'updated_at': '2021-05-25T17:53:26Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi', '_interfaces': [{'id': 'd42b2822-3e3c-4030-974d-4cd1a0ba238f', 'name': '', 'network_id': '0293f9ff-afda-47ba-aab9-1aac8ea6403d', 'tenant_id': 'b32a0178e35546828deb4b131cde3201', 'mac_address': 'fa:16:3e:99:2a:b9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e7c0703b-bced-4496-8da6-09afc21d0c08', 'device_owner': 'network:router_interface', 'standard_attr_id': 528, 'fixed_ips': [{'subnet_id': '69cd9818-8734-45ed-94ad-ee676be865a2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:53:26Z', 'updated_at': '2021-05-25T17:53:26Z', 'revision_number': 1, 'project_id': 'b32a0178e35546828deb4b131cde3201', 'subnets': [{'id': '69cd9818-8734-45ed-94ad-ee676be865a2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=99028) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 25 17:53:28.099311 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4042612e-03a0-46d3-85ac-bdb052b06f36 admin admin] Router e7c0703b-bced-4496-8da6-09afc21d0c08 has already been hosted by L3 agent eaeb6875-c4ed-43b6-8658-aa4e52324fdf {{(pid=99027) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 25 17:53:28.181731 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-f2f7f42e-fcab-41c9-8288-9363f735feb7 None None] Provisioning complete for port d42b2822-3e3c-4030-974d-4cd1a0ba238f triggered by entity DHCP. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 17:53:28.182115 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-f2f7f42e-fcab-41c9-8288-9363f735feb7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:28.246298 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.plugin [None req-f2f7f42e-fcab-41c9-8288-9363f735feb7 None None] Port d42b2822-3e3c-4030-974d-4cd1a0ba238f cannot update to ACTIVE because it is not bound. {{(pid=99028) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 25 17:53:28.326149 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4042612e-03a0-46d3-85ac-bdb052b06f36 admin admin] Notify agent at l3_agent.dv-cinder-789564-2-iscsi the message routers_updated {{(pid=99027) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 25 17:53:28.336020 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-4042612e-03a0-46d3-85ac-bdb052b06f36 admin admin] 10.222.0.122 "PUT /v2.0/routers/e7c0703b-bced-4496-8da6-09afc21d0c08/add_router_interface HTTP/1.1" status: 200  len: 503 time: 2.7853682
May 25 17:53:29.114272 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 49166) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:53:29.120343 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.v2.base [None req-d0435101-67d6-459b-9f6a-99961701b86b admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-2008156234-network', 'tenant_id': 'd440d92738fa475c889c19df3d828036'}} {{(pid=99027) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:53:29.125479 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-d0435101-67d6-459b-9f6a-99961701b86b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:53:29.130204 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-d0435101-67d6-459b-9f6a-99961701b86b admin admin] Usage tracker for resource:network and tenant:d440d92738fa475c889c19df3d828036 is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:53:29.133060 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-d0435101-67d6-459b-9f6a-99961701b86b admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:53:29.139856 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-d0435101-67d6-459b-9f6a-99961701b86b admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:53:29.211935 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d0435101-67d6-459b-9f6a-99961701b86b admin admin] Made reservation on behalf of d440d92738fa475c889c19df3d828036 for: {'network': 1} {{(pid=99027) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 17:53:29.214367 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-d0435101-67d6-459b-9f6a-99961701b86b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-1465344'] for network, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:29.226897 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-d0435101-67d6-459b-9f6a-99961701b86b admin admin] Notify callbacks [] for security_group, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:29.242327 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-d0435101-67d6-459b-9f6a-99961701b86b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:53:29.246198 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-d0435101-67d6-459b-9f6a-99961701b86b admin admin] Usage tracker for resource:security_group_rule and tenant:d440d92738fa475c889c19df3d828036 is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:53:29.248988 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-d0435101-67d6-459b-9f6a-99961701b86b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:53:29.256015 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-d0435101-67d6-459b-9f6a-99961701b86b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:53:29.337252 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-d0435101-67d6-459b-9f6a-99961701b86b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:29.406228 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-d0435101-67d6-459b-9f6a-99961701b86b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:29.409363 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-d1e8200b-a884-47b8-994c-4e18939112f3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:53:29.444187 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d0435101-67d6-459b-9f6a-99961701b86b admin admin] vlan segment allocate from pool success with {'vlan_id': 1320, 'physical_network': 'physnet1'}  {{(pid=99027) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 25 17:53:29.449675 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0435101-67d6-459b-9f6a-99961701b86b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e50b3a44-5660-4014-aa76-544a66134be5,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:53:29.452995 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-d0435101-67d6-459b-9f6a-99961701b86b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:53:29.459070 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-d0435101-67d6-459b-9f6a-99961701b86b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1469168'] for segment, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:29.459416 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.db.segments_db [None req-d0435101-67d6-459b-9f6a-99961701b86b admin admin] Added segment 25860488-309b-44b3-a089-322389b1576c of type vlan for network 137490af-32dc-4466-832c-959b96aa867d
May 25 17:53:29.488110 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-d0435101-67d6-459b-9f6a-99961701b86b admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8781840806997'] for network, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:29.506673 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device 81c38a52-f89b-442f-a887-1536464ac16e up at agent ovs-agent-dv-cinder-789564-2-iscsi {{(pid=99028) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 17:53:29.572181 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-d0435101-67d6-459b-9f6a-99961701b86b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-459299', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551400'] for network, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:29.573763 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d0435101-67d6-459b-9f6a-99961701b86b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:53:29.574130 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-d0435101-67d6-459b-9f6a-99961701b86b admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for network, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:29.579130 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-e6f4e897-3d60-4a0a-b6f0-c79a838deaf6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:53:29.650126 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Provisioning for port 81c38a52-f89b-442f-a887-1536464ac16e completed by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 17:53:29.655097 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Provisioning complete for port 81c38a52-f89b-442f-a887-1536464ac16e triggered by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 17:53:29.655478 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:29.681263 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0435101-67d6-459b-9f6a-99961701b86b admin admin] Pushing event updated for resources: {'Network': ['ID=137490af-32dc-4466-832c-959b96aa867d,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:53:29.683984 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-d0435101-67d6-459b-9f6a-99961701b86b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.105s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:53:29.699887 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Network 137490af-32dc-4466-832c-959b96aa867d details requested by agent ovs-agent-dv-cinder-789564-2-iscsi with host dv-cinder-789564-2-iscsi {{(pid=99028) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 25 17:53:29.740018 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-d0435101-67d6-459b-9f6a-99961701b86b admin admin] 10.222.0.122 "POST /v2.0/networks HTTP/1.1" status: 201  len: 883 time: 0.6212432
May 25 17:53:29.745725 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 49170) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:53:29.746651 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.v2.base [None req-ca8088f3-9908-461b-af3a-96295adb1c71 admin admin] Request body: {'subnet': {'network_id': '137490af-32dc-4466-832c-959b96aa867d', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-2008156234-subnet', 'tenant_id': 'd440d92738fa475c889c19df3d828036', 'ip_version': 4}} {{(pid=99027) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:53:29.752105 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-ca8088f3-9908-461b-af3a-96295adb1c71 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:53:29.756529 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-ca8088f3-9908-461b-af3a-96295adb1c71 admin admin] Usage tracker for resource:subnet and tenant:d440d92738fa475c889c19df3d828036 is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:53:29.759522 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-ca8088f3-9908-461b-af3a-96295adb1c71 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:53:29.765334 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-ca8088f3-9908-461b-af3a-96295adb1c71 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:53:29.832579 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ca8088f3-9908-461b-af3a-96295adb1c71 admin admin] Made reservation on behalf of d440d92738fa475c889c19df3d828036 for: {'subnet': 1} {{(pid=99027) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 17:53:29.835180 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-ca8088f3-9908-461b-af3a-96295adb1c71 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-14778112'] for subnet, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:29.876395 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:29.895881 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] For port 81c38a52-f89b-442f-a887-1536464ac16e, host dv-cinder-789564-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=81c38a52-f89b-442f-a887-1536464ac16e,segment=NetworkSegment(471771f9-c462-4865-800d-0d5029e9eb3e),segment_id=471771f9-c462-4865-800d-0d5029e9eb3e)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:53:29.916919 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0353c4fe-b0bd-4ace-995f-5d1d7243c8e9 None None] Sync routers for ids ['e7c0703b-bced-4496-8da6-09afc21d0c08'] in dv-cinder-789564-2-iscsi {{(pid=99029) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 25 17:53:29.927726 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0353c4fe-b0bd-4ace-995f-5d1d7243c8e9 None None] Routers {'e7c0703b-bced-4496-8da6-09afc21d0c08'} bound to L3 agent in host dv-cinder-789564-2-iscsi {{(pid=99029) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 17:53:29.928263 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_hamode_db [None req-0353c4fe-b0bd-4ace-995f-5d1d7243c8e9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcae850c280>, 'dv-cinder-789564-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-25T17:34:21Z,description=<?>,heartbeat_timestamp=2021-05-25T17:53:21Z,host='dv-cinder-789564-2-iscsi',id=eaeb6875-c4ed-43b6-8658-aa4e52324fdf,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T17:34:21Z,topic='l3_agent')) {'router_ids': ['e7c0703b-bced-4496-8da6-09afc21d0c08'], 'active': True} {{(pid=99029) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:53:29.970258 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:29.973452 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:53:30.064218 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Pushing event updated for resources: {'Port': ['ID=81c38a52-f89b-442f-a887-1536464ac16e,revision_number=4']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:53:30.069681 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.096s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:53:30.160718 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_dvr_db [None req-0353c4fe-b0bd-4ace-995f-5d1d7243c8e9 None None] Set router e7c0703b-bced-4496-8da6-09afc21d0c08 gateway port host: dv-cinder-789564-2-iscsi {{(pid=99029) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 17:53:30.403608 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-ca8088f3-9908-461b-af3a-96295adb1c71 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114466', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-15467018', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-14778134'] for subnet, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:30.408420 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-63c29d22-0e4f-4fa1-b319-ae8c2ce3a93b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:53:30.481967 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca8088f3-9908-461b-af3a-96295adb1c71 admin admin] Pushing event updated for resources: {'Subnet': ['ID=fefe3428-f312-48c3-a442-12fb15c37143,revision_number=0']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:53:30.485486 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-ca8088f3-9908-461b-af3a-96295adb1c71 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:53:30.491514 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ca8088f3-9908-461b-af3a-96295adb1c71 admin admin] Checking segment: {'id': '25860488-309b-44b3-a089-322389b1576c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1320, 'network_id': '137490af-32dc-4466-832c-959b96aa867d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=99027) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 17:53:30.491864 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ca8088f3-9908-461b-af3a-96295adb1c71 admin admin] Network hostable DHCP agents. Network: 137490af-32dc-4466-832c-959b96aa867d, hostable agents: ['c8b0a350-254b-4562-874b-120ecdef0e25'], hosted agents: [] {{(pid=99027) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 25 17:53:30.495131 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_hamode_db [None req-0353c4fe-b0bd-4ace-995f-5d1d7243c8e9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcae850c280>, [{'id': 'e7c0703b-bced-4496-8da6-09afc21d0c08', 'name': 'tempest-TestShelveInstance-236747542-router', 'tenant_id': 'b32a0178e35546828deb4b131cde3201', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.219'}], 'enable_snat': True}, 'gw_port_id': '81c38a52-f89b-442f-a887-1536464ac16e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:53:22Z', 'updated_at': '2021-05-25T17:53:27Z', 'revision_number': 4, 'project_id': 'b32a0178e35546828deb4b131cde3201', 'gw_port': {'id': '81c38a52-f89b-442f-a887-1536464ac16e', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:58:82:cf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e7c0703b-bced-4496-8da6-09afc21d0c08', 'device_owner': 'network:router_gateway', 'standard_attr_id': 527, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.219', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:53:23Z', 'updated_at': '2021-05-25T17:53:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi', '_interfaces': [{'id': 'd42b2822-3e3c-4030-974d-4cd1a0ba238f', 'name': '', 'network_id': '0293f9ff-afda-47ba-aab9-1aac8ea6403d', 'tenant_id': 'b32a0178e35546828deb4b131cde3201', 'mac_address': 'fa:16:3e:99:2a:b9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e7c0703b-bced-4496-8da6-09afc21d0c08', 'device_owner': 'network:router_interface', 'standard_attr_id': 528, 'fixed_ips': [{'subnet_id': '69cd9818-8734-45ed-94ad-ee676be865a2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:53:26Z', 'updated_at': '2021-05-25T17:53:27Z', 'revision_number': 2, 'project_id': 'b32a0178e35546828deb4b131cde3201', 'subnets': [{'id': '69cd9818-8734-45ed-94ad-ee676be865a2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-789564-2-iscsi', False) {} {{(pid=99029) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:53:30.499080 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0353c4fe-b0bd-4ace-995f-5d1d7243c8e9 None None] Checking router: e7c0703b-bced-4496-8da6-09afc21d0c08 for host: dv-cinder-789564-2-iscsi {{(pid=99029) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 25 17:53:30.499438 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0353c4fe-b0bd-4ace-995f-5d1d7243c8e9 None None] Updating router e7c0703b-bced-4496-8da6-09afc21d0c08 port d42b2822-3e3c-4030-974d-4cd1a0ba238f binding host dv-cinder-789564-2-iscsi {{(pid=99029) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 25 17:53:30.554685 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron_lib.callbacks.manager [None req-0353c4fe-b0bd-4ace-995f-5d1d7243c8e9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99029) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:30.566513 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ca8088f3-9908-461b-af3a-96295adb1c71 admin admin] Network 137490af-32dc-4466-832c-959b96aa867d is scheduled to be hosted by DHCP agent c8b0a350-254b-4562-874b-120ecdef0e25 with binding_index 1 {{(pid=99027) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 25 17:53:30.623176 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.base_scheduler [None req-ca8088f3-9908-461b-af3a-96295adb1c71 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-789564-2-iscsi, 137490af-32dc-4466-832c-959b96aa867d) {{(pid=99027) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 17:53:30.633933 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ecfbd8ab-84bf-42d3-a4d3-aa88bcf80897 None None] Network 137490af-32dc-4466-832c-959b96aa867d requested from dv-cinder-789564-2-iscsi {{(pid=99028) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 17:53:30.635326 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ca8088f3-9908-461b-af3a-96295adb1c71 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:53:30.635919 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-ca8088f3-9908-461b-af3a-96295adb1c71 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for subnet, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:30.747552 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-ca8088f3-9908-461b-af3a-96295adb1c71 admin admin] 10.222.0.122 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 845 time: 1.0060313
May 25 17:53:30.750285 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 49176) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:53:30.756159 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.v2.base [None req-38600a04-fa8b-4001-b06f-cdfb1faafd11 admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-2008156234-router', 'tenant_id': 'd440d92738fa475c889c19df3d828036', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb'}}} {{(pid=99027) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:53:30.761053 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-38600a04-fa8b-4001-b06f-cdfb1faafd11 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:53:30.765163 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-38600a04-fa8b-4001-b06f-cdfb1faafd11 admin admin] Usage tracker for resource:router and tenant:d440d92738fa475c889c19df3d828036 is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:53:30.768943 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-38600a04-fa8b-4001-b06f-cdfb1faafd11 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:53:30.775384 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-38600a04-fa8b-4001-b06f-cdfb1faafd11 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:53:30.857625 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-38600a04-fa8b-4001-b06f-cdfb1faafd11 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-415064', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-6983'] for router, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:30.859149 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-38600a04-fa8b-4001-b06f-cdfb1faafd11 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-414296', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-419975', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-491114', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-6988'] for router, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:30.866262 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2cccbc58-093b-4648-a206-1e82bc09d06a None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpe415bc4a-81ee-5198-a7be-1f5e4adc5586-137490af-32dc-4466-832c-959b96aa867d', 'network_id': '137490af-32dc-4466-832c-959b96aa867d', 'tenant_id': 'd440d92738fa475c889c19df3d828036', 'fixed_ips': [{'subnet_id': 'fefe3428-f312-48c3-a442-12fb15c37143'}]}} from dv-cinder-789564-2-iscsi. {{(pid=99028) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
May 25 17:53:30.866987 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-2cccbc58-093b-4648-a206-1e82bc09d06a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_create {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:30.879913 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-38600a04-fa8b-4001-b06f-cdfb1faafd11 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:30.915240 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron_lib.callbacks.manager [None req-0353c4fe-b0bd-4ace-995f-5d1d7243c8e9 None None] Notify callbacks [] for port, precommit_update {{(pid=99029) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:30.927496 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.provisioning_blocks [None req-0353c4fe-b0bd-4ace-995f-5d1d7243c8e9 None None] Transition to ACTIVE for port object d42b2822-3e3c-4030-974d-4cd1a0ba238f will not be triggered until provisioned by entity L2. {{(pid=99029) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 17:53:31.004343 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron_lib.callbacks.manager [None req-0353c4fe-b0bd-4ace-995f-5d1d7243c8e9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99029) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:31.009648 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:53:31.039010 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.db_base_plugin_common [None req-2cccbc58-093b-4648-a206-1e82bc09d06a None None] Allocated IP 172.20.0.2 (137490af-32dc-4466-832c-959b96aa867d/fefe3428-f312-48c3-a442-12fb15c37143/67cb78bc-708f-450f-9e19-ef7b06a381d0) {{(pid=99028) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 17:53:31.128230 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e74fd6bf-e9c9-404e-a99f-b72ef91b7147 None None] Pushing event updated for resources: {'Port': ['ID=d42b2822-3e3c-4030-974d-4cd1a0ba238f,revision_number=3']} {{(pid=99029) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:53:31.143631 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e74fd6bf-e9c9-404e-a99f-b72ef91b7147 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99029) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:53:31.144265 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e74fd6bf-e9c9-404e-a99f-b72ef91b7147 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99029) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:53:31.144774 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e74fd6bf-e9c9-404e-a99f-b72ef91b7147 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99029) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:53:31.145283 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e74fd6bf-e9c9-404e-a99f-b72ef91b7147 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99029) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:53:31.145778 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e74fd6bf-e9c9-404e-a99f-b72ef91b7147 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99029) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:53:31.146519 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e74fd6bf-e9c9-404e-a99f-b72ef91b7147 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99029) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:53:31.146727 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e74fd6bf-e9c9-404e-a99f-b72ef91b7147 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99029) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:53:31.147057 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e74fd6bf-e9c9-404e-a99f-b72ef91b7147 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99029) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:53:31.147403 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e74fd6bf-e9c9-404e-a99f-b72ef91b7147 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99029) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:53:31.147733 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e74fd6bf-e9c9-404e-a99f-b72ef91b7147 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99029) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:53:31.148051 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e74fd6bf-e9c9-404e-a99f-b72ef91b7147 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99029) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:53:31.148372 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e74fd6bf-e9c9-404e-a99f-b72ef91b7147 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99029) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:53:31.152274 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG oslo_concurrency.lockutils [None req-e74fd6bf-e9c9-404e-a99f-b72ef91b7147 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.143s {{(pid=99029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:53:31.295855 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.plugins.ml2.managers [None req-0353c4fe-b0bd-4ace-995f-5d1d7243c8e9 None None] Attempting to bind port d42b2822-3e3c-4030-974d-4cd1a0ba238f on host dv-cinder-789564-2-iscsi for vnic_type normal with profile  {{(pid=99029) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 17:53:31.296369 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.plugins.ml2.managers [None req-0353c4fe-b0bd-4ace-995f-5d1d7243c8e9 None None] Attempting to bind port d42b2822-3e3c-4030-974d-4cd1a0ba238f by drivers openvswitch,hyperv on host dv-cinder-789564-2-iscsi at level 0 using segments [{'id': '66d2a99c-6c47-4a92-ac51-31e984766b29', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1321, 'network_id': '0293f9ff-afda-47ba-aab9-1aac8ea6403d'}] {{(pid=99029) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 17:53:31.296823 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0353c4fe-b0bd-4ace-995f-5d1d7243c8e9 None None] Attempting to bind port d42b2822-3e3c-4030-974d-4cd1a0ba238f on network 0293f9ff-afda-47ba-aab9-1aac8ea6403d {{(pid=99029) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 17:53:31.303654 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0353c4fe-b0bd-4ace-995f-5d1d7243c8e9 None None] Checking agent: {'id': '7bb67520-1e97-4ad9-9b97-101068bbe1a3', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-789564-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 17, 34, 21), 'started_at': datetime.datetime(2021, 5, 25, 17, 34, 51), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 17, 53, 21), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-789564-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=99029) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 17:53:31.304432 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0353c4fe-b0bd-4ace-995f-5d1d7243c8e9 None None] Checking segment: {'id': '66d2a99c-6c47-4a92-ac51-31e984766b29', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1321, 'network_id': '0293f9ff-afda-47ba-aab9-1aac8ea6403d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=99029) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 17:53:31.305047 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron_lib.callbacks.manager [None req-0353c4fe-b0bd-4ace-995f-5d1d7243c8e9 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=99029) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:31.305709 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0353c4fe-b0bd-4ace-995f-5d1d7243c8e9 None None] Bound using segment: {'id': '66d2a99c-6c47-4a92-ac51-31e984766b29', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1321, 'network_id': '0293f9ff-afda-47ba-aab9-1aac8ea6403d'} {{(pid=99029) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 17:53:31.306796 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.plugins.ml2.managers [None req-0353c4fe-b0bd-4ace-995f-5d1d7243c8e9 None None] Bound port: d42b2822-3e3c-4030-974d-4cd1a0ba238f, host: dv-cinder-789564-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '66d2a99c-6c47-4a92-ac51-31e984766b29', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1321, 'network_id': '0293f9ff-afda-47ba-aab9-1aac8ea6403d'}}] {{(pid=99029) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 17:53:31.307409 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron_lib.callbacks.manager [None req-0353c4fe-b0bd-4ace-995f-5d1d7243c8e9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99029) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:31.336729 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-38600a04-fa8b-4001-b06f-cdfb1faafd11 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-420002', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-415082', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-6970'] for router, precommit_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:31.414072 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-2cccbc58-093b-4648-a206-1e82bc09d06a None None] Notify callbacks [] for port, precommit_create {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:31.418070 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.plugins.ml2.db [None req-0353c4fe-b0bd-4ace-995f-5d1d7243c8e9 None None] For port d42b2822-3e3c-4030-974d-4cd1a0ba238f, host dv-cinder-789564-2-iscsi, cleared binding levels {{(pid=99029) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 17:53:31.422160 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.plugins.ml2.db [None req-0353c4fe-b0bd-4ace-995f-5d1d7243c8e9 None None] For port d42b2822-3e3c-4030-974d-4cd1a0ba238f, host dv-cinder-789564-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=d42b2822-3e3c-4030-974d-4cd1a0ba238f,segment=NetworkSegment(66d2a99c-6c47-4a92-ac51-31e984766b29),segment_id=66d2a99c-6c47-4a92-ac51-31e984766b29)] {{(pid=99029) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 17:53:31.439079 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-2cccbc58-093b-4648-a206-1e82bc09d06a None None] Transition to ACTIVE for port object 67cb78bc-708f-450f-9e19-ef7b06a381d0 will not be triggered until provisioned by entity L2. {{(pid=99028) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 17:53:31.461170 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-2cccbc58-093b-4648-a206-1e82bc09d06a None None] Transition to ACTIVE for port object 67cb78bc-708f-450f-9e19-ef7b06a381d0 will not be triggered until provisioned by entity DHCP. {{(pid=99028) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 17:53:31.487701 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device 81c38a52-f89b-442f-a887-1536464ac16e up at agent ovs-agent-dv-cinder-789564-2-iscsi {{(pid=99028) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 17:53:31.491950 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron_lib.callbacks.manager [None req-0353c4fe-b0bd-4ace-995f-5d1d7243c8e9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99029) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:31.497227 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:53:31.552283 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-2cccbc58-093b-4648-a206-1e82bc09d06a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781840788179'] for port, after_create {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:31.557647 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:53:31.586404 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e74fd6bf-e9c9-404e-a99f-b72ef91b7147 None None] Pushing event updated for resources: {'Port': ['ID=d42b2822-3e3c-4030-974d-4cd1a0ba238f,revision_number=4']} {{(pid=99029) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:53:31.590350 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG oslo_concurrency.lockutils [None req-e74fd6bf-e9c9-404e-a99f-b72ef91b7147 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.093s {{(pid=99029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:53:31.592071 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0353c4fe-b0bd-4ace-995f-5d1d7243c8e9 None None] Routers {'e7c0703b-bced-4496-8da6-09afc21d0c08'} bound to L3 agent in host dv-cinder-789564-2-iscsi {{(pid=99029) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 17:53:31.592695 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_hamode_db [None req-0353c4fe-b0bd-4ace-995f-5d1d7243c8e9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcae850c280>, 'dv-cinder-789564-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-25T17:34:21Z,description=<?>,heartbeat_timestamp=2021-05-25T17:53:21Z,host='dv-cinder-789564-2-iscsi',id=eaeb6875-c4ed-43b6-8658-aa4e52324fdf,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T17:34:21Z,topic='l3_agent')) {'router_ids': ['e7c0703b-bced-4496-8da6-09afc21d0c08'], 'active': True} {{(pid=99029) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:53:31.655056 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2cccbc58-093b-4648-a206-1e82bc09d06a None None] Network 137490af-32dc-4466-832c-959b96aa867d is already hosted by enough agents. {{(pid=99028) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 17:53:31.656077 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Provisioning complete for port 81c38a52-f89b-442f-a887-1536464ac16e triggered by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 17:53:31.656604 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:31.719136 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2cccbc58-093b-4648-a206-1e82bc09d06a None None] Pushing event updated for resources: {'Port': ['ID=67cb78bc-708f-450f-9e19-ef7b06a381d0,revision_number=1']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:53:31.728806 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.scheduler.base_scheduler [None req-2cccbc58-093b-4648-a206-1e82bc09d06a None None] Resources bound (agent type, host, resource id):  {{(pid=99028) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 17:53:31.730682 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-2cccbc58-093b-4648-a206-1e82bc09d06a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.173s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:53:31.733650 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2cccbc58-093b-4648-a206-1e82bc09d06a None None] Received port after_create {{(pid=99028) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 17:53:31.800824 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-38600a04-fa8b-4001-b06f-cdfb1faafd11 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:31.836238 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_dvr_db [None req-0353c4fe-b0bd-4ace-995f-5d1d7243c8e9 None None] Set router e7c0703b-bced-4496-8da6-09afc21d0c08 gateway port host: dv-cinder-789564-2-iscsi {{(pid=99029) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 17:53:31.838941 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-38600a04-fa8b-4001-b06f-cdfb1faafd11 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:31.900737 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.managers [None req-2cccbc58-093b-4648-a206-1e82bc09d06a None None] Attempting to bind port 67cb78bc-708f-450f-9e19-ef7b06a381d0 on host dv-cinder-789564-2-iscsi for vnic_type normal with profile  {{(pid=99028) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 17:53:31.905400 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.managers [None req-2cccbc58-093b-4648-a206-1e82bc09d06a None None] Attempting to bind port 67cb78bc-708f-450f-9e19-ef7b06a381d0 by drivers openvswitch,hyperv on host dv-cinder-789564-2-iscsi at level 0 using segments [{'id': '25860488-309b-44b3-a089-322389b1576c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1320, 'network_id': '137490af-32dc-4466-832c-959b96aa867d'}] {{(pid=99028) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 17:53:31.905400 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2cccbc58-093b-4648-a206-1e82bc09d06a None None] Attempting to bind port 67cb78bc-708f-450f-9e19-ef7b06a381d0 on network 137490af-32dc-4466-832c-959b96aa867d {{(pid=99028) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 17:53:31.911248 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2cccbc58-093b-4648-a206-1e82bc09d06a None None] Checking agent: {'id': '7bb67520-1e97-4ad9-9b97-101068bbe1a3', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-789564-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 17, 34, 21), 'started_at': datetime.datetime(2021, 5, 25, 17, 34, 51), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 17, 53, 21), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-789564-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=99028) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 17:53:31.911629 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2cccbc58-093b-4648-a206-1e82bc09d06a None None] Checking segment: {'id': '25860488-309b-44b3-a089-322389b1576c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1320, 'network_id': '137490af-32dc-4466-832c-959b96aa867d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=99028) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 17:53:31.912040 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-2cccbc58-093b-4648-a206-1e82bc09d06a None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:31.912433 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2cccbc58-093b-4648-a206-1e82bc09d06a None None] Bound using segment: {'id': '25860488-309b-44b3-a089-322389b1576c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1320, 'network_id': '137490af-32dc-4466-832c-959b96aa867d'} {{(pid=99028) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 17:53:31.912993 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.managers [None req-2cccbc58-093b-4648-a206-1e82bc09d06a None None] Bound port: 67cb78bc-708f-450f-9e19-ef7b06a381d0, host: dv-cinder-789564-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '25860488-309b-44b3-a089-322389b1576c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1320, 'network_id': '137490af-32dc-4466-832c-959b96aa867d'}}] {{(pid=99028) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 17:53:31.913419 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-2cccbc58-093b-4648-a206-1e82bc09d06a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:32.001323 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.db_base_plugin_common [None req-38600a04-fa8b-4001-b06f-cdfb1faafd11 admin admin] Allocated IP 172.27.3.14 (eb7ec72b-a691-481b-8d7e-42c05e13a8cb/d6898f5f-da0b-4428-97b4-4cbe3e83caaa/00b1d19d-649f-4ed3-863e-f862f91d943b) {{(pid=99027) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 17:53:32.020804 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-2cccbc58-093b-4648-a206-1e82bc09d06a None None] For port 67cb78bc-708f-450f-9e19-ef7b06a381d0, host dv-cinder-789564-2-iscsi, cleared binding levels {{(pid=99028) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 17:53:32.023979 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-2cccbc58-093b-4648-a206-1e82bc09d06a None None] For port 67cb78bc-708f-450f-9e19-ef7b06a381d0, host dv-cinder-789564-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=67cb78bc-708f-450f-9e19-ef7b06a381d0,segment=NetworkSegment(25860488-309b-44b3-a089-322389b1576c),segment_id=25860488-309b-44b3-a089-322389b1576c)] {{(pid=99028) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 17:53:32.081904 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-2cccbc58-093b-4648-a206-1e82bc09d06a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:32.088798 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:53:32.160018 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-38600a04-fa8b-4001-b06f-cdfb1faafd11 admin admin] Notify callbacks [] for port, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:32.169626 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2cccbc58-093b-4648-a206-1e82bc09d06a None None] Pushing event updated for resources: {'Port': ['ID=67cb78bc-708f-450f-9e19-ef7b06a381d0,revision_number=2']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:53:32.180405 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-2cccbc58-093b-4648-a206-1e82bc09d06a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:53:32.231436 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_hamode_db [None req-0353c4fe-b0bd-4ace-995f-5d1d7243c8e9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcae850c280>, [{'id': 'e7c0703b-bced-4496-8da6-09afc21d0c08', 'name': 'tempest-TestShelveInstance-236747542-router', 'tenant_id': 'b32a0178e35546828deb4b131cde3201', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.219'}], 'enable_snat': True}, 'gw_port_id': '81c38a52-f89b-442f-a887-1536464ac16e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:53:22Z', 'updated_at': '2021-05-25T17:53:27Z', 'revision_number': 4, 'project_id': 'b32a0178e35546828deb4b131cde3201', 'gw_port': {'id': '81c38a52-f89b-442f-a887-1536464ac16e', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:58:82:cf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e7c0703b-bced-4496-8da6-09afc21d0c08', 'device_owner': 'network:router_gateway', 'standard_attr_id': 527, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.219', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:53:23Z', 'updated_at': '2021-05-25T17:53:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi', '_interfaces': [{'id': 'd42b2822-3e3c-4030-974d-4cd1a0ba238f', 'name': '', 'network_id': '0293f9ff-afda-47ba-aab9-1aac8ea6403d', 'tenant_id': 'b32a0178e35546828deb4b131cde3201', 'mac_address': 'fa:16:3e:99:2a:b9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e7c0703b-bced-4496-8da6-09afc21d0c08', 'device_owner': 'network:router_interface', 'standard_attr_id': 528, 'fixed_ips': [{'subnet_id': '69cd9818-8734-45ed-94ad-ee676be865a2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:53:26Z', 'updated_at': '2021-05-25T17:53:31Z', 'revision_number': 4, 'project_id': 'b32a0178e35546828deb4b131cde3201', 'subnets': [{'id': '69cd9818-8734-45ed-94ad-ee676be865a2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-789564-2-iscsi', False) {} {{(pid=99029) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:53:32.236550 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0353c4fe-b0bd-4ace-995f-5d1d7243c8e9 None None] The sync data for ids ['e7c0703b-bced-4496-8da6-09afc21d0c08'] in dv-cinder-789564-2-iscsi is: [{'id': 'e7c0703b-bced-4496-8da6-09afc21d0c08', 'name': 'tempest-TestShelveInstance-236747542-router', 'tenant_id': 'b32a0178e35546828deb4b131cde3201', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.219'}], 'enable_snat': True}, 'gw_port_id': '81c38a52-f89b-442f-a887-1536464ac16e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:53:22Z', 'updated_at': '2021-05-25T17:53:27Z', 'revision_number': 4, 'project_id': 'b32a0178e35546828deb4b131cde3201', 'gw_port': {'id': '81c38a52-f89b-442f-a887-1536464ac16e', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:58:82:cf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e7c0703b-bced-4496-8da6-09afc21d0c08', 'device_owner': 'network:router_gateway', 'standard_attr_id': 527, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.219', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:53:23Z', 'updated_at': '2021-05-25T17:53:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi', '_interfaces': [{'id': 'd42b2822-3e3c-4030-974d-4cd1a0ba238f', 'name': '', 'network_id': '0293f9ff-afda-47ba-aab9-1aac8ea6403d', 'tenant_id': 'b32a0178e35546828deb4b131cde3201', 'mac_address': 'fa:16:3e:99:2a:b9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e7c0703b-bced-4496-8da6-09afc21d0c08', 'device_owner': 'network:router_interface', 'standard_attr_id': 528, 'fixed_ips': [{'subnet_id': '69cd9818-8734-45ed-94ad-ee676be865a2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:53:26Z', 'updated_at': '2021-05-25T17:53:31Z', 'revision_number': 4, 'project_id': 'b32a0178e35546828deb4b131cde3201', 'subnets': [{'id': '69cd9818-8734-45ed-94ad-ee676be865a2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=99029) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 25 17:53:32.256688 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-38600a04-fa8b-4001-b06f-cdfb1faafd11 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781840788179', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15468986'] for port, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:32.261433 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-887c0a5b-9377-40ad-bf51-a66e5e8550fb tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:53:32.352836 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-38600a04-fa8b-4001-b06f-cdfb1faafd11 admin admin] Network eb7ec72b-a691-481b-8d7e-42c05e13a8cb is already hosted by enough agents. {{(pid=99027) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 17:53:32.364860 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.base_scheduler [None req-38600a04-fa8b-4001-b06f-cdfb1faafd11 admin admin] Resources bound (agent type, host, resource id):  {{(pid=99027) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 17:53:32.367701 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.l3_dvrscheduler_db [None req-38600a04-fa8b-4001-b06f-cdfb1faafd11 admin admin] Received port after_create {{(pid=99027) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 17:53:32.406945 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38600a04-fa8b-4001-b06f-cdfb1faafd11 admin admin] Pushing event updated for resources: {'Port': ['ID=00b1d19d-649f-4ed3-863e-f862f91d943b,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:53:32.409997 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-38600a04-fa8b-4001-b06f-cdfb1faafd11 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.149s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:53:33.025900 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-38600a04-fa8b-4001-b06f-cdfb1faafd11 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:33.110664 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-199bf964-3e15-4b11-a767-7ac1e1292ae2 None None] Network 137490af-32dc-4466-832c-959b96aa867d requested from dv-cinder-789564-2-iscsi {{(pid=99028) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 17:53:33.270961 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-76f01b34-3397-451c-990a-f9b21e528ff1 None None] Provisioning for port 67cb78bc-708f-450f-9e19-ef7b06a381d0 completed by entity DHCP. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 17:53:33.380718 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-38600a04-fa8b-4001-b06f-cdfb1faafd11 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-415057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-420065'] for router, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:33.623465 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device d42b2822-3e3c-4030-974d-4cd1a0ba238f up at agent ovs-agent-dv-cinder-789564-2-iscsi {{(pid=99028) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 17:53:33.735739 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-38600a04-fa8b-4001-b06f-cdfb1faafd11 admin admin] Router 9f3abaf6-6698-4faf-a235-07b94569540c is scheduled to L3 agent eaeb6875-c4ed-43b6-8658-aa4e52324fdf with binding_index 1 {{(pid=99027) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
May 25 17:53:33.764002 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Provisioning for port d42b2822-3e3c-4030-974d-4cd1a0ba238f completed by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 17:53:33.769314 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Provisioning complete for port d42b2822-3e3c-4030-974d-4cd1a0ba238f triggered by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 17:53:33.769696 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:33.896074 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:33.921732 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-38600a04-fa8b-4001-b06f-cdfb1faafd11 admin admin] Notify agent at l3_agent.dv-cinder-789564-2-iscsi the message routers_updated {{(pid=99027) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 25 17:53:33.931797 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-962a04b2-9a26-4441-8a64-3b6c8f990b18 None None] Sync routers for ids ['9f3abaf6-6698-4faf-a235-07b94569540c'] in dv-cinder-789564-2-iscsi {{(pid=99028) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 25 17:53:33.935246 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] For port d42b2822-3e3c-4030-974d-4cd1a0ba238f, host dv-cinder-789564-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=d42b2822-3e3c-4030-974d-4cd1a0ba238f,segment=NetworkSegment(66d2a99c-6c47-4a92-ac51-31e984766b29),segment_id=66d2a99c-6c47-4a92-ac51-31e984766b29)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:53:33.954218 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvrscheduler_db [None req-962a04b2-9a26-4441-8a64-3b6c8f990b18 None None] Routers {'9f3abaf6-6698-4faf-a235-07b94569540c'} bound to L3 agent in host dv-cinder-789564-2-iscsi {{(pid=99028) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 17:53:33.954864 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-962a04b2-9a26-4441-8a64-3b6c8f990b18 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcae5a7efa0>, 'dv-cinder-789564-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-25T17:34:21Z,description=<?>,heartbeat_timestamp=2021-05-25T17:53:21Z,host='dv-cinder-789564-2-iscsi',id=eaeb6875-c4ed-43b6-8658-aa4e52324fdf,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T17:34:21Z,topic='l3_agent')) {'router_ids': ['9f3abaf6-6698-4faf-a235-07b94569540c'], 'active': True} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:53:34.023262 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:34.024110 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device 67cb78bc-708f-450f-9e19-ef7b06a381d0 up at agent ovs-agent-dv-cinder-789564-2-iscsi {{(pid=99028) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 17:53:34.032751 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-38600a04-fa8b-4001-b06f-cdfb1faafd11 admin admin] Notify callbacks [] for router, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:34.034543 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-38600a04-fa8b-4001-b06f-cdfb1faafd11 admin admin] 10.222.0.122 "POST /v2.0/routers HTTP/1.1" status: 201  len: 920 time: 3.2831972
May 25 17:53:34.037752 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 49186) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:53:34.055745 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-22651512-fc64-4305-995b-985ad1d3d588 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:53:34.229345 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Pushing event updated for resources: {'Port': ['ID=d42b2822-3e3c-4030-974d-4cd1a0ba238f,revision_number=5']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:53:34.238645 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.183s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:53:34.267524 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvr_db [None req-962a04b2-9a26-4441-8a64-3b6c8f990b18 None None] Set router 9f3abaf6-6698-4faf-a235-07b94569540c gateway port host: dv-cinder-789564-2-iscsi {{(pid=99028) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 17:53:34.375286 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Provisioning for port 67cb78bc-708f-450f-9e19-ef7b06a381d0 completed by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 17:53:34.402521 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Provisioning complete for port 67cb78bc-708f-450f-9e19-ef7b06a381d0 triggered by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 17:53:34.402899 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:34.693915 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:34.744885 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] For port 67cb78bc-708f-450f-9e19-ef7b06a381d0, host dv-cinder-789564-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=67cb78bc-708f-450f-9e19-ef7b06a381d0,segment=NetworkSegment(25860488-309b-44b3-a089-322389b1576c),segment_id=25860488-309b-44b3-a089-322389b1576c)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:53:34.751197 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-962a04b2-9a26-4441-8a64-3b6c8f990b18 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcae5a7efa0>, [{'id': '9f3abaf6-6698-4faf-a235-07b94569540c', 'name': 'tempest-TestShelveInstance-2008156234-router', 'tenant_id': 'd440d92738fa475c889c19df3d828036', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.14'}], 'enable_snat': True}, 'gw_port_id': '00b1d19d-649f-4ed3-863e-f862f91d943b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:53:30Z', 'updated_at': '2021-05-25T17:53:32Z', 'revision_number': 3, 'project_id': 'd440d92738fa475c889c19df3d828036', 'gw_port': {'id': '00b1d19d-649f-4ed3-863e-f862f91d943b', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:5d:6e:b8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9f3abaf6-6698-4faf-a235-07b94569540c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 539, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.14', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:53:31Z', 'updated_at': '2021-05-25T17:53:32Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi'}], 'dv-cinder-789564-2-iscsi', False) {} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:53:34.757314 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-962a04b2-9a26-4441-8a64-3b6c8f990b18 None None] Checking router: 9f3abaf6-6698-4faf-a235-07b94569540c for host: dv-cinder-789564-2-iscsi {{(pid=99028) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 25 17:53:34.757675 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-962a04b2-9a26-4441-8a64-3b6c8f990b18 None None] Updating router 9f3abaf6-6698-4faf-a235-07b94569540c port 00b1d19d-649f-4ed3-863e-f862f91d943b binding host dv-cinder-789564-2-iscsi {{(pid=99028) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 25 17:53:34.812621 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:34.814547 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:53:34.847511 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-962a04b2-9a26-4441-8a64-3b6c8f990b18 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:34.869074 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-68b3bb15-8e5c-45d3-b02b-f2bd04cb8d33 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:34.986055 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Pushing event updated for resources: {'Port': ['ID=67cb78bc-708f-450f-9e19-ef7b06a381d0,revision_number=3']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:53:34.996599 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.182s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:53:35.084318 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.db_base_plugin_common [None req-68b3bb15-8e5c-45d3-b02b-f2bd04cb8d33 admin admin] Allocated IP 172.20.0.1 (137490af-32dc-4466-832c-959b96aa867d/fefe3428-f312-48c3-a442-12fb15c37143/755f4579-cae9-48c8-b5ad-a366ef203726) {{(pid=99027) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 17:53:35.232343 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-962a04b2-9a26-4441-8a64-3b6c8f990b18 None None] Notify callbacks [] for port, precommit_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:35.238647 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-68b3bb15-8e5c-45d3-b02b-f2bd04cb8d33 admin admin] Notify callbacks [] for port, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:35.245376 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-962a04b2-9a26-4441-8a64-3b6c8f990b18 None None] Transition to ACTIVE for port object 00b1d19d-649f-4ed3-863e-f862f91d943b will not be triggered until provisioned by entity L2. {{(pid=99028) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 17:53:35.255508 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.provisioning_blocks [None req-68b3bb15-8e5c-45d3-b02b-f2bd04cb8d33 admin admin] Transition to ACTIVE for port object 755f4579-cae9-48c8-b5ad-a366ef203726 will not be triggered until provisioned by entity DHCP. {{(pid=99027) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 17:53:35.309235 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-962a04b2-9a26-4441-8a64-3b6c8f990b18 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:35.314437 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-d16f39f4-30fc-4b2c-8411-64bb4bf9e96e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:53:35.335622 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-68b3bb15-8e5c-45d3-b02b-f2bd04cb8d33 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781840788179', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15468986'] for port, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:35.339487 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-8dae9941-91d4-4ce4-acf9-025ee2341832 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:53:35.389887 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.managers [None req-962a04b2-9a26-4441-8a64-3b6c8f990b18 None None] Attempting to bind port 00b1d19d-649f-4ed3-863e-f862f91d943b on host dv-cinder-789564-2-iscsi for vnic_type normal with profile  {{(pid=99028) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 17:53:35.390255 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.managers [None req-962a04b2-9a26-4441-8a64-3b6c8f990b18 None None] Attempting to bind port 00b1d19d-649f-4ed3-863e-f862f91d943b by drivers openvswitch,hyperv on host dv-cinder-789564-2-iscsi at level 0 using segments [{'id': '471771f9-c462-4865-800d-0d5029e9eb3e', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb'}] {{(pid=99028) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 17:53:35.390623 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-962a04b2-9a26-4441-8a64-3b6c8f990b18 None None] Attempting to bind port 00b1d19d-649f-4ed3-863e-f862f91d943b on network eb7ec72b-a691-481b-8d7e-42c05e13a8cb {{(pid=99028) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 17:53:35.396929 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89411d75-83e0-4e21-bf09-f28cebc71a4e None None] Pushing event updated for resources: {'Port': ['ID=00b1d19d-649f-4ed3-863e-f862f91d943b,revision_number=2']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:53:35.399709 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-89411d75-83e0-4e21-bf09-f28cebc71a4e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.085s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:53:35.402522 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-962a04b2-9a26-4441-8a64-3b6c8f990b18 None None] Checking agent: {'id': '7bb67520-1e97-4ad9-9b97-101068bbe1a3', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-789564-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 17, 34, 21), 'started_at': datetime.datetime(2021, 5, 25, 17, 34, 51), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 17, 53, 21), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-789564-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=99028) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 17:53:35.402813 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-68b3bb15-8e5c-45d3-b02b-f2bd04cb8d33 admin admin] Network 137490af-32dc-4466-832c-959b96aa867d is already hosted by enough agents. {{(pid=99027) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 17:53:35.402924 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-962a04b2-9a26-4441-8a64-3b6c8f990b18 None None] Checking segment: {'id': '471771f9-c462-4865-800d-0d5029e9eb3e', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=99028) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 17:53:35.403302 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-962a04b2-9a26-4441-8a64-3b6c8f990b18 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:35.403693 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-962a04b2-9a26-4441-8a64-3b6c8f990b18 None None] Bound using segment: {'id': '471771f9-c462-4865-800d-0d5029e9eb3e', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb'} {{(pid=99028) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 17:53:35.404174 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.managers [None req-962a04b2-9a26-4441-8a64-3b6c8f990b18 None None] Bound port: 00b1d19d-649f-4ed3-863e-f862f91d943b, host: dv-cinder-789564-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '471771f9-c462-4865-800d-0d5029e9eb3e', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb'}}] {{(pid=99028) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 17:53:35.404531 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-962a04b2-9a26-4441-8a64-3b6c8f990b18 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:35.405232 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.base_scheduler [None req-68b3bb15-8e5c-45d3-b02b-f2bd04cb8d33 admin admin] Resources bound (agent type, host, resource id):  {{(pid=99027) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 17:53:35.409231 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.l3_dvrscheduler_db [None req-68b3bb15-8e5c-45d3-b02b-f2bd04cb8d33 admin admin] Received port after_create {{(pid=99027) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 17:53:35.443932 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68b3bb15-8e5c-45d3-b02b-f2bd04cb8d33 admin admin] Pushing event updated for resources: {'Port': ['ID=755f4579-cae9-48c8-b5ad-a366ef203726,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:53:35.450266 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-68b3bb15-8e5c-45d3-b02b-f2bd04cb8d33 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.111s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:53:35.477502 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-68b3bb15-8e5c-45d3-b02b-f2bd04cb8d33 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-421008'] for router_interface, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:35.501984 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-962a04b2-9a26-4441-8a64-3b6c8f990b18 None None] For port 00b1d19d-649f-4ed3-863e-f862f91d943b, host dv-cinder-789564-2-iscsi, cleared binding levels {{(pid=99028) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 17:53:35.507037 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-962a04b2-9a26-4441-8a64-3b6c8f990b18 None None] For port 00b1d19d-649f-4ed3-863e-f862f91d943b, host dv-cinder-789564-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=00b1d19d-649f-4ed3-863e-f862f91d943b,segment=NetworkSegment(471771f9-c462-4865-800d-0d5029e9eb3e),segment_id=471771f9-c462-4865-800d-0d5029e9eb3e)] {{(pid=99028) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 17:53:35.526601 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device d42b2822-3e3c-4030-974d-4cd1a0ba238f up at agent ovs-agent-dv-cinder-789564-2-iscsi {{(pid=99028) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 17:53:35.600337 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Provisioning complete for port d42b2822-3e3c-4030-974d-4cd1a0ba238f triggered by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 17:53:35.600719 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:35.624399 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-962a04b2-9a26-4441-8a64-3b6c8f990b18 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:35.633200 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:53:35.701057 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-68b3bb15-8e5c-45d3-b02b-f2bd04cb8d33 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:35.745446 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvrscheduler_db [None req-962a04b2-9a26-4441-8a64-3b6c8f990b18 None None] Routers {'9f3abaf6-6698-4faf-a235-07b94569540c'} bound to L3 agent in host dv-cinder-789564-2-iscsi {{(pid=99028) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 17:53:35.746085 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-962a04b2-9a26-4441-8a64-3b6c8f990b18 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcae5a7efa0>, 'dv-cinder-789564-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-25T17:34:21Z,description=<?>,heartbeat_timestamp=2021-05-25T17:53:21Z,host='dv-cinder-789564-2-iscsi',id=eaeb6875-c4ed-43b6-8658-aa4e52324fdf,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T17:34:21Z,topic='l3_agent')) {'router_ids': ['9f3abaf6-6698-4faf-a235-07b94569540c'], 'active': True} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:53:35.826000 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-05333196-a448-40bc-bed5-b98f185008f7 None None] Provisioning for port 755f4579-cae9-48c8-b5ad-a366ef203726 completed by entity DHCP. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 17:53:35.843712 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-05333196-a448-40bc-bed5-b98f185008f7 None None] Provisioning complete for port 755f4579-cae9-48c8-b5ad-a366ef203726 triggered by entity DHCP. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 17:53:35.844086 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-05333196-a448-40bc-bed5-b98f185008f7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:35.869743 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89411d75-83e0-4e21-bf09-f28cebc71a4e None None] Pushing event updated for resources: {'Port': ['ID=00b1d19d-649f-4ed3-863e-f862f91d943b,revision_number=3']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:53:35.873068 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-89411d75-83e0-4e21-bf09-f28cebc71a4e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.240s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:53:35.940853 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-68b3bb15-8e5c-45d3-b02b-f2bd04cb8d33 admin admin] Notify callbacks [] for port, precommit_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:36.000948 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-68b3bb15-8e5c-45d3-b02b-f2bd04cb8d33 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15468979'] for port, after_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:36.030633 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-9dd1d841-7ccb-4484-b27b-74938eb3e8b7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:53:36.035599 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.plugin [None req-05333196-a448-40bc-bed5-b98f185008f7 None None] Port 755f4579-cae9-48c8-b5ad-a366ef203726 cannot update to ACTIVE because it is not bound. {{(pid=99028) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 25 17:53:36.058556 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device 67cb78bc-708f-450f-9e19-ef7b06a381d0 up at agent ovs-agent-dv-cinder-789564-2-iscsi {{(pid=99028) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 17:53:36.108629 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvr_db [None req-962a04b2-9a26-4441-8a64-3b6c8f990b18 None None] Set router 9f3abaf6-6698-4faf-a235-07b94569540c gateway port host: dv-cinder-789564-2-iscsi {{(pid=99028) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 17:53:36.115320 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68b3bb15-8e5c-45d3-b02b-f2bd04cb8d33 admin admin] Pushing event updated for resources: {'Port': ['ID=755f4579-cae9-48c8-b5ad-a366ef203726,revision_number=2']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:53:36.117863 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-68b3bb15-8e5c-45d3-b02b-f2bd04cb8d33 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-549394', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-420925'] for router_interface, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:36.121505 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-68b3bb15-8e5c-45d3-b02b-f2bd04cb8d33 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:53:36.260222 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-68b3bb15-8e5c-45d3-b02b-f2bd04cb8d33 admin admin] Network 137490af-32dc-4466-832c-959b96aa867d is already hosted by enough agents. {{(pid=99027) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 17:53:36.261377 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.base_scheduler [None req-68b3bb15-8e5c-45d3-b02b-f2bd04cb8d33 admin admin] Resources bound (agent type, host, resource id):  {{(pid=99027) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 17:53:36.396152 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Provisioning complete for port 67cb78bc-708f-450f-9e19-ef7b06a381d0 triggered by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 17:53:36.396730 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:36.512548 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-f5ac341d-1d12-4056-9fc8-526c71d819e3 None None] Provisioning complete for port 755f4579-cae9-48c8-b5ad-a366ef203726 triggered by entity DHCP. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 17:53:36.512931 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-f5ac341d-1d12-4056-9fc8-526c71d819e3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:36.575201 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-68b3bb15-8e5c-45d3-b02b-f2bd04cb8d33 admin admin] Router 9f3abaf6-6698-4faf-a235-07b94569540c has already been hosted by L3 agent eaeb6875-c4ed-43b6-8658-aa4e52324fdf {{(pid=99027) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 25 17:53:36.637734 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.plugin [None req-f5ac341d-1d12-4056-9fc8-526c71d819e3 None None] Port 755f4579-cae9-48c8-b5ad-a366ef203726 cannot update to ACTIVE because it is not bound. {{(pid=99028) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 25 17:53:36.692856 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-962a04b2-9a26-4441-8a64-3b6c8f990b18 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcae5a7efa0>, [{'id': '9f3abaf6-6698-4faf-a235-07b94569540c', 'name': 'tempest-TestShelveInstance-2008156234-router', 'tenant_id': 'd440d92738fa475c889c19df3d828036', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.14'}], 'enable_snat': True}, 'gw_port_id': '00b1d19d-649f-4ed3-863e-f862f91d943b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:53:30Z', 'updated_at': '2021-05-25T17:53:35Z', 'revision_number': 4, 'project_id': 'd440d92738fa475c889c19df3d828036', 'gw_port': {'id': '00b1d19d-649f-4ed3-863e-f862f91d943b', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:5d:6e:b8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9f3abaf6-6698-4faf-a235-07b94569540c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 539, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.14', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:53:31Z', 'updated_at': '2021-05-25T17:53:35Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi', '_interfaces': [{'id': '755f4579-cae9-48c8-b5ad-a366ef203726', 'name': '', 'network_id': '137490af-32dc-4466-832c-959b96aa867d', 'tenant_id': 'd440d92738fa475c889c19df3d828036', 'mac_address': 'fa:16:3e:95:f9:aa', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9f3abaf6-6698-4faf-a235-07b94569540c', 'device_owner': 'network:router_interface', 'standard_attr_id': 540, 'fixed_ips': [{'subnet_id': 'fefe3428-f312-48c3-a442-12fb15c37143', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:53:34Z', 'updated_at': '2021-05-25T17:53:35Z', 'revision_number': 1, 'project_id': 'd440d92738fa475c889c19df3d828036', 'subnets': [{'id': 'fefe3428-f312-48c3-a442-12fb15c37143', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-789564-2-iscsi', False) {} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:53:36.697228 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-962a04b2-9a26-4441-8a64-3b6c8f990b18 None None] The sync data for ids ['9f3abaf6-6698-4faf-a235-07b94569540c'] in dv-cinder-789564-2-iscsi is: [{'id': '9f3abaf6-6698-4faf-a235-07b94569540c', 'name': 'tempest-TestShelveInstance-2008156234-router', 'tenant_id': 'd440d92738fa475c889c19df3d828036', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.14'}], 'enable_snat': True}, 'gw_port_id': '00b1d19d-649f-4ed3-863e-f862f91d943b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:53:30Z', 'updated_at': '2021-05-25T17:53:35Z', 'revision_number': 4, 'project_id': 'd440d92738fa475c889c19df3d828036', 'gw_port': {'id': '00b1d19d-649f-4ed3-863e-f862f91d943b', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:5d:6e:b8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9f3abaf6-6698-4faf-a235-07b94569540c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 539, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.14', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:53:31Z', 'updated_at': '2021-05-25T17:53:35Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi', '_interfaces': [{'id': '755f4579-cae9-48c8-b5ad-a366ef203726', 'name': '', 'network_id': '137490af-32dc-4466-832c-959b96aa867d', 'tenant_id': 'd440d92738fa475c889c19df3d828036', 'mac_address': 'fa:16:3e:95:f9:aa', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9f3abaf6-6698-4faf-a235-07b94569540c', 'device_owner': 'network:router_interface', 'standard_attr_id': 540, 'fixed_ips': [{'subnet_id': 'fefe3428-f312-48c3-a442-12fb15c37143', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:53:34Z', 'updated_at': '2021-05-25T17:53:35Z', 'revision_number': 1, 'project_id': 'd440d92738fa475c889c19df3d828036', 'subnets': [{'id': 'fefe3428-f312-48c3-a442-12fb15c37143', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=99028) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 25 17:53:36.769461 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-68b3bb15-8e5c-45d3-b02b-f2bd04cb8d33 admin admin] Notify agent at l3_agent.dv-cinder-789564-2-iscsi the message routers_updated {{(pid=99027) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 25 17:53:36.778783 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-68b3bb15-8e5c-45d3-b02b-f2bd04cb8d33 admin admin] 10.222.0.122 "PUT /v2.0/routers/9f3abaf6-6698-4faf-a235-07b94569540c/add_router_interface HTTP/1.1" status: 200  len: 503 time: 2.7400191
May 25 17:53:37.501316 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device 00b1d19d-649f-4ed3-863e-f862f91d943b up at agent ovs-agent-dv-cinder-789564-2-iscsi {{(pid=99028) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 17:53:37.712785 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Provisioning for port 00b1d19d-649f-4ed3-863e-f862f91d943b completed by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 17:53:37.720960 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Provisioning complete for port 00b1d19d-649f-4ed3-863e-f862f91d943b triggered by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 17:53:37.723930 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:37.757501 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 49202) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:53:37.762916 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.v2.base [None req-ff443d1f-f9e4-466f-8e4d-4321404c42b8 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-415427174', 'description': 'tempest-secgroup-smoke-415427174 description', 'project_id': 'b32a0178e35546828deb4b131cde3201'}} {{(pid=99027) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:53:37.771807 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-ff443d1f-f9e4-466f-8e4d-4321404c42b8 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:53:37.775914 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-ff443d1f-f9e4-466f-8e4d-4321404c42b8 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Usage tracker for resource:security_group and tenant:b32a0178e35546828deb4b131cde3201 is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:53:37.782356 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-ff443d1f-f9e4-466f-8e4d-4321404c42b8 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:53:37.787246 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-ff443d1f-f9e4-466f-8e4d-4321404c42b8 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:53:37.856814 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:37.860976 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-ff443d1f-f9e4-466f-8e4d-4321404c42b8 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Notify callbacks [] for security_group, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:37.873231 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] For port 00b1d19d-649f-4ed3-863e-f862f91d943b, host dv-cinder-789564-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=00b1d19d-649f-4ed3-863e-f862f91d943b,segment=NetworkSegment(471771f9-c462-4865-800d-0d5029e9eb3e),segment_id=471771f9-c462-4865-800d-0d5029e9eb3e)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:53:37.882165 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-ff443d1f-f9e4-466f-8e4d-4321404c42b8 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:53:37.885924 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-ff443d1f-f9e4-466f-8e4d-4321404c42b8 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Usage tracker for resource:security_group_rule and tenant:b32a0178e35546828deb4b131cde3201 is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:53:37.888670 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-ff443d1f-f9e4-466f-8e4d-4321404c42b8 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:53:37.895434 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-ff443d1f-f9e4-466f-8e4d-4321404c42b8 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:53:37.949401 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:37.952605 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:53:37.968111 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-ff443d1f-f9e4-466f-8e4d-4321404c42b8 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Notify callbacks [] for security_group, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:38.029020 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Pushing event updated for resources: {'Port': ['ID=00b1d19d-649f-4ed3-863e-f862f91d943b,revision_number=4']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:53:38.032841 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:53:38.043795 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-ff443d1f-f9e4-466f-8e4d-4321404c42b8 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:38.047696 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-8ce91b55-a1a5-48d6-aa04-a040674d39b1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:53:38.089611 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff443d1f-f9e4-466f-8e4d-4321404c42b8 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Pushing event updated for resources: {'SecurityGroup': ['ID=d5b71c00-54cd-4760-821a-82059bd31db8,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:53:38.092420 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-ff443d1f-f9e4-466f-8e4d-4321404c42b8 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:53:38.149181 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-ff443d1f-f9e4-466f-8e4d-4321404c42b8 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Notify callbacks [] for security_group, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:38.150466 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-ff443d1f-f9e4-466f-8e4d-4321404c42b8 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] 10.222.0.122 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1792 time: 0.3919618
May 25 17:53:38.153486 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 49208) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:53:38.158596 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.v2.base [None req-4a1a9d8f-18a2-4853-a142-574fdf81bb92 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Request body: {'security_group_rule': {'security_group_id': 'd5b71c00-54cd-4760-821a-82059bd31db8', 'project_id': 'b32a0178e35546828deb4b131cde3201', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=99027) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:53:38.164580 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-4a1a9d8f-18a2-4853-a142-574fdf81bb92 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:53:38.168320 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-4a1a9d8f-18a2-4853-a142-574fdf81bb92 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Usage tracker for resource:security_group_rule and tenant:b32a0178e35546828deb4b131cde3201 is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:53:38.171181 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-4a1a9d8f-18a2-4853-a142-574fdf81bb92 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:53:38.177357 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-4a1a9d8f-18a2-4853-a142-574fdf81bb92 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:53:38.259503 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-4a1a9d8f-18a2-4853-a142-574fdf81bb92 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Notify callbacks [] for security_group_rule, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:38.328289 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-4a1a9d8f-18a2-4853-a142-574fdf81bb92 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:38.418172 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-4a1a9d8f-18a2-4853-a142-574fdf81bb92 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459369'] for security_group_rule, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:38.425048 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:53:38.445231 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a1a9d8f-18a2-4853-a142-574fdf81bb92 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=bc1df9bd-4c1b-4290-a05d-62100c64051e,revision_number=0']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:53:38.449735 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-4a1a9d8f-18a2-4853-a142-574fdf81bb92 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:53:38.526634 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-4a1a9d8f-18a2-4853-a142-574fdf81bb92 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Notify callbacks [] for security_group_rule, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:38.527785 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-4a1a9d8f-18a2-4853-a142-574fdf81bb92 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] 10.222.0.122 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 0.3733771
May 25 17:53:38.530510 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 49212) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:53:38.536829 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.v2.base [None req-351383e4-e219-4d69-947f-755fa9c34b5f tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Request body: {'security_group_rule': {'security_group_id': 'd5b71c00-54cd-4760-821a-82059bd31db8', 'project_id': 'b32a0178e35546828deb4b131cde3201', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=99027) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:53:38.542867 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-351383e4-e219-4d69-947f-755fa9c34b5f tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:53:38.546692 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-351383e4-e219-4d69-947f-755fa9c34b5f tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Usage tracker for resource:security_group_rule and tenant:b32a0178e35546828deb4b131cde3201 is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:53:38.550597 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-351383e4-e219-4d69-947f-755fa9c34b5f tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:53:38.556409 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-351383e4-e219-4d69-947f-755fa9c34b5f tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:53:38.656139 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-351383e4-e219-4d69-947f-755fa9c34b5f tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Notify callbacks [] for security_group_rule, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:38.719331 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-351383e4-e219-4d69-947f-755fa9c34b5f tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:38.823135 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-351383e4-e219-4d69-947f-755fa9c34b5f tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459369'] for security_group_rule, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:38.825436 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:53:38.849899 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-351383e4-e219-4d69-947f-755fa9c34b5f tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=aa813c51-cb1c-4dde-a33a-99f529907835,revision_number=0']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:53:38.854760 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-351383e4-e219-4d69-947f-755fa9c34b5f tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:53:38.954785 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-351383e4-e219-4d69-947f-755fa9c34b5f tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Notify callbacks [] for security_group_rule, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:38.956195 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-351383e4-e219-4d69-947f-755fa9c34b5f tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] 10.222.0.122 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 763 time: 0.4246087
May 25 17:53:38.959009 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 49216) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:53:38.964705 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.v2.base [None req-78da11b6-fbca-426b-be44-3ae6eaaa8996 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Request body: {'security_group_rule': {'security_group_id': 'd5b71c00-54cd-4760-821a-82059bd31db8', 'project_id': 'b32a0178e35546828deb4b131cde3201', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=99027) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:53:38.971412 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-78da11b6-fbca-426b-be44-3ae6eaaa8996 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:53:38.975384 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-78da11b6-fbca-426b-be44-3ae6eaaa8996 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Usage tracker for resource:security_group_rule and tenant:b32a0178e35546828deb4b131cde3201 is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:53:38.978415 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-78da11b6-fbca-426b-be44-3ae6eaaa8996 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:53:38.984574 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-78da11b6-fbca-426b-be44-3ae6eaaa8996 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:53:39.086027 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-78da11b6-fbca-426b-be44-3ae6eaaa8996 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Notify callbacks [] for security_group_rule, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:39.154679 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-78da11b6-fbca-426b-be44-3ae6eaaa8996 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:39.238338 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-78da11b6-fbca-426b-be44-3ae6eaaa8996 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459369'] for security_group_rule, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:39.240663 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-4a1a9d8f-18a2-4853-a142-574fdf81bb92 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:53:39.267302 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78da11b6-fbca-426b-be44-3ae6eaaa8996 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=428e0a48-b477-4091-9104-5c2a6d1b5ec2,revision_number=0']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:53:39.270422 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-78da11b6-fbca-426b-be44-3ae6eaaa8996 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:53:39.347190 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-78da11b6-fbca-426b-be44-3ae6eaaa8996 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Notify callbacks [] for security_group_rule, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:39.348420 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-78da11b6-fbca-426b-be44-3ae6eaaa8996 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] 10.222.0.122 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.3884225
May 25 17:53:39.351273 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 49222) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:53:39.356459 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.v2.base [None req-878b76fc-b3c5-4722-bd5d-e127b3cbb8d2 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Request body: {'security_group_rule': {'security_group_id': 'd5b71c00-54cd-4760-821a-82059bd31db8', 'project_id': 'b32a0178e35546828deb4b131cde3201', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=99027) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:53:39.362668 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-878b76fc-b3c5-4722-bd5d-e127b3cbb8d2 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:53:39.366662 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-878b76fc-b3c5-4722-bd5d-e127b3cbb8d2 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Usage tracker for resource:security_group_rule and tenant:b32a0178e35546828deb4b131cde3201 is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:53:39.369624 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-878b76fc-b3c5-4722-bd5d-e127b3cbb8d2 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:53:39.375635 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-878b76fc-b3c5-4722-bd5d-e127b3cbb8d2 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:53:39.441414 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-878b76fc-b3c5-4722-bd5d-e127b3cbb8d2 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Notify callbacks [] for security_group_rule, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:39.484762 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device 00b1d19d-649f-4ed3-863e-f862f91d943b up at agent ovs-agent-dv-cinder-789564-2-iscsi {{(pid=99028) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 17:53:39.508968 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-878b76fc-b3c5-4722-bd5d-e127b3cbb8d2 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:39.555591 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Provisioning complete for port 00b1d19d-649f-4ed3-863e-f862f91d943b triggered by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 17:53:39.555967 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:39.577818 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-878b76fc-b3c5-4722-bd5d-e127b3cbb8d2 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459369'] for security_group_rule, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:39.579895 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:53:39.601880 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-878b76fc-b3c5-4722-bd5d-e127b3cbb8d2 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=4f6e3c64-bfec-4c66-ad21-1874007d708c,revision_number=0']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:53:39.605945 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-878b76fc-b3c5-4722-bd5d-e127b3cbb8d2 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:53:39.692835 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-878b76fc-b3c5-4722-bd5d-e127b3cbb8d2 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Notify callbacks [] for security_group_rule, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:39.694105 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-878b76fc-b3c5-4722-bd5d-e127b3cbb8d2 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] 10.222.0.122 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 768 time: 0.3419013
May 25 17:53:39.697426 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 49226) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:53:39.703184 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.v2.base [None req-84a62e88-88e6-4d72-9287-a0cb6972d56b tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Request body: {'security_group_rule': {'security_group_id': 'd5b71c00-54cd-4760-821a-82059bd31db8', 'project_id': 'b32a0178e35546828deb4b131cde3201', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=99026) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:53:39.709648 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-84a62e88-88e6-4d72-9287-a0cb6972d56b tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:53:39.714693 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-84a62e88-88e6-4d72-9287-a0cb6972d56b tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Usage tracker for resource:security_group_rule and tenant:b32a0178e35546828deb4b131cde3201 is out of sync, need to count used quota {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:53:39.717955 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-84a62e88-88e6-4d72-9287-a0cb6972d56b tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:53:39.724298 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-84a62e88-88e6-4d72-9287-a0cb6972d56b tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:53:39.829466 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.db.securitygroups_db [None req-84a62e88-88e6-4d72-9287-a0cb6972d56b tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Project b32a0178e35546828deb4b131cde3201 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted.
May 25 17:53:39.835937 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-84a62e88-88e6-4d72-9287-a0cb6972d56b tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Notify callbacks [] for security_group_rule, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:39.906628 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-84a62e88-88e6-4d72-9287-a0cb6972d56b tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:39.943373 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-531a6592-e334-429e-81b6-22c3843b2050 None None] Sync routers for ids ['9f3abaf6-6698-4faf-a235-07b94569540c'] in dv-cinder-789564-2-iscsi {{(pid=99029) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 25 17:53:39.952020 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_dvrscheduler_db [None req-531a6592-e334-429e-81b6-22c3843b2050 None None] Routers {'9f3abaf6-6698-4faf-a235-07b94569540c'} bound to L3 agent in host dv-cinder-789564-2-iscsi {{(pid=99029) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 17:53:39.952621 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_hamode_db [None req-531a6592-e334-429e-81b6-22c3843b2050 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcae703aca0>, 'dv-cinder-789564-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-25T17:34:21Z,description=<?>,heartbeat_timestamp=2021-05-25T17:53:21Z,host='dv-cinder-789564-2-iscsi',id=eaeb6875-c4ed-43b6-8658-aa4e52324fdf,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T17:34:21Z,topic='l3_agent')) {'router_ids': ['9f3abaf6-6698-4faf-a235-07b94569540c'], 'active': True} {{(pid=99029) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:53:39.981225 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-84a62e88-88e6-4d72-9287-a0cb6972d56b tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459369'] for security_group_rule, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:39.988371 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-a4ad2af0-d16c-4579-854a-7f56f7268f24 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:53:40.011576 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84a62e88-88e6-4d72-9287-a0cb6972d56b tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c0fcaa1d-03fc-4210-bd82-2fb70ce53374,revision_number=0']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:53:40.014114 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-84a62e88-88e6-4d72-9287-a0cb6972d56b tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:53:40.086458 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-84a62e88-88e6-4d72-9287-a0cb6972d56b tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Notify callbacks [] for security_group_rule, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:40.087683 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-84a62e88-88e6-4d72-9287-a0cb6972d56b tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] 10.222.0.122 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 774 time: 0.3892183
May 25 17:53:40.090437 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 49230) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:53:40.095672 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.v2.base [None req-5758d589-b5b1-4713-bde6-6c77a16258cd tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Request body: {'security_group_rule': {'security_group_id': 'd5b71c00-54cd-4760-821a-82059bd31db8', 'project_id': 'b32a0178e35546828deb4b131cde3201', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=99026) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:53:40.102416 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-5758d589-b5b1-4713-bde6-6c77a16258cd tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:53:40.106131 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-5758d589-b5b1-4713-bde6-6c77a16258cd tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Usage tracker for resource:security_group_rule and tenant:b32a0178e35546828deb4b131cde3201 is out of sync, need to count used quota {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:53:40.109285 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-5758d589-b5b1-4713-bde6-6c77a16258cd tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:53:40.115962 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-5758d589-b5b1-4713-bde6-6c77a16258cd tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:53:40.140478 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_dvr_db [None req-531a6592-e334-429e-81b6-22c3843b2050 None None] Set router 9f3abaf6-6698-4faf-a235-07b94569540c gateway port host: dv-cinder-789564-2-iscsi {{(pid=99029) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 17:53:40.184005 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.db.securitygroups_db [None req-5758d589-b5b1-4713-bde6-6c77a16258cd tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Project b32a0178e35546828deb4b131cde3201 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted.
May 25 17:53:40.190290 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-5758d589-b5b1-4713-bde6-6c77a16258cd tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Notify callbacks [] for security_group_rule, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:40.262669 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-5758d589-b5b1-4713-bde6-6c77a16258cd tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:40.314820 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-5758d589-b5b1-4713-bde6-6c77a16258cd tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459369'] for security_group_rule, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:40.317809 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:53:40.341865 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5758d589-b5b1-4713-bde6-6c77a16258cd tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a4136ca8-ea6e-450e-ac55-ac22a61ecc2a,revision_number=0']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:53:40.352374 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-5758d589-b5b1-4713-bde6-6c77a16258cd tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.035s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:53:40.428773 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-5758d589-b5b1-4713-bde6-6c77a16258cd tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Notify callbacks [] for security_group_rule, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:40.430176 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-5758d589-b5b1-4713-bde6-6c77a16258cd tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] 10.222.0.122 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 773 time: 0.3388226
May 25 17:53:40.458388 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_hamode_db [None req-531a6592-e334-429e-81b6-22c3843b2050 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcae703aca0>, [{'id': '9f3abaf6-6698-4faf-a235-07b94569540c', 'name': 'tempest-TestShelveInstance-2008156234-router', 'tenant_id': 'd440d92738fa475c889c19df3d828036', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.14'}], 'enable_snat': True}, 'gw_port_id': '00b1d19d-649f-4ed3-863e-f862f91d943b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:53:30Z', 'updated_at': '2021-05-25T17:53:35Z', 'revision_number': 4, 'project_id': 'd440d92738fa475c889c19df3d828036', 'gw_port': {'id': '00b1d19d-649f-4ed3-863e-f862f91d943b', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:5d:6e:b8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9f3abaf6-6698-4faf-a235-07b94569540c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 539, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.14', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:53:31Z', 'updated_at': '2021-05-25T17:53:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi', '_interfaces': [{'id': '755f4579-cae9-48c8-b5ad-a366ef203726', 'name': '', 'network_id': '137490af-32dc-4466-832c-959b96aa867d', 'tenant_id': 'd440d92738fa475c889c19df3d828036', 'mac_address': 'fa:16:3e:95:f9:aa', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9f3abaf6-6698-4faf-a235-07b94569540c', 'device_owner': 'network:router_interface', 'standard_attr_id': 540, 'fixed_ips': [{'subnet_id': 'fefe3428-f312-48c3-a442-12fb15c37143', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:53:34Z', 'updated_at': '2021-05-25T17:53:35Z', 'revision_number': 2, 'project_id': 'd440d92738fa475c889c19df3d828036', 'subnets': [{'id': 'fefe3428-f312-48c3-a442-12fb15c37143', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-789564-2-iscsi', False) {} {{(pid=99029) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:53:40.462601 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-531a6592-e334-429e-81b6-22c3843b2050 None None] Checking router: 9f3abaf6-6698-4faf-a235-07b94569540c for host: dv-cinder-789564-2-iscsi {{(pid=99029) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 25 17:53:40.462956 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-531a6592-e334-429e-81b6-22c3843b2050 None None] Updating router 9f3abaf6-6698-4faf-a235-07b94569540c port 755f4579-cae9-48c8-b5ad-a366ef203726 binding host dv-cinder-789564-2-iscsi {{(pid=99029) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 25 17:53:40.518467 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron_lib.callbacks.manager [None req-531a6592-e334-429e-81b6-22c3843b2050 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99029) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:40.862656 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron_lib.callbacks.manager [None req-531a6592-e334-429e-81b6-22c3843b2050 None None] Notify callbacks [] for port, precommit_update {{(pid=99029) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:40.874157 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.provisioning_blocks [None req-531a6592-e334-429e-81b6-22c3843b2050 None None] Transition to ACTIVE for port object 755f4579-cae9-48c8-b5ad-a366ef203726 will not be triggered until provisioned by entity L2. {{(pid=99029) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 17:53:40.946787 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron_lib.callbacks.manager [None req-531a6592-e334-429e-81b6-22c3843b2050 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99029) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:40.950719 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:53:41.076276 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3703660-749f-4f8a-9c4d-1acd9653f4a9 None None] Pushing event updated for resources: {'Port': ['ID=755f4579-cae9-48c8-b5ad-a366ef203726,revision_number=3']} {{(pid=99029) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:53:41.103174 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG oslo_concurrency.lockutils [None req-d3703660-749f-4f8a-9c4d-1acd9653f4a9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.152s {{(pid=99029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:53:41.170908 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.plugins.ml2.managers [None req-531a6592-e334-429e-81b6-22c3843b2050 None None] Attempting to bind port 755f4579-cae9-48c8-b5ad-a366ef203726 on host dv-cinder-789564-2-iscsi for vnic_type normal with profile  {{(pid=99029) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 17:53:41.171277 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.plugins.ml2.managers [None req-531a6592-e334-429e-81b6-22c3843b2050 None None] Attempting to bind port 755f4579-cae9-48c8-b5ad-a366ef203726 by drivers openvswitch,hyperv on host dv-cinder-789564-2-iscsi at level 0 using segments [{'id': '25860488-309b-44b3-a089-322389b1576c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1320, 'network_id': '137490af-32dc-4466-832c-959b96aa867d'}] {{(pid=99029) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 17:53:41.171693 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-531a6592-e334-429e-81b6-22c3843b2050 None None] Attempting to bind port 755f4579-cae9-48c8-b5ad-a366ef203726 on network 137490af-32dc-4466-832c-959b96aa867d {{(pid=99029) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 17:53:41.178906 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-531a6592-e334-429e-81b6-22c3843b2050 None None] Checking agent: {'id': '7bb67520-1e97-4ad9-9b97-101068bbe1a3', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-789564-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 17, 34, 21), 'started_at': datetime.datetime(2021, 5, 25, 17, 34, 51), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 17, 53, 21), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-789564-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=99029) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 17:53:41.181842 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-531a6592-e334-429e-81b6-22c3843b2050 None None] Checking segment: {'id': '25860488-309b-44b3-a089-322389b1576c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1320, 'network_id': '137490af-32dc-4466-832c-959b96aa867d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=99029) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 17:53:41.181842 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron_lib.callbacks.manager [None req-531a6592-e334-429e-81b6-22c3843b2050 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=99029) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:41.181842 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-531a6592-e334-429e-81b6-22c3843b2050 None None] Bound using segment: {'id': '25860488-309b-44b3-a089-322389b1576c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1320, 'network_id': '137490af-32dc-4466-832c-959b96aa867d'} {{(pid=99029) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 17:53:41.181842 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.plugins.ml2.managers [None req-531a6592-e334-429e-81b6-22c3843b2050 None None] Bound port: 755f4579-cae9-48c8-b5ad-a366ef203726, host: dv-cinder-789564-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '25860488-309b-44b3-a089-322389b1576c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1320, 'network_id': '137490af-32dc-4466-832c-959b96aa867d'}}] {{(pid=99029) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 17:53:41.181842 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron_lib.callbacks.manager [None req-531a6592-e334-429e-81b6-22c3843b2050 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99029) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:41.269766 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.plugins.ml2.db [None req-531a6592-e334-429e-81b6-22c3843b2050 None None] For port 755f4579-cae9-48c8-b5ad-a366ef203726, host dv-cinder-789564-2-iscsi, cleared binding levels {{(pid=99029) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 17:53:41.272764 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.plugins.ml2.db [None req-531a6592-e334-429e-81b6-22c3843b2050 None None] For port 755f4579-cae9-48c8-b5ad-a366ef203726, host dv-cinder-789564-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=755f4579-cae9-48c8-b5ad-a366ef203726,segment=NetworkSegment(25860488-309b-44b3-a089-322389b1576c),segment_id=25860488-309b-44b3-a089-322389b1576c)] {{(pid=99029) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 17:53:41.355259 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron_lib.callbacks.manager [None req-531a6592-e334-429e-81b6-22c3843b2050 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99029) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:41.359399 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG oslo_concurrency.lockutils [None req-ee6bfbab-b432-47be-ac64-8a014a796be8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:53:41.457214 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_dvrscheduler_db [None req-531a6592-e334-429e-81b6-22c3843b2050 None None] Routers {'9f3abaf6-6698-4faf-a235-07b94569540c'} bound to L3 agent in host dv-cinder-789564-2-iscsi {{(pid=99029) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 17:53:41.458037 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_hamode_db [None req-531a6592-e334-429e-81b6-22c3843b2050 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcae703aca0>, 'dv-cinder-789564-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-25T17:34:21Z,description=<?>,heartbeat_timestamp=2021-05-25T17:53:21Z,host='dv-cinder-789564-2-iscsi',id=eaeb6875-c4ed-43b6-8658-aa4e52324fdf,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T17:34:21Z,topic='l3_agent')) {'router_ids': ['9f3abaf6-6698-4faf-a235-07b94569540c'], 'active': True} {{(pid=99029) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:53:41.604409 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:41.624651 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3703660-749f-4f8a-9c4d-1acd9653f4a9 None None] Pushing event updated for resources: {'Port': ['ID=755f4579-cae9-48c8-b5ad-a366ef203726,revision_number=4']} {{(pid=99029) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:53:41.631330 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG oslo_concurrency.lockutils [None req-d3703660-749f-4f8a-9c4d-1acd9653f4a9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.272s {{(pid=99029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:53:41.659564 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_dvr_db [None req-531a6592-e334-429e-81b6-22c3843b2050 None None] Set router 9f3abaf6-6698-4faf-a235-07b94569540c gateway port host: dv-cinder-789564-2-iscsi {{(pid=99029) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 17:53:41.983425 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_hamode_db [None req-531a6592-e334-429e-81b6-22c3843b2050 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcae703aca0>, [{'id': '9f3abaf6-6698-4faf-a235-07b94569540c', 'name': 'tempest-TestShelveInstance-2008156234-router', 'tenant_id': 'd440d92738fa475c889c19df3d828036', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.14'}], 'enable_snat': True}, 'gw_port_id': '00b1d19d-649f-4ed3-863e-f862f91d943b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:53:30Z', 'updated_at': '2021-05-25T17:53:35Z', 'revision_number': 4, 'project_id': 'd440d92738fa475c889c19df3d828036', 'gw_port': {'id': '00b1d19d-649f-4ed3-863e-f862f91d943b', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:5d:6e:b8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9f3abaf6-6698-4faf-a235-07b94569540c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 539, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.14', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:53:31Z', 'updated_at': '2021-05-25T17:53:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi', '_interfaces': [{'id': '755f4579-cae9-48c8-b5ad-a366ef203726', 'name': '', 'network_id': '137490af-32dc-4466-832c-959b96aa867d', 'tenant_id': 'd440d92738fa475c889c19df3d828036', 'mac_address': 'fa:16:3e:95:f9:aa', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9f3abaf6-6698-4faf-a235-07b94569540c', 'device_owner': 'network:router_interface', 'standard_attr_id': 540, 'fixed_ips': [{'subnet_id': 'fefe3428-f312-48c3-a442-12fb15c37143', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:53:34Z', 'updated_at': '2021-05-25T17:53:41Z', 'revision_number': 4, 'project_id': 'd440d92738fa475c889c19df3d828036', 'subnets': [{'id': 'fefe3428-f312-48c3-a442-12fb15c37143', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-789564-2-iscsi', False) {} {{(pid=99029) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:53:41.987950 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-531a6592-e334-429e-81b6-22c3843b2050 None None] The sync data for ids ['9f3abaf6-6698-4faf-a235-07b94569540c'] in dv-cinder-789564-2-iscsi is: [{'id': '9f3abaf6-6698-4faf-a235-07b94569540c', 'name': 'tempest-TestShelveInstance-2008156234-router', 'tenant_id': 'd440d92738fa475c889c19df3d828036', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.14'}], 'enable_snat': True}, 'gw_port_id': '00b1d19d-649f-4ed3-863e-f862f91d943b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:53:30Z', 'updated_at': '2021-05-25T17:53:35Z', 'revision_number': 4, 'project_id': 'd440d92738fa475c889c19df3d828036', 'gw_port': {'id': '00b1d19d-649f-4ed3-863e-f862f91d943b', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:5d:6e:b8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9f3abaf6-6698-4faf-a235-07b94569540c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 539, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.14', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:53:31Z', 'updated_at': '2021-05-25T17:53:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi', '_interfaces': [{'id': '755f4579-cae9-48c8-b5ad-a366ef203726', 'name': '', 'network_id': '137490af-32dc-4466-832c-959b96aa867d', 'tenant_id': 'd440d92738fa475c889c19df3d828036', 'mac_address': 'fa:16:3e:95:f9:aa', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9f3abaf6-6698-4faf-a235-07b94569540c', 'device_owner': 'network:router_interface', 'standard_attr_id': 540, 'fixed_ips': [{'subnet_id': 'fefe3428-f312-48c3-a442-12fb15c37143', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:53:34Z', 'updated_at': '2021-05-25T17:53:41Z', 'revision_number': 4, 'project_id': 'd440d92738fa475c889c19df3d828036', 'subnets': [{'id': 'fefe3428-f312-48c3-a442-12fb15c37143', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=99029) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 25 17:53:43.526658 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device 755f4579-cae9-48c8-b5ad-a366ef203726 up at agent ovs-agent-dv-cinder-789564-2-iscsi {{(pid=99028) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 17:53:43.657624 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Provisioning for port 755f4579-cae9-48c8-b5ad-a366ef203726 completed by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 17:53:43.663703 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Provisioning complete for port 755f4579-cae9-48c8-b5ad-a366ef203726 triggered by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 17:53:43.664128 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:43.767077 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.agents_db [None req-14fae233-15dc-4576-836b-621c5f95b584 None None] Agent healthcheck: found 6 active agents {{(pid=99029) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 17:53:43.796493 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:43.839580 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] For port 755f4579-cae9-48c8-b5ad-a366ef203726, host dv-cinder-789564-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=755f4579-cae9-48c8-b5ad-a366ef203726,segment=NetworkSegment(25860488-309b-44b3-a089-322389b1576c),segment_id=25860488-309b-44b3-a089-322389b1576c)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:53:43.995130 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:43.997884 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:53:44.080996 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Pushing event updated for resources: {'Port': ['ID=755f4579-cae9-48c8-b5ad-a366ef203726,revision_number=5']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:53:44.084939 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:53:45.488031 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device 755f4579-cae9-48c8-b5ad-a366ef203726 up at agent ovs-agent-dv-cinder-789564-2-iscsi {{(pid=99028) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 17:53:45.585426 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Provisioning complete for port 755f4579-cae9-48c8-b5ad-a366ef203726 triggered by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 17:53:45.585722 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:46.013654 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-8975c71c-24dd-4c45-89e5-eefe4f17567b req-f2a411e0-d027-4956-a532-73605bc077fc service neutron] 10.222.0.125 "GET /v2.0/ports?device_id=00d13d2c-33fc-42ec-a80d-4cd8155b6fe1&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.1036830
May 25 17:53:46.121246 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8975c71c-24dd-4c45-89e5-eefe4f17567b req-7b5eaa3b-a1fb-4c9b-8848-48f9e8fed42d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:53:46.122887 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-8975c71c-24dd-4c45-89e5-eefe4f17567b req-7b5eaa3b-a1fb-4c9b-8848-48f9e8fed42d service neutron] 10.222.0.125 "GET /v2.0/ports?tenant_id=cf02997eda314aee8fb322add2fbb921&device_id=00d13d2c-33fc-42ec-a80d-4cd8155b6fe1 HTTP/1.1" status: 200  len: 1098 time: 0.0841179
May 25 17:53:46.308011 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8975c71c-24dd-4c45-89e5-eefe4f17567b req-84e5c2a8-db48-49bf-8508-8aa7f4119c5b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:53:46.309545 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-8975c71c-24dd-4c45-89e5-eefe4f17567b req-84e5c2a8-db48-49bf-8508-8aa7f4119c5b service neutron] 10.222.0.125 "GET /v2.0/networks?id=45b850af-d423-458a-855a-d7f828a11fff HTTP/1.1" status: 200  len: 919 time: 0.1673064
May 25 17:53:46.418610 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-8975c71c-24dd-4c45-89e5-eefe4f17567b req-d1e7c266-664a-4ebd-a12b-6ea3d0721c3e service neutron] 10.222.0.125 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=5c96172a-06f4-41ce-b47a-f1bbde47e41c HTTP/1.1" status: 200  len: 999 time: 0.1005759
May 25 17:53:46.487947 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8975c71c-24dd-4c45-89e5-eefe4f17567b req-f83b462a-17de-42d5-aa65-219f9e48c72f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:53:46.489443 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-8975c71c-24dd-4c45-89e5-eefe4f17567b req-f83b462a-17de-42d5-aa65-219f9e48c72f service neutron] 10.222.0.125 "GET /v2.0/subnets?id=704d0a85-ee4f-4df2-90a3-a525dfe28461 HTTP/1.1" status: 200  len: 856 time: 0.0651894
May 25 17:53:46.571122 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8975c71c-24dd-4c45-89e5-eefe4f17567b req-fd36f59f-ca8c-459a-b50d-413b38fed598 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:53:46.572506 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-8975c71c-24dd-4c45-89e5-eefe4f17567b req-fd36f59f-ca8c-459a-b50d-413b38fed598 service neutron] 10.222.0.125 "GET /v2.0/ports?network_id=45b850af-d423-458a-855a-d7f828a11fff&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0779476
May 25 17:53:46.824693 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-8975c71c-24dd-4c45-89e5-eefe4f17567b req-5ece4a35-d2e2-4ca7-879f-4e6cc3cef3f9 service neutron] 10.222.0.125 "GET /v2.0/networks/45b850af-d423-458a-855a-d7f828a11fff?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2424324
May 25 17:53:46.992095 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-8975c71c-24dd-4c45-89e5-eefe4f17567b req-de5a1afc-a126-494a-8983-f6689d91d17a service neutron] 10.222.0.125 "GET /v2.0/networks/45b850af-d423-458a-855a-d7f828a11fff?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1592562
May 25 17:53:48.137769 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-666f9ddf-8af7-45a9-bdb1-78a8f29ff0a8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:50.683916 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-65952af8-d7ce-4a5d-bad3-c643153f2b8d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:50.855705 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:51.732206 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-7e261f94-b84f-443e-be49-3bc1ac903b55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:51.975224 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fd17c9a-2e35-44c0-9bec-aa145d3726a8 req-90d0a632-85bb-477d-828a-c3a4a4cdb2fe tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:53:51.976680 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-2fd17c9a-2e35-44c0-9bec-aa145d3726a8 req-90d0a632-85bb-477d-828a-c3a4a4cdb2fe tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.122 "GET /v2.0/ports?device_id=00d13d2c-33fc-42ec-a80d-4cd8155b6fe1 HTTP/1.1" status: 200  len: 945 time: 0.0821805
May 25 17:53:52.026407 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-2fd17c9a-2e35-44c0-9bec-aa145d3726a8 req-9c710bde-4cf8-409a-8459-e873a9d05113 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.122 "GET /v2.0/security-groups?id=fa654e78-f61f-461b-b301-3690d1826946&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0441296
May 25 17:53:52.272892 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16308b26-cbc3-4ff3-8037-9803c024ba1c req-3aa46095-f357-4021-8412-233753919209 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:53:52.274729 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-16308b26-cbc3-4ff3-8037-9803c024ba1c req-3aa46095-f357-4021-8412-233753919209 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.125 "GET /v2.0/ports?device_id=00d13d2c-33fc-42ec-a80d-4cd8155b6fe1 HTTP/1.1" status: 200  len: 945 time: 0.0842223
May 25 17:53:52.433036 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.plugin [req-16308b26-cbc3-4ff3-8037-9803c024ba1c req-4266a099-8968-4b40-afd3-3d93c86a8c1a tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Deleting port 5c96172a-06f4-41ce-b47a-f1bbde47e41c {{(pid=99026) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 17:53:52.433402 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [req-16308b26-cbc3-4ff3-8037-9803c024ba1c req-4266a099-8968-4b40-afd3-3d93c86a8c1a tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781841220419'] for port, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:52.572328 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.db [req-16308b26-cbc3-4ff3-8037-9803c024ba1c req-4266a099-8968-4b40-afd3-3d93c86a8c1a tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] For port 5c96172a-06f4-41ce-b47a-f1bbde47e41c, host hv-cinder-78956, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=5c96172a-06f4-41ce-b47a-f1bbde47e41c,segment=NetworkSegment(e9a4953c-bd2f-4412-9030-8eb2cd20f5c5),segment_id=e9a4953c-bd2f-4412-9030-8eb2cd20f5c5)] {{(pid=99026) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:53:52.572684 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [req-16308b26-cbc3-4ff3-8037-9803c024ba1c req-4266a099-8968-4b40-afd3-3d93c86a8c1a tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-418810'] for port, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:52.866691 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [req-16308b26-cbc3-4ff3-8037-9803c024ba1c req-4266a099-8968-4b40-afd3-3d93c86a8c1a tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify callbacks [] for floatingip, precommit_update {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:52.867059 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [req-16308b26-cbc3-4ff3-8037-9803c024ba1c req-4266a099-8968-4b40-afd3-3d93c86a8c1a tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-419865'] for floatingip, after_update {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:52.867372 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.db.l3_db [req-16308b26-cbc3-4ff3-8037-9803c024ba1c req-4266a099-8968-4b40-afd3-3d93c86a8c1a tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Floating IP 2ae45669-5f60-40fd-ab29-1b1d8f4ca2b9 disassociated. External IP: 172.27.3.6, port: 5c96172a-06f4-41ce-b47a-f1bbde47e41c.
May 25 17:53:52.867707 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.plugin [req-16308b26-cbc3-4ff3-8037-9803c024ba1c req-4266a099-8968-4b40-afd3-3d93c86a8c1a tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Calling delete_port for 5c96172a-06f4-41ce-b47a-f1bbde47e41c owned by compute:nova {{(pid=99026) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 17:53:53.023336 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [req-16308b26-cbc3-4ff3-8037-9803c024ba1c req-4266a099-8968-4b40-afd3-3d93c86a8c1a tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781841222566', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781840788188', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15476536'] for port, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:53.028909 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-5dc948ed-65f6-4093-9c0a-0ef1d1b8aab3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:53:53.073961 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4266a099-8968-4b40-afd3-3d93c86a8c1a tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Pushing event deleted for resources: {'Port': ['ID=5c96172a-06f4-41ce-b47a-f1bbde47e41c,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:53:53.085956 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4266a099-8968-4b40-afd3-3d93c86a8c1a tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:53:53.086304 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4266a099-8968-4b40-afd3-3d93c86a8c1a tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:53:53.086666 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4266a099-8968-4b40-afd3-3d93c86a8c1a tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:53:53.087030 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4266a099-8968-4b40-afd3-3d93c86a8c1a tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:53:53.087399 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4266a099-8968-4b40-afd3-3d93c86a8c1a tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:53:53.087753 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4266a099-8968-4b40-afd3-3d93c86a8c1a tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:53:53.088112 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4266a099-8968-4b40-afd3-3d93c86a8c1a tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:53:53.088472 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4266a099-8968-4b40-afd3-3d93c86a8c1a tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:53:53.088823 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4266a099-8968-4b40-afd3-3d93c86a8c1a tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:53:53.089206 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4266a099-8968-4b40-afd3-3d93c86a8c1a tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:53:53.089562 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4266a099-8968-4b40-afd3-3d93c86a8c1a tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:53:53.089912 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4266a099-8968-4b40-afd3-3d93c86a8c1a tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:53:53.093789 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-4266a099-8968-4b40-afd3-3d93c86a8c1a tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.065s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:53:53.203251 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-ef41c72f-1acd-4242-942d-f7a92a3f7721 req-49629629-7086-47fb-97a1-7af13a30131f tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.122 "GET /v2.0/ports?device_id=00d13d2c-33fc-42ec-a80d-4cd8155b6fe1 HTTP/1.1" status: 200  len: 210 time: 0.0458252
May 25 17:53:53.286788 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.scheduler.l3_agent_scheduler [req-16308b26-cbc3-4ff3-8037-9803c024ba1c req-4266a099-8968-4b40-afd3-3d93c86a8c1a tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Router 3ca50ec5-218d-44ad-8ffc-4318f54d7350 has already been hosted by L3 agent eaeb6875-c4ed-43b6-8658-aa4e52324fdf {{(pid=99026) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 25 17:53:53.335187 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-6df2b2a7-a54e-4d57-9be3-033078b9d5b3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:53.463548 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-16308b26-cbc3-4ff3-8037-9803c024ba1c req-4266a099-8968-4b40-afd3-3d93c86a8c1a tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify agent at l3_agent.dv-cinder-789564-2-iscsi the message routers_updated {{(pid=99026) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 25 17:53:53.472637 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f3e4fe4a-359a-423c-8d9d-974601f379f9 None None] Sync routers for ids ['3ca50ec5-218d-44ad-8ffc-4318f54d7350'] in dv-cinder-789564-2-iscsi {{(pid=99028) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 25 17:53:53.481797 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f3e4fe4a-359a-423c-8d9d-974601f379f9 None None] Routers {'3ca50ec5-218d-44ad-8ffc-4318f54d7350'} bound to L3 agent in host dv-cinder-789564-2-iscsi {{(pid=99028) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 17:53:53.482448 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-f3e4fe4a-359a-423c-8d9d-974601f379f9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcae71766a0>, 'dv-cinder-789564-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T17:34:21Z,description=<?>,heartbeat_timestamp=2021-05-25T17:53:51Z,host='dv-cinder-789564-2-iscsi',id=eaeb6875-c4ed-43b6-8658-aa4e52324fdf,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T17:34:21Z,topic='l3_agent')) {'router_ids': ['3ca50ec5-218d-44ad-8ffc-4318f54d7350'], 'active': True} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:53:53.642246 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.l3_dvrscheduler_db [req-16308b26-cbc3-4ff3-8037-9803c024ba1c req-4266a099-8968-4b40-afd3-3d93c86a8c1a tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] No DVR routers for this DVR port 5c96172a-06f4-41ce-b47a-f1bbde47e41c on host hv-cinder-78956 {{(pid=99026) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 25 17:53:53.645514 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [req-16308b26-cbc3-4ff3-8037-9803c024ba1c req-4266a099-8968-4b40-afd3-3d93c86a8c1a tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-239387'] for port, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:53.649671 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '00d13d2c-33fc-42ec-a80d-4cd8155b6fe1', 'name': 'network-vif-deleted', 'tag': '5c96172a-06f4-41ce-b47a-f1bbde47e41c'}] {{(pid=99026) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 17:53:53.668970 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvr_db [None req-f3e4fe4a-359a-423c-8d9d-974601f379f9 None None] Set router 3ca50ec5-218d-44ad-8ffc-4318f54d7350 gateway port host: dv-cinder-789564-2-iscsi {{(pid=99028) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 17:53:53.738214 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '00d13d2c-33fc-42ec-a80d-4cd8155b6fe1', 'name': 'network-vif-deleted', 'tag': '5c96172a-06f4-41ce-b47a-f1bbde47e41c', 'status': 'completed', 'code': 200}
May 25 17:53:53.741936 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-16308b26-cbc3-4ff3-8037-9803c024ba1c req-4266a099-8968-4b40-afd3-3d93c86a8c1a tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.125 "DELETE /v2.0/ports/5c96172a-06f4-41ce-b47a-f1bbde47e41c HTTP/1.1" status: 204  len: 173 time: 1.4633238
May 25 17:53:53.985779 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-f3e4fe4a-359a-423c-8d9d-974601f379f9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcae71766a0>, [{'id': '3ca50ec5-218d-44ad-8ffc-4318f54d7350', 'name': 'tempest-AttachVolumeShelveTestJSON-2113890446-router', 'tenant_id': 'cf02997eda314aee8fb322add2fbb921', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.226'}], 'enable_snat': True}, 'gw_port_id': '1e97124a-073a-4947-a6f2-359fb12ffe5e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:43:31Z', 'updated_at': '2021-05-25T17:43:37Z', 'revision_number': 4, 'project_id': 'cf02997eda314aee8fb322add2fbb921', 'gw_port': {'id': '1e97124a-073a-4947-a6f2-359fb12ffe5e', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:c8:ed:c5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3ca50ec5-218d-44ad-8ffc-4318f54d7350', 'device_owner': 'network:router_gateway', 'standard_attr_id': 244, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.226', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:43:33Z', 'updated_at': '2021-05-25T17:43:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi', '_interfaces': [{'id': 'ada7bf8b-4ba6-4629-8693-a2574922e458', 'name': '', 'network_id': '45b850af-d423-458a-855a-d7f828a11fff', 'tenant_id': 'cf02997eda314aee8fb322add2fbb921', 'mac_address': 'fa:16:3e:59:34:b7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3ca50ec5-218d-44ad-8ffc-4318f54d7350', 'device_owner': 'network:router_interface', 'standard_attr_id': 255, 'fixed_ips': [{'subnet_id': '704d0a85-ee4f-4df2-90a3-a525dfe28461', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:43:37Z', 'updated_at': '2021-05-25T17:43:45Z', 'revision_number': 5, 'project_id': 'cf02997eda314aee8fb322add2fbb921', 'subnets': [{'id': '704d0a85-ee4f-4df2-90a3-a525dfe28461', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-789564-2-iscsi', False) {} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:53:53.990133 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f3e4fe4a-359a-423c-8d9d-974601f379f9 None None] Checking router: 3ca50ec5-218d-44ad-8ffc-4318f54d7350 for host: dv-cinder-789564-2-iscsi {{(pid=99028) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 25 17:53:53.998421 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f3e4fe4a-359a-423c-8d9d-974601f379f9 None None] Routers {'3ca50ec5-218d-44ad-8ffc-4318f54d7350'} bound to L3 agent in host dv-cinder-789564-2-iscsi {{(pid=99028) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 17:53:54.002771 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-f3e4fe4a-359a-423c-8d9d-974601f379f9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcae71766a0>, 'dv-cinder-789564-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T17:34:21Z,description=<?>,heartbeat_timestamp=2021-05-25T17:53:51Z,host='dv-cinder-789564-2-iscsi',id=eaeb6875-c4ed-43b6-8658-aa4e52324fdf,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T17:34:21Z,topic='l3_agent')) {'router_ids': ['3ca50ec5-218d-44ad-8ffc-4318f54d7350'], 'active': True} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:53:54.194136 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvr_db [None req-f3e4fe4a-359a-423c-8d9d-974601f379f9 None None] Set router 3ca50ec5-218d-44ad-8ffc-4318f54d7350 gateway port host: dv-cinder-789564-2-iscsi {{(pid=99028) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 17:53:54.376674 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [req-299f1c66-49bb-44d1-a895-a6916225cb27 req-827e6941-2f66-4b2a-8c8e-a167754ef2cc tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Synchronizing usage tracker for tenant:cf02997eda314aee8fb322add2fbb921 on resource:port {{(pid=99026) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 17:53:54.450002 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [req-299f1c66-49bb-44d1-a895-a6916225cb27 req-827e6941-2f66-4b2a-8c8e-a167754ef2cc tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Unset dirty status for tenant:cf02997eda314aee8fb322add2fbb921 on resource:port {{(pid=99026) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 17:53:54.451233 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-299f1c66-49bb-44d1-a895-a6916225cb27 req-827e6941-2f66-4b2a-8c8e-a167754ef2cc tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.122 "GET /v2.0/ports?device_id=00d13d2c-33fc-42ec-a80d-4cd8155b6fe1 HTTP/1.1" status: 200  len: 210 time: 0.1189866
May 25 17:53:54.510884 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-f3e4fe4a-359a-423c-8d9d-974601f379f9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcae71766a0>, [{'id': '3ca50ec5-218d-44ad-8ffc-4318f54d7350', 'name': 'tempest-AttachVolumeShelveTestJSON-2113890446-router', 'tenant_id': 'cf02997eda314aee8fb322add2fbb921', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.226'}], 'enable_snat': True}, 'gw_port_id': '1e97124a-073a-4947-a6f2-359fb12ffe5e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:43:31Z', 'updated_at': '2021-05-25T17:43:37Z', 'revision_number': 4, 'project_id': 'cf02997eda314aee8fb322add2fbb921', 'gw_port': {'id': '1e97124a-073a-4947-a6f2-359fb12ffe5e', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:c8:ed:c5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3ca50ec5-218d-44ad-8ffc-4318f54d7350', 'device_owner': 'network:router_gateway', 'standard_attr_id': 244, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.226', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:43:33Z', 'updated_at': '2021-05-25T17:43:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi', '_interfaces': [{'id': 'ada7bf8b-4ba6-4629-8693-a2574922e458', 'name': '', 'network_id': '45b850af-d423-458a-855a-d7f828a11fff', 'tenant_id': 'cf02997eda314aee8fb322add2fbb921', 'mac_address': 'fa:16:3e:59:34:b7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3ca50ec5-218d-44ad-8ffc-4318f54d7350', 'device_owner': 'network:router_interface', 'standard_attr_id': 255, 'fixed_ips': [{'subnet_id': '704d0a85-ee4f-4df2-90a3-a525dfe28461', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:43:37Z', 'updated_at': '2021-05-25T17:43:45Z', 'revision_number': 5, 'project_id': 'cf02997eda314aee8fb322add2fbb921', 'subnets': [{'id': '704d0a85-ee4f-4df2-90a3-a525dfe28461', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-789564-2-iscsi', False) {} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:53:54.514854 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f3e4fe4a-359a-423c-8d9d-974601f379f9 None None] The sync data for ids ['3ca50ec5-218d-44ad-8ffc-4318f54d7350'] in dv-cinder-789564-2-iscsi is: [{'id': '3ca50ec5-218d-44ad-8ffc-4318f54d7350', 'name': 'tempest-AttachVolumeShelveTestJSON-2113890446-router', 'tenant_id': 'cf02997eda314aee8fb322add2fbb921', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.226'}], 'enable_snat': True}, 'gw_port_id': '1e97124a-073a-4947-a6f2-359fb12ffe5e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:43:31Z', 'updated_at': '2021-05-25T17:43:37Z', 'revision_number': 4, 'project_id': 'cf02997eda314aee8fb322add2fbb921', 'gw_port': {'id': '1e97124a-073a-4947-a6f2-359fb12ffe5e', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:c8:ed:c5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3ca50ec5-218d-44ad-8ffc-4318f54d7350', 'device_owner': 'network:router_gateway', 'standard_attr_id': 244, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.226', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:43:33Z', 'updated_at': '2021-05-25T17:43:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi', '_interfaces': [{'id': 'ada7bf8b-4ba6-4629-8693-a2574922e458', 'name': '', 'network_id': '45b850af-d423-458a-855a-d7f828a11fff', 'tenant_id': 'cf02997eda314aee8fb322add2fbb921', 'mac_address': 'fa:16:3e:59:34:b7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3ca50ec5-218d-44ad-8ffc-4318f54d7350', 'device_owner': 'network:router_interface', 'standard_attr_id': 255, 'fixed_ips': [{'subnet_id': '704d0a85-ee4f-4df2-90a3-a525dfe28461', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:43:37Z', 'updated_at': '2021-05-25T17:43:45Z', 'revision_number': 5, 'project_id': 'cf02997eda314aee8fb322add2fbb921', 'subnets': [{'id': '704d0a85-ee4f-4df2-90a3-a525dfe28461', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=99028) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 25 17:53:54.741034 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1b679533-4fb5-4634-94ab-f4d26e9b7cdd None None] New status for floating IP 2ae45669-5f60-40fd-ab29-1b1d8f4ca2b9: DOWN {{(pid=99029) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 25 17:53:55.715813 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 49374) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:53:55.787347 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-db6399af-0e56-4071-bc38-5df3afccdac6 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify callbacks [] for security_group, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:55.816191 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-db6399af-0e56-4071-bc38-5df3afccdac6 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify callbacks [] for security_group, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:55.930032 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-db6399af-0e56-4071-bc38-5df3afccdac6 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:55.935292 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-cbc415d0-be12-4382-ab19-3a069ca277be admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:53:55.951199 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db6399af-0e56-4071-bc38-5df3afccdac6 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=fa654e78-f61f-461b-b301-3690d1826946,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:53:55.953805 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-db6399af-0e56-4071-bc38-5df3afccdac6 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:53:56.016530 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-db6399af-0e56-4071-bc38-5df3afccdac6 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify callbacks [] for security_group, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:56.018284 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-db6399af-0e56-4071-bc38-5df3afccdac6 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.122 "DELETE /v2.0/security-groups/fa654e78-f61f-461b-b301-3690d1826946 HTTP/1.1" status: 204  len: 168 time: 0.3009312
May 25 17:53:56.020829 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 49380) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:53:56.036603 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.api.v2.resource [None req-652c7c1a-7fa6-489d-9595-f443589b33af tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] show failed (client error): The resource could not be found.
May 25 17:53:56.037602 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-652c7c1a-7fa6-489d-9595-f443589b33af tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.122 "GET /v2.0/security-groups/fa654e78-f61f-461b-b301-3690d1826946 HTTP/1.1" status: 404  len: 347 time: 0.0158601
May 25 17:53:56.040411 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 49384) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:53:56.284167 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.plugin [None req-f98f0001-a576-4715-a267-be54c8fb743f tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Deleting port 89860521-7707-4358-ae75-85fa1eb2c669 {{(pid=99026) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 17:53:56.284507 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-f98f0001-a576-4715-a267-be54c8fb743f tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781841220419'] for port, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:56.401455 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-f98f0001-a576-4715-a267-be54c8fb743f tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-418810'] for port, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:56.401704 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-f98f0001-a576-4715-a267-be54c8fb743f tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:56.525599 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.plugin [None req-f98f0001-a576-4715-a267-be54c8fb743f tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Calling delete_port for 89860521-7707-4358-ae75-85fa1eb2c669 owned by network:floatingip {{(pid=99026) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 17:53:56.695614 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-f98f0001-a576-4715-a267-be54c8fb743f tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781841222566', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781840788188', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15476536'] for port, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:56.699231 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:53:56.744846 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f98f0001-a576-4715-a267-be54c8fb743f tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Pushing event deleted for resources: {'Port': ['ID=89860521-7707-4358-ae75-85fa1eb2c669,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:53:56.748029 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-f98f0001-a576-4715-a267-be54c8fb743f tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:53:56.838831 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-f98f0001-a576-4715-a267-be54c8fb743f tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify callbacks [] for floatingip, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:56.906918 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-f98f0001-a576-4715-a267-be54c8fb743f tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-239387'] for floatingip, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:56.909303 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-f98f0001-a576-4715-a267-be54c8fb743f tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.122 "DELETE /v2.0/floatingips/2ae45669-5f60-40fd-ab29-1b1d8f4ca2b9 HTTP/1.1" status: 204  len: 168 time: 0.8678987
May 25 17:53:57.073888 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-d2f9c9e8-4005-40f5-977b-95eea7e11bd8 req-c63ed11c-8471-4f94-a207-5d631ce28434 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Synchronizing usage tracker for tenant:b32a0178e35546828deb4b131cde3201 on resource:security_group {{(pid=99027) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 17:53:57.149207 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-d2f9c9e8-4005-40f5-977b-95eea7e11bd8 req-c63ed11c-8471-4f94-a207-5d631ce28434 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Unset dirty status for tenant:b32a0178e35546828deb4b131cde3201 on resource:security_group {{(pid=99027) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 17:53:57.150396 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-d2f9c9e8-4005-40f5-977b-95eea7e11bd8 req-c63ed11c-8471-4f94-a207-5d631ce28434 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] 10.222.0.122 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-415427174&fields=id&tenant_id=b32a0178e35546828deb4b131cde3201 HTTP/1.1" status: 200  len: 267 time: 0.1187172
May 25 17:53:57.282569 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 49400) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:53:57.288674 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.v2.base [None req-70d62fe6-c08b-4330-aa2c-9c2e3e545227 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1067122059', 'description': 'tempest-description--635303597'}} {{(pid=99026) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:53:57.294505 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-70d62fe6-c08b-4330-aa2c-9c2e3e545227 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:53:57.298644 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-70d62fe6-c08b-4330-aa2c-9c2e3e545227 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Usage tracker for resource:security_group and tenant:cf02997eda314aee8fb322add2fbb921 is out of sync, need to count used quota {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:53:57.301665 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-70d62fe6-c08b-4330-aa2c-9c2e3e545227 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:53:57.307355 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-70d62fe6-c08b-4330-aa2c-9c2e3e545227 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:53:57.315686 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2f9c9e8-4005-40f5-977b-95eea7e11bd8 req-e99d62ec-37f0-4db0-b18d-c075e8b90bc8 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:53:57.317360 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-d2f9c9e8-4005-40f5-977b-95eea7e11bd8 req-e99d62ec-37f0-4db0-b18d-c075e8b90bc8 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] 10.222.0.122 "GET /v2.0/networks?id=0293f9ff-afda-47ba-aab9-1aac8ea6403d HTTP/1.1" status: 200  len: 808 time: 0.1599264
May 25 17:53:57.333045 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-d2f9c9e8-4005-40f5-977b-95eea7e11bd8 req-e0df14d4-d8a5-466d-bc73-330f13d735f8 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] 10.222.0.122 "GET /v2.0/quotas/b32a0178e35546828deb4b131cde3201 HTTP/1.1" status: 200  len: 375 time: 0.0101161
May 25 17:53:57.362000 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-70d62fe6-c08b-4330-aa2c-9c2e3e545227 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify callbacks [] for security_group, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:57.383783 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-70d62fe6-c08b-4330-aa2c-9c2e3e545227 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:53:57.387823 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-70d62fe6-c08b-4330-aa2c-9c2e3e545227 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Usage tracker for resource:security_group_rule and tenant:cf02997eda314aee8fb322add2fbb921 is out of sync, need to count used quota {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:53:57.390812 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-70d62fe6-c08b-4330-aa2c-9c2e3e545227 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:53:57.397832 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-70d62fe6-c08b-4330-aa2c-9c2e3e545227 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:53:57.421826 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-d2f9c9e8-4005-40f5-977b-95eea7e11bd8 req-9cc3bdf0-5da0-4aee-969c-75a46e4f67f4 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Synchronizing usage tracker for tenant:b32a0178e35546828deb4b131cde3201 on resource:port {{(pid=99027) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 17:53:57.444120 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Device 5c96172a-06f4-41ce-b47a-f1bbde47e41c no longer exists at agent hyperv_hv-cinder-78956 {{(pid=99028) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 17:53:57.473238 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-70d62fe6-c08b-4330-aa2c-9c2e3e545227 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify callbacks [] for security_group, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:57.482911 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.plugin [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] No Port match for: 5c96172a-06f4-41ce-b47a-f1bbde47e41c {{(pid=99028) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 25 17:53:57.483266 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Device 5c96172a-06f4-41ce-b47a-f1bbde47e41c not bound to the agent host hv-cinder-78956 {{(pid=99028) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 25 17:53:57.492242 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-d2f9c9e8-4005-40f5-977b-95eea7e11bd8 req-9cc3bdf0-5da0-4aee-969c-75a46e4f67f4 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Unset dirty status for tenant:b32a0178e35546828deb4b131cde3201 on resource:port {{(pid=99027) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 17:53:57.493610 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-d2f9c9e8-4005-40f5-977b-95eea7e11bd8 req-9cc3bdf0-5da0-4aee-969c-75a46e4f67f4 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] 10.222.0.122 "GET /v2.0/ports?tenant_id=b32a0178e35546828deb4b131cde3201&fields=id HTTP/1.1" status: 200  len: 302 time: 0.1549621
May 25 17:53:57.554807 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-70d62fe6-c08b-4330-aa2c-9c2e3e545227 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:57.558666 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-1b69bf05-006c-459f-bcbe-ff9aa282d72e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:53:57.600065 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70d62fe6-c08b-4330-aa2c-9c2e3e545227 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Pushing event updated for resources: {'SecurityGroup': ['ID=f96a2660-11f5-4f6d-a34a-0a5f0713b90d,revision_number=1']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:53:57.603181 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-70d62fe6-c08b-4330-aa2c-9c2e3e545227 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:53:57.634057 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-d2f9c9e8-4005-40f5-977b-95eea7e11bd8 req-068c104f-3362-4b70-bc9a-c435c71153dc service neutron] 10.222.0.122 "GET /v2.0/networks/0293f9ff-afda-47ba-aab9-1aac8ea6403d?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1278899
May 25 17:53:57.669145 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-70d62fe6-c08b-4330-aa2c-9c2e3e545227 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify callbacks [] for security_group, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:57.670361 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-70d62fe6-c08b-4330-aa2c-9c2e3e545227 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.122 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1779 time: 0.3860564
May 25 17:53:57.673224 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 49404) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:53:57.679028 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.v2.base [None req-8c1012dd-43a6-4764-a90f-e7ced8e5e21d tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Request body: {'security_group_rule': {'security_group_id': 'f96a2660-11f5-4f6d-a34a-0a5f0713b90d', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=99026) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:53:57.684901 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-8c1012dd-43a6-4764-a90f-e7ced8e5e21d tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:53:57.688643 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-8c1012dd-43a6-4764-a90f-e7ced8e5e21d tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Usage tracker for resource:security_group_rule and tenant:cf02997eda314aee8fb322add2fbb921 is out of sync, need to count used quota {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:53:57.692143 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-8c1012dd-43a6-4764-a90f-e7ced8e5e21d tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:53:57.697862 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-8c1012dd-43a6-4764-a90f-e7ced8e5e21d tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:53:57.772616 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-d2f9c9e8-4005-40f5-977b-95eea7e11bd8 req-f8e597dd-13bc-4da4-b21e-5ffb33a415c1 service neutron] 10.222.0.122 "GET /v2.0/networks/0293f9ff-afda-47ba-aab9-1aac8ea6403d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1326575
May 25 17:53:57.778781 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-8c1012dd-43a6-4764-a90f-e7ced8e5e21d tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify callbacks [] for security_group_rule, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:57.843722 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-8c1012dd-43a6-4764-a90f-e7ced8e5e21d tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:57.929621 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-8c1012dd-43a6-4764-a90f-e7ced8e5e21d tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459369'] for security_group_rule, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:57.931761 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:53:57.955486 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c1012dd-43a6-4764-a90f-e7ced8e5e21d tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=4ee4264e-4d98-4ef8-b4b4-8e55405ec33f,revision_number=0']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:53:57.959992 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-8c1012dd-43a6-4764-a90f-e7ced8e5e21d tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:53:58.018165 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-8c1012dd-43a6-4764-a90f-e7ced8e5e21d tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify callbacks [] for security_group_rule, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:58.019226 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-8c1012dd-43a6-4764-a90f-e7ced8e5e21d tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.122 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 0.3443434
May 25 17:53:58.021951 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 49414) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:53:58.027087 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.v2.base [None req-4e348ec9-09a9-42d1-a76c-bea37a62fa45 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Request body: {'security_group_rule': {'security_group_id': 'f96a2660-11f5-4f6d-a34a-0a5f0713b90d', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=99026) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:53:58.032872 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-4e348ec9-09a9-42d1-a76c-bea37a62fa45 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:53:58.037154 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-4e348ec9-09a9-42d1-a76c-bea37a62fa45 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Usage tracker for resource:security_group_rule and tenant:cf02997eda314aee8fb322add2fbb921 is out of sync, need to count used quota {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:53:58.040089 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-4e348ec9-09a9-42d1-a76c-bea37a62fa45 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:53:58.046272 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-4e348ec9-09a9-42d1-a76c-bea37a62fa45 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:53:58.161376 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-4e348ec9-09a9-42d1-a76c-bea37a62fa45 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify callbacks [] for security_group_rule, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:58.224296 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-4e348ec9-09a9-42d1-a76c-bea37a62fa45 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:58.326157 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-4e348ec9-09a9-42d1-a76c-bea37a62fa45 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459369'] for security_group_rule, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:58.332260 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:53:58.352068 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e348ec9-09a9-42d1-a76c-bea37a62fa45 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=09612d71-d9d4-4f21-95b7-2f021ed08a55,revision_number=0']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:53:58.354427 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-4e348ec9-09a9-42d1-a76c-bea37a62fa45 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.022s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:53:58.444247 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-4e348ec9-09a9-42d1-a76c-bea37a62fa45 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify callbacks [] for security_group_rule, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:58.445495 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-4e348ec9-09a9-42d1-a76c-bea37a62fa45 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.122 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.4226129
May 25 17:53:58.448925 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 49426) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:53:58.456337 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.v2.base [None req-9a72be09-6466-477b-9439-e6c7345c060b tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Request body: {'floatingip': {'floating_network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb'}} {{(pid=99026) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:53:58.464402 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-9a72be09-6466-477b-9439-e6c7345c060b tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:53:58.503007 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-9a72be09-6466-477b-9439-e6c7345c060b tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Usage tracker for resource:floatingip and tenant:cf02997eda314aee8fb322add2fbb921 is out of sync, need to count used quota {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:53:58.514380 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-9a72be09-6466-477b-9439-e6c7345c060b tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:53:58.519784 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-d1b5a7d1-bb22-4bcc-8240-262c2d9ca822 req-8ac4fea9-c826-4b42-8089-11ecea02f08a tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] 10.222.0.122 "GET /v2.0/ports?device_id=a88a7518-b01c-49a5-96f0-7cb8608682c8 HTTP/1.1" status: 200  len: 210 time: 0.0584135
May 25 17:53:58.523946 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-9a72be09-6466-477b-9439-e6c7345c060b tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:53:58.623338 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-9a72be09-6466-477b-9439-e6c7345c060b tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify callbacks [] for floatingip, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:58.768441 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-9a72be09-6466-477b-9439-e6c7345c060b tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:58.910524 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.db_base_plugin_common [None req-9a72be09-6466-477b-9439-e6c7345c060b tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Allocated IP 172.27.3.115 (eb7ec72b-a691-481b-8d7e-42c05e13a8cb/d6898f5f-da0b-4428-97b4-4cbe3e83caaa/788a6bdb-6047-40ec-b75e-842aa5ac303f) {{(pid=99026) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 17:53:59.160748 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-9a72be09-6466-477b-9439-e6c7345c060b tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify callbacks [] for port, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:59.250465 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-9a72be09-6466-477b-9439-e6c7345c060b tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781840788179', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15476536'] for port, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:59.255168 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-12bc1c78-4e3b-4a49-a8c0-4f1c67932f9d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:53:59.322682 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9a72be09-6466-477b-9439-e6c7345c060b tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Network eb7ec72b-a691-481b-8d7e-42c05e13a8cb is already hosted by enough agents. {{(pid=99026) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 17:53:59.325282 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.scheduler.base_scheduler [None req-9a72be09-6466-477b-9439-e6c7345c060b tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Resources bound (agent type, host, resource id):  {{(pid=99026) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 17:53:59.328874 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9a72be09-6466-477b-9439-e6c7345c060b tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Received port after_create {{(pid=99026) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 17:53:59.362188 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a72be09-6466-477b-9439-e6c7345c060b tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Pushing event updated for resources: {'Port': ['ID=788a6bdb-6047-40ec-b75e-842aa5ac303f,revision_number=1']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:53:59.366290 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-9a72be09-6466-477b-9439-e6c7345c060b tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.111s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:53:59.410380 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-9a72be09-6466-477b-9439-e6c7345c060b tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify callbacks [] for floatingip, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:59.526838 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-9a72be09-6466-477b-9439-e6c7345c060b tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:59.625762 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-9600b4f3-d899-49f5-9295-f50c068dffcd req-a2fda7f8-dbc0-4ac3-9a1b-e616efd62167 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] 10.222.0.122 "GET /v2.0/ports?device_id=a88a7518-b01c-49a5-96f0-7cb8608682c8 HTTP/1.1" status: 200  len: 210 time: 0.0505886
May 25 17:53:59.784669 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-9a72be09-6466-477b-9439-e6c7345c060b tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify callbacks [] for port, precommit_update {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:59.878348 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-9a72be09-6466-477b-9439-e6c7345c060b tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15476529'] for port, after_update {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:53:59.882496 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-b2d25bb2-cecb-4d35-a19d-7befdbb943d3 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:53:59.989127 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a72be09-6466-477b-9439-e6c7345c060b tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Pushing event updated for resources: {'Port': ['ID=788a6bdb-6047-40ec-b75e-842aa5ac303f,revision_number=2']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:53:59.993100 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-9a72be09-6466-477b-9439-e6c7345c060b tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.111s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:53:59.999635 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-9a72be09-6466-477b-9439-e6c7345c060b tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-419865'] for floatingip, after_update {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:54:00.083779 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-9a72be09-6466-477b-9439-e6c7345c060b tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-239387'] for floatingip, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:54:00.085024 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-9a72be09-6466-477b-9439-e6c7345c060b tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.122 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 693 time: 1.6343226
May 25 17:54:00.271407 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [req-3925f2dd-c91e-4328-bdef-909519739faf req-c0db09c5-c036-464d-9988-cf3182d68726 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Synchronizing usage tracker for tenant:cf02997eda314aee8fb322add2fbb921 on resource:security_group {{(pid=99026) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 17:54:00.403996 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [req-3925f2dd-c91e-4328-bdef-909519739faf req-c0db09c5-c036-464d-9988-cf3182d68726 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Unset dirty status for tenant:cf02997eda314aee8fb322add2fbb921 on resource:security_group {{(pid=99026) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 17:54:00.405264 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-3925f2dd-c91e-4328-bdef-909519739faf req-c0db09c5-c036-464d-9988-cf3182d68726 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.122 "GET /v2.0/security-groups?name=tempest-securitygroup--1067122059&fields=id&tenant_id=cf02997eda314aee8fb322add2fbb921 HTTP/1.1" status: 200  len: 267 time: 0.1785681
May 25 17:54:00.556640 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3925f2dd-c91e-4328-bdef-909519739faf req-866411fb-9767-466c-9899-9c4c909a71b5 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:54:00.558139 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-3925f2dd-c91e-4328-bdef-909519739faf req-866411fb-9767-466c-9899-9c4c909a71b5 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.122 "GET /v2.0/networks?id=45b850af-d423-458a-855a-d7f828a11fff HTTP/1.1" status: 200  len: 817 time: 0.1460242
May 25 17:54:00.575315 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-3925f2dd-c91e-4328-bdef-909519739faf req-c487bdb3-cf8c-4866-9967-ccebccb2c398 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.122 "GET /v2.0/quotas/cf02997eda314aee8fb322add2fbb921 HTTP/1.1" status: 200  len: 375 time: 0.0103550
May 25 17:54:00.666566 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [req-3925f2dd-c91e-4328-bdef-909519739faf req-8f925cd6-43a7-49e1-8418-920b3073f229 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Synchronizing usage tracker for tenant:cf02997eda314aee8fb322add2fbb921 on resource:port {{(pid=99026) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 17:54:00.724077 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-de4a88dc-39db-4506-9dec-6cc62b148c67 req-12fc799a-c5e5-4edf-8b9b-6f56b38fba4b tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] 10.222.0.122 "GET /v2.0/ports?device_id=a88a7518-b01c-49a5-96f0-7cb8608682c8 HTTP/1.1" status: 200  len: 210 time: 0.0433803
May 25 17:54:00.770158 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [req-3925f2dd-c91e-4328-bdef-909519739faf req-8f925cd6-43a7-49e1-8418-920b3073f229 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Unset dirty status for tenant:cf02997eda314aee8fb322add2fbb921 on resource:port {{(pid=99026) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 17:54:00.771654 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-3925f2dd-c91e-4328-bdef-909519739faf req-8f925cd6-43a7-49e1-8418-920b3073f229 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.122 "GET /v2.0/ports?tenant_id=cf02997eda314aee8fb322add2fbb921&fields=id HTTP/1.1" status: 200  len: 348 time: 0.1919463
May 25 17:54:00.891515 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [req-3925f2dd-c91e-4328-bdef-909519739faf req-36e893f7-071c-4d6a-96f4-1505d9868913 service neutron] http://10.222.0.122:9696/v2.0/extensions returned with HTTP 200 {{(pid=99026) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 25 17:54:00.893021 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-3925f2dd-c91e-4328-bdef-909519739faf req-36e893f7-071c-4d6a-96f4-1505d9868913 service neutron] 10.222.0.122 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.1087675
May 25 17:54:01.030009 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-3925f2dd-c91e-4328-bdef-909519739faf req-ee4d10cf-967f-4268-acf5-764c12cdd724 service neutron] 10.222.0.122 "GET /v2.0/networks/45b850af-d423-458a-855a-d7f828a11fff?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1307886
May 25 17:54:01.169628 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-3925f2dd-c91e-4328-bdef-909519739faf req-fb76d4ed-02e4-41d4-9387-49630d59faf0 service neutron] 10.222.0.122 "GET /v2.0/networks/45b850af-d423-458a-855a-d7f828a11fff?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1327033
May 25 17:54:01.875216 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-cdb29b43-d3b9-4fc9-94fa-452f5373966c req-d1a87b4b-6a8e-4b91-aadb-e38a5de87faa tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] 10.222.0.122 "GET /v2.0/ports?device_id=a88a7518-b01c-49a5-96f0-7cb8608682c8 HTTP/1.1" status: 200  len: 210 time: 0.0429926
May 25 17:54:02.513495 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-53eca912-60c8-4de0-863b-bc92d4658823 req-67aa92f0-82cb-4b58-a3a4-e9670e087495 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.122 "GET /v2.0/ports?device_id=6f66d198-4e81-4b59-a5ed-d28bf9c046e3 HTTP/1.1" status: 200  len: 210 time: 0.0472434
May 25 17:54:03.024574 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-d884fce9-145d-4db2-b9ec-3fc0b13dd86d req-cc325beb-15a8-4ff9-b5f3-6e1930ca90ca tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] 10.222.0.122 "GET /v2.0/ports?device_id=a88a7518-b01c-49a5-96f0-7cb8608682c8 HTTP/1.1" status: 200  len: 210 time: 0.0457442
May 25 17:54:03.620259 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-10105c7a-1ba2-432c-8ffa-f68d50addc51 req-2c83aeea-4775-4a57-b60b-3145eb89a4b0 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.122 "GET /v2.0/ports?device_id=6f66d198-4e81-4b59-a5ed-d28bf9c046e3 HTTP/1.1" status: 200  len: 210 time: 0.0466652
May 25 17:54:03.987559 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2f9c9e8-4005-40f5-977b-95eea7e11bd8 req-30df9cee-4046-48a6-958b-b334af3331af tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:54:03.988234 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [req-d2f9c9e8-4005-40f5-977b-95eea7e11bd8 req-30df9cee-4046-48a6-958b-b334af3331af tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Synchronizing usage tracker for tenant:b32a0178e35546828deb4b131cde3201 on resource:network {{(pid=99026) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 17:54:04.135866 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [req-d2f9c9e8-4005-40f5-977b-95eea7e11bd8 req-30df9cee-4046-48a6-958b-b334af3331af tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Unset dirty status for tenant:b32a0178e35546828deb4b131cde3201 on resource:network {{(pid=99026) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 17:54:04.137195 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-d2f9c9e8-4005-40f5-977b-95eea7e11bd8 req-30df9cee-4046-48a6-958b-b334af3331af tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] 10.222.0.125 "GET /v2.0/networks?id=0293f9ff-afda-47ba-aab9-1aac8ea6403d HTTP/1.1" status: 200  len: 808 time: 0.3015497
May 25 17:54:04.192979 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [req-d2f9c9e8-4005-40f5-977b-95eea7e11bd8 req-94757974-fcb4-46f5-9ce5-eda010bd9a0b tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Synchronizing usage tracker for tenant:b32a0178e35546828deb4b131cde3201 on resource:security_group {{(pid=99026) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 17:54:04.204414 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-a0d29257-9627-458c-872b-d566c4c4bbaf req-5c289773-0d81-4e70-af86-5edbedb8a857 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] 10.222.0.122 "GET /v2.0/ports?device_id=a88a7518-b01c-49a5-96f0-7cb8608682c8 HTTP/1.1" status: 200  len: 210 time: 0.0590305
May 25 17:54:04.207740 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [req-d2f9c9e8-4005-40f5-977b-95eea7e11bd8 req-94757974-fcb4-46f5-9ce5-eda010bd9a0b tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Unset dirty status for tenant:b32a0178e35546828deb4b131cde3201 on resource:security_group {{(pid=99026) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 17:54:04.208878 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-d2f9c9e8-4005-40f5-977b-95eea7e11bd8 req-94757974-fcb4-46f5-9ce5-eda010bd9a0b tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] 10.222.0.125 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=b32a0178e35546828deb4b131cde3201 HTTP/1.1" status: 200  len: 379 time: 0.0612350
May 25 17:54:04.219665 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.v2.base [req-d2f9c9e8-4005-40f5-977b-95eea7e11bd8 req-fda8bbe7-9940-4f3a-8b3a-a8d5250296e2 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Request body: {'port': {'device_id': 'a88a7518-b01c-49a5-96f0-7cb8608682c8', 'network_id': '0293f9ff-afda-47ba-aab9-1aac8ea6403d', 'admin_state_up': True, 'tenant_id': 'b32a0178e35546828deb4b131cde3201', 'security_groups': ['d5b71c00-54cd-4760-821a-82059bd31db8']}} {{(pid=99026) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:54:04.470451 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [req-d2f9c9e8-4005-40f5-977b-95eea7e11bd8 req-fda8bbe7-9940-4f3a-8b3a-a8d5250296e2 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:54:04.480476 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [req-d2f9c9e8-4005-40f5-977b-95eea7e11bd8 req-fda8bbe7-9940-4f3a-8b3a-a8d5250296e2 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:54:04.565041 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-d2f9c9e8-4005-40f5-977b-95eea7e11bd8 req-fda8bbe7-9940-4f3a-8b3a-a8d5250296e2 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Made reservation on behalf of b32a0178e35546828deb4b131cde3201 for: {'port': 1} {{(pid=99026) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 17:54:04.568668 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [req-d2f9c9e8-4005-40f5-977b-95eea7e11bd8 req-fda8bbe7-9940-4f3a-8b3a-a8d5250296e2 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:54:04.742589 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.db_base_plugin_common [req-d2f9c9e8-4005-40f5-977b-95eea7e11bd8 req-fda8bbe7-9940-4f3a-8b3a-a8d5250296e2 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Allocated IP 172.20.0.5 (0293f9ff-afda-47ba-aab9-1aac8ea6403d/69cd9818-8734-45ed-94ad-ee676be865a2/e70c756f-3f35-4e5a-b4d2-444540756468) {{(pid=99026) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 17:54:04.776312 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-a9dc068e-03bf-4140-9377-fbbb3ef40bf4 req-837a1f07-6bcf-4a95-9ae1-9b09fbd0d2d4 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.122 "GET /v2.0/ports?device_id=6f66d198-4e81-4b59-a5ed-d28bf9c046e3 HTTP/1.1" status: 200  len: 210 time: 0.0446913
May 25 17:54:04.940745 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [req-d2f9c9e8-4005-40f5-977b-95eea7e11bd8 req-fda8bbe7-9940-4f3a-8b3a-a8d5250296e2 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Notify callbacks [] for port, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:54:04.957350 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.provisioning_blocks [req-d2f9c9e8-4005-40f5-977b-95eea7e11bd8 req-fda8bbe7-9940-4f3a-8b3a-a8d5250296e2 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Transition to ACTIVE for port object e70c756f-3f35-4e5a-b4d2-444540756468 will not be triggered until provisioned by entity DHCP. {{(pid=99026) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 17:54:05.051318 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [req-d2f9c9e8-4005-40f5-977b-95eea7e11bd8 req-fda8bbe7-9940-4f3a-8b3a-a8d5250296e2 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781840788179', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15476536'] for port, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:54:05.058580 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-e5c2fd47-a3b2-4978-8273-cbdeb9ad20fd tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:54:05.147261 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-d2f9c9e8-4005-40f5-977b-95eea7e11bd8 req-fda8bbe7-9940-4f3a-8b3a-a8d5250296e2 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Network 0293f9ff-afda-47ba-aab9-1aac8ea6403d is already hosted by enough agents. {{(pid=99026) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 17:54:05.150420 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.scheduler.base_scheduler [req-d2f9c9e8-4005-40f5-977b-95eea7e11bd8 req-fda8bbe7-9940-4f3a-8b3a-a8d5250296e2 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Resources bound (agent type, host, resource id):  {{(pid=99026) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 17:54:05.155358 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.l3_dvrscheduler_db [req-d2f9c9e8-4005-40f5-977b-95eea7e11bd8 req-fda8bbe7-9940-4f3a-8b3a-a8d5250296e2 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Received port after_create {{(pid=99026) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 17:54:05.179817 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3925f2dd-c91e-4328-bdef-909519739faf req-5997d14f-3fa9-41c6-a244-c92624a36034 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:54:05.181350 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-3925f2dd-c91e-4328-bdef-909519739faf req-5997d14f-3fa9-41c6-a244-c92624a36034 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.125 "GET /v2.0/networks?id=45b850af-d423-458a-855a-d7f828a11fff HTTP/1.1" status: 200  len: 817 time: 0.2468591
May 25 17:54:05.188470 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fda8bbe7-9940-4f3a-8b3a-a8d5250296e2 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Pushing event updated for resources: {'Port': ['ID=e70c756f-3f35-4e5a-b4d2-444540756468,revision_number=1']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:54:05.193017 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-fda8bbe7-9940-4f3a-8b3a-a8d5250296e2 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.133s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:54:05.233723 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2f9c9e8-4005-40f5-977b-95eea7e11bd8 req-fda8bbe7-9940-4f3a-8b3a-a8d5250296e2 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:54:05.234393 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [req-d2f9c9e8-4005-40f5-977b-95eea7e11bd8 req-fda8bbe7-9940-4f3a-8b3a-a8d5250296e2 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-239387'] for port, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:54:05.261781 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-3925f2dd-c91e-4328-bdef-909519739faf req-73f22e43-3cd4-49d8-9523-1161c048eedf tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.125 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=cf02997eda314aee8fb322add2fbb921 HTTP/1.1" status: 200  len: 380 time: 0.0662651
May 25 17:54:05.281999 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.v2.base [req-3925f2dd-c91e-4328-bdef-909519739faf req-ec5f4143-1aae-4bb4-b9a2-f3eb9771efb1 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Request body: {'port': {'device_id': '6f66d198-4e81-4b59-a5ed-d28bf9c046e3', 'network_id': '45b850af-d423-458a-855a-d7f828a11fff', 'admin_state_up': True, 'tenant_id': 'cf02997eda314aee8fb322add2fbb921', 'security_groups': ['f96a2660-11f5-4f6d-a34a-0a5f0713b90d']}} {{(pid=99027) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:54:05.409196 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-d2f9c9e8-4005-40f5-977b-95eea7e11bd8 req-fda8bbe7-9940-4f3a-8b3a-a8d5250296e2 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] 10.222.0.125 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.1937768
May 25 17:54:05.420554 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.v2.base [req-d2f9c9e8-4005-40f5-977b-95eea7e11bd8 req-85a95637-f68d-436d-888f-9b1b91c99771 service neutron] Request body: {'port': {'device_id': 'a88a7518-b01c-49a5-96f0-7cb8608682c8', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78956'}} {{(pid=99026) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:54:05.452919 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [req-3925f2dd-c91e-4328-bdef-909519739faf req-ec5f4143-1aae-4bb4-b9a2-f3eb9771efb1 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:54:05.465576 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [req-3925f2dd-c91e-4328-bdef-909519739faf req-ec5f4143-1aae-4bb4-b9a2-f3eb9771efb1 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:54:05.486843 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-9cf06138-d022-4443-bea6-f2a64ce00087 None None] Provisioning for port e70c756f-3f35-4e5a-b4d2-444540756468 completed by entity DHCP. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 17:54:05.494234 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-9cf06138-d022-4443-bea6-f2a64ce00087 None None] Provisioning complete for port e70c756f-3f35-4e5a-b4d2-444540756468 triggered by entity DHCP. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 17:54:05.494620 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-9cf06138-d022-4443-bea6-f2a64ce00087 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:54:05.552434 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.plugin [None req-9cf06138-d022-4443-bea6-f2a64ce00087 None None] Port e70c756f-3f35-4e5a-b4d2-444540756468 cannot update to ACTIVE because it is not bound. {{(pid=99028) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 25 17:54:05.557739 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75012980-dc69-456e-a3a7-0076a7500eac req-00a2ee06-2362-4a19-a639-896a9164d0c6 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:54:05.558387 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [req-75012980-dc69-456e-a3a7-0076a7500eac req-00a2ee06-2362-4a19-a639-896a9164d0c6 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Synchronizing usage tracker for tenant:b32a0178e35546828deb4b131cde3201 on resource:port {{(pid=99026) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 17:54:05.558757 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-3925f2dd-c91e-4328-bdef-909519739faf req-ec5f4143-1aae-4bb4-b9a2-f3eb9771efb1 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Made reservation on behalf of cf02997eda314aee8fb322add2fbb921 for: {'port': 1} {{(pid=99027) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 17:54:05.562086 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [req-d2f9c9e8-4005-40f5-977b-95eea7e11bd8 req-85a95637-f68d-436d-888f-9b1b91c99771 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:54:05.562294 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-3925f2dd-c91e-4328-bdef-909519739faf req-ec5f4143-1aae-4bb4-b9a2-f3eb9771efb1 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:54:05.690971 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [req-75012980-dc69-456e-a3a7-0076a7500eac req-00a2ee06-2362-4a19-a639-896a9164d0c6 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Unset dirty status for tenant:b32a0178e35546828deb4b131cde3201 on resource:port {{(pid=99026) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 17:54:05.693692 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-75012980-dc69-456e-a3a7-0076a7500eac req-00a2ee06-2362-4a19-a639-896a9164d0c6 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] 10.222.0.122 "GET /v2.0/ports?device_id=a88a7518-b01c-49a5-96f0-7cb8608682c8 HTTP/1.1" status: 200  len: 931 time: 0.3377709
May 25 17:54:05.733789 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.db_base_plugin_common [req-3925f2dd-c91e-4328-bdef-909519739faf req-ec5f4143-1aae-4bb4-b9a2-f3eb9771efb1 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Allocated IP 172.20.0.12 (45b850af-d423-458a-855a-d7f828a11fff/704d0a85-ee4f-4df2-90a3-a525dfe28461/940c93c6-ab4c-47b9-9b48-31aabb845ba8) {{(pid=99027) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 17:54:05.831084 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-75012980-dc69-456e-a3a7-0076a7500eac req-cd59ed11-c354-422d-9a32-6c75c8fd9f3c tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] 10.222.0.122 "GET /v2.0/security-groups?id=d5b71c00-54cd-4760-821a-82059bd31db8&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1260998
May 25 17:54:05.976613 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-3925f2dd-c91e-4328-bdef-909519739faf req-ec5f4143-1aae-4bb4-b9a2-f3eb9771efb1 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify callbacks [] for port, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:54:05.982952 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.notifiers.nova [req-d2f9c9e8-4005-40f5-977b-95eea7e11bd8 req-85a95637-f68d-436d-888f-9b1b91c99771 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id e70c756f-3f35-4e5a-b4d2-444540756468 {{(pid=99026) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 25 17:54:05.989253 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-b99d42e7-ef91-4720-b082-110734ff5ac1 req-a9bf9b9c-1a8b-4af7-966f-ec5ab29f22ce tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.122 "GET /v2.0/ports?device_id=6f66d198-4e81-4b59-a5ed-d28bf9c046e3 HTTP/1.1" status: 200  len: 210 time: 0.0579116
May 25 17:54:05.991533 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [req-d2f9c9e8-4005-40f5-977b-95eea7e11bd8 req-85a95637-f68d-436d-888f-9b1b91c99771 service neutron] Notify callbacks [] for port, precommit_update {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:54:05.999726 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.provisioning_blocks [req-3925f2dd-c91e-4328-bdef-909519739faf req-ec5f4143-1aae-4bb4-b9a2-f3eb9771efb1 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Transition to ACTIVE for port object 940c93c6-ab4c-47b9-9b48-31aabb845ba8 will not be triggered until provisioned by entity DHCP. {{(pid=99027) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 17:54:06.021511 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.provisioning_blocks [req-d2f9c9e8-4005-40f5-977b-95eea7e11bd8 req-85a95637-f68d-436d-888f-9b1b91c99771 service neutron] Transition to ACTIVE for port object e70c756f-3f35-4e5a-b4d2-444540756468 will not be triggered until provisioned by entity L2. {{(pid=99026) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 17:54:06.086345 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [req-d2f9c9e8-4005-40f5-977b-95eea7e11bd8 req-85a95637-f68d-436d-888f-9b1b91c99771 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15476529'] for port, after_update {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:54:06.091100 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-4a013feb-8733-4e80-85ef-1a802f072647 tempest-VolumesNegativeTest-173737758 tempest-VolumesNegativeTest-173737758-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:54:06.109971 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-3925f2dd-c91e-4328-bdef-909519739faf req-ec5f4143-1aae-4bb4-b9a2-f3eb9771efb1 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781840788179', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15468986'] for port, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:54:06.117764 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-48208825-78cb-4c26-bcb1-acd3c173ba7c service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:54:06.187371 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-3925f2dd-c91e-4328-bdef-909519739faf req-ec5f4143-1aae-4bb4-b9a2-f3eb9771efb1 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Network 45b850af-d423-458a-855a-d7f828a11fff is already hosted by enough agents. {{(pid=99027) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 17:54:06.193528 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.base_scheduler [req-3925f2dd-c91e-4328-bdef-909519739faf req-ec5f4143-1aae-4bb4-b9a2-f3eb9771efb1 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Resources bound (agent type, host, resource id):  {{(pid=99027) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 17:54:06.197815 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.l3_dvrscheduler_db [req-3925f2dd-c91e-4328-bdef-909519739faf req-ec5f4143-1aae-4bb4-b9a2-f3eb9771efb1 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Received port after_create {{(pid=99027) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 17:54:06.263013 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec5f4143-1aae-4bb4-b9a2-f3eb9771efb1 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Pushing event updated for resources: {'Port': ['ID=940c93c6-ab4c-47b9-9b48-31aabb845ba8,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:54:06.265715 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85a95637-f68d-436d-888f-9b1b91c99771 service neutron] Pushing event updated for resources: {'Port': ['ID=e70c756f-3f35-4e5a-b4d2-444540756468,revision_number=2']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:54:06.274253 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-85a95637-f68d-436d-888f-9b1b91c99771 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.183s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:54:06.282412 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ec5f4143-1aae-4bb4-b9a2-f3eb9771efb1 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:54:06.283322 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ec5f4143-1aae-4bb4-b9a2-f3eb9771efb1 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:54:06.283682 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ec5f4143-1aae-4bb4-b9a2-f3eb9771efb1 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:54:06.284039 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ec5f4143-1aae-4bb4-b9a2-f3eb9771efb1 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:54:06.284388 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ec5f4143-1aae-4bb4-b9a2-f3eb9771efb1 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:54:06.284744 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ec5f4143-1aae-4bb4-b9a2-f3eb9771efb1 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:54:06.285129 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ec5f4143-1aae-4bb4-b9a2-f3eb9771efb1 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:54:06.285453 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ec5f4143-1aae-4bb4-b9a2-f3eb9771efb1 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:54:06.285813 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ec5f4143-1aae-4bb4-b9a2-f3eb9771efb1 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:54:06.286150 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ec5f4143-1aae-4bb4-b9a2-f3eb9771efb1 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:54:06.286491 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ec5f4143-1aae-4bb4-b9a2-f3eb9771efb1 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:54:06.286858 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ec5f4143-1aae-4bb4-b9a2-f3eb9771efb1 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:54:06.300521 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-ec5f4143-1aae-4bb4-b9a2-f3eb9771efb1 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.183s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:54:06.313984 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3925f2dd-c91e-4328-bdef-909519739faf req-ec5f4143-1aae-4bb4-b9a2-f3eb9771efb1 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:54:06.314944 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-3925f2dd-c91e-4328-bdef-909519739faf req-ec5f4143-1aae-4bb4-b9a2-f3eb9771efb1 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-239387'] for port, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:54:06.362609 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.managers [req-d2f9c9e8-4005-40f5-977b-95eea7e11bd8 req-85a95637-f68d-436d-888f-9b1b91c99771 service neutron] Attempting to bind port e70c756f-3f35-4e5a-b4d2-444540756468 on host hv-cinder-78956 for vnic_type normal with profile  {{(pid=99026) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 17:54:06.363061 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.managers [req-d2f9c9e8-4005-40f5-977b-95eea7e11bd8 req-85a95637-f68d-436d-888f-9b1b91c99771 service neutron] Attempting to bind port e70c756f-3f35-4e5a-b4d2-444540756468 by drivers openvswitch,hyperv on host hv-cinder-78956 at level 0 using segments [{'id': '66d2a99c-6c47-4a92-ac51-31e984766b29', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1321, 'network_id': '0293f9ff-afda-47ba-aab9-1aac8ea6403d'}] {{(pid=99026) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 17:54:06.363501 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d2f9c9e8-4005-40f5-977b-95eea7e11bd8 req-85a95637-f68d-436d-888f-9b1b91c99771 service neutron] Attempting to bind port e70c756f-3f35-4e5a-b4d2-444540756468 on network 0293f9ff-afda-47ba-aab9-1aac8ea6403d {{(pid=99026) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 17:54:06.368837 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d2f9c9e8-4005-40f5-977b-95eea7e11bd8 req-85a95637-f68d-436d-888f-9b1b91c99771 service neutron] Port e70c756f-3f35-4e5a-b4d2-444540756468 on network 0293f9ff-afda-47ba-aab9-1aac8ea6403d not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78956 {{(pid=99026) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 25 17:54:06.369186 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d2f9c9e8-4005-40f5-977b-95eea7e11bd8 req-85a95637-f68d-436d-888f-9b1b91c99771 service neutron] Attempting to bind port e70c756f-3f35-4e5a-b4d2-444540756468 on network 0293f9ff-afda-47ba-aab9-1aac8ea6403d {{(pid=99026) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 17:54:06.374660 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d2f9c9e8-4005-40f5-977b-95eea7e11bd8 req-85a95637-f68d-436d-888f-9b1b91c99771 service neutron] Checking agent: {'id': '4d02a528-6a0e-4977-985f-4bcff1ca6cb7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78956', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 17, 40, 41), 'started_at': datetime.datetime(2021, 5, 25, 17, 40, 41), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 17, 53, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=99026) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 17:54:06.374954 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d2f9c9e8-4005-40f5-977b-95eea7e11bd8 req-85a95637-f68d-436d-888f-9b1b91c99771 service neutron] Checking segment: {'id': '66d2a99c-6c47-4a92-ac51-31e984766b29', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1321, 'network_id': '0293f9ff-afda-47ba-aab9-1aac8ea6403d'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=99026) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 17:54:06.375330 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d2f9c9e8-4005-40f5-977b-95eea7e11bd8 req-85a95637-f68d-436d-888f-9b1b91c99771 service neutron] Bound using segment: {'id': '66d2a99c-6c47-4a92-ac51-31e984766b29', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1321, 'network_id': '0293f9ff-afda-47ba-aab9-1aac8ea6403d'} {{(pid=99026) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 17:54:06.375789 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.managers [req-d2f9c9e8-4005-40f5-977b-95eea7e11bd8 req-85a95637-f68d-436d-888f-9b1b91c99771 service neutron] Bound port: e70c756f-3f35-4e5a-b4d2-444540756468, host: hv-cinder-78956, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '66d2a99c-6c47-4a92-ac51-31e984766b29', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1321, 'network_id': '0293f9ff-afda-47ba-aab9-1aac8ea6403d'}}] {{(pid=99026) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 17:54:06.376097 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [req-d2f9c9e8-4005-40f5-977b-95eea7e11bd8 req-85a95637-f68d-436d-888f-9b1b91c99771 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:54:06.424577 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-3925f2dd-c91e-4328-bdef-909519739faf req-ec5f4143-1aae-4bb4-b9a2-f3eb9771efb1 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.125 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 1.1581089
May 25 17:54:06.438380 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.v2.base [req-3925f2dd-c91e-4328-bdef-909519739faf req-055756b5-30e8-4510-964f-fece910e947f service neutron] Request body: {'port': {'device_id': '6f66d198-4e81-4b59-a5ed-d28bf9c046e3', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78956'}} {{(pid=99027) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:54:06.473979 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.db [req-d2f9c9e8-4005-40f5-977b-95eea7e11bd8 req-85a95637-f68d-436d-888f-9b1b91c99771 service neutron] For port e70c756f-3f35-4e5a-b4d2-444540756468, host hv-cinder-78956, cleared binding levels {{(pid=99026) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 17:54:06.477405 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.db [req-d2f9c9e8-4005-40f5-977b-95eea7e11bd8 req-85a95637-f68d-436d-888f-9b1b91c99771 service neutron] For port e70c756f-3f35-4e5a-b4d2-444540756468, host hv-cinder-78956, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=e70c756f-3f35-4e5a-b4d2-444540756468,segment=NetworkSegment(66d2a99c-6c47-4a92-ac51-31e984766b29),segment_id=66d2a99c-6c47-4a92-ac51-31e984766b29)] {{(pid=99026) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 17:54:06.553230 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-3925f2dd-c91e-4328-bdef-909519739faf req-055756b5-30e8-4510-964f-fece910e947f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:54:06.572040 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-fa2bb2c5-8b7e-4086-b6f4-200a0189e55f None None] Provisioning for port 940c93c6-ab4c-47b9-9b48-31aabb845ba8 completed by entity DHCP. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 17:54:06.572688 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [req-d2f9c9e8-4005-40f5-977b-95eea7e11bd8 req-85a95637-f68d-436d-888f-9b1b91c99771 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15476529'] for port, after_update {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:54:06.577439 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-fa2bb2c5-8b7e-4086-b6f4-200a0189e55f None None] Provisioning complete for port 940c93c6-ab4c-47b9-9b48-31aabb845ba8 triggered by entity DHCP. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 17:54:06.583709 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-42b60104-981a-415c-a8cb-60572dc4e0cc tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:54:06.583996 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-fa2bb2c5-8b7e-4086-b6f4-200a0189e55f None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:54:06.637384 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2f9c9e8-4005-40f5-977b-95eea7e11bd8 req-85a95637-f68d-436d-888f-9b1b91c99771 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:54:06.637974 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [req-d2f9c9e8-4005-40f5-977b-95eea7e11bd8 req-85a95637-f68d-436d-888f-9b1b91c99771 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-239387'] for port, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:54:06.638720 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.plugin [None req-fa2bb2c5-8b7e-4086-b6f4-200a0189e55f None None] Port 940c93c6-ab4c-47b9-9b48-31aabb845ba8 cannot update to ACTIVE because it is not bound. {{(pid=99028) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 25 17:54:06.639456 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-d2f9c9e8-4005-40f5-977b-95eea7e11bd8 req-85a95637-f68d-436d-888f-9b1b91c99771 service neutron] 10.222.0.125 "PUT /v2.0/ports/e70c756f-3f35-4e5a-b4d2-444540756468 HTTP/1.1" status: 200  len: 1093 time: 1.2242901
May 25 17:54:06.639834 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a88a7518-b01c-49a5-96f0-7cb8608682c8', 'tag': 'e70c756f-3f35-4e5a-b4d2-444540756468'}] {{(pid=99026) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 17:54:06.669803 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85a95637-f68d-436d-888f-9b1b91c99771 service neutron] Pushing event updated for resources: {'Port': ['ID=e70c756f-3f35-4e5a-b4d2-444540756468,revision_number=3']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:54:06.672180 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-85a95637-f68d-436d-888f-9b1b91c99771 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.095s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:54:06.701020 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a88a7518-b01c-49a5-96f0-7cb8608682c8', 'tag': 'e70c756f-3f35-4e5a-b4d2-444540756468', 'status': 'completed', 'code': 200}
May 25 17:54:06.820089 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2eb2e737-92ef-4ee5-8f13-c0beeed1dc0a req-5d8ed0ba-8ba4-42cb-ba53-669890e56507 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:54:06.821601 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-2eb2e737-92ef-4ee5-8f13-c0beeed1dc0a req-5d8ed0ba-8ba4-42cb-ba53-669890e56507 service neutron] 10.222.0.125 "GET /v2.0/ports?tenant_id=b32a0178e35546828deb4b131cde3201&device_id=a88a7518-b01c-49a5-96f0-7cb8608682c8 HTTP/1.1" status: 200  len: 1096 time: 0.0820501
May 25 17:54:06.931293 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.notifiers.nova [req-3925f2dd-c91e-4328-bdef-909519739faf req-055756b5-30e8-4510-964f-fece910e947f service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 940c93c6-ab4c-47b9-9b48-31aabb845ba8 {{(pid=99027) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 25 17:54:06.940780 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-3925f2dd-c91e-4328-bdef-909519739faf req-055756b5-30e8-4510-964f-fece910e947f service neutron] Notify callbacks [] for port, precommit_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:54:06.955662 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.provisioning_blocks [req-3925f2dd-c91e-4328-bdef-909519739faf req-055756b5-30e8-4510-964f-fece910e947f service neutron] Transition to ACTIVE for port object 940c93c6-ab4c-47b9-9b48-31aabb845ba8 will not be triggered until provisioned by entity L2. {{(pid=99027) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 17:54:07.072495 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-3925f2dd-c91e-4328-bdef-909519739faf req-055756b5-30e8-4510-964f-fece910e947f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15468979'] for port, after_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:54:07.077564 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-44dbc8a0-a50a-4a6a-a7f6-ab873b2d7e63 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:54:07.130897 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2eb2e737-92ef-4ee5-8f13-c0beeed1dc0a req-08f7256a-3855-48dc-be72-c2fa0ab505a5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:54:07.132341 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-2eb2e737-92ef-4ee5-8f13-c0beeed1dc0a req-08f7256a-3855-48dc-be72-c2fa0ab505a5 service neutron] 10.222.0.125 "GET /v2.0/networks?tenant_id=b32a0178e35546828deb4b131cde3201&shared=False HTTP/1.1" status: 200  len: 910 time: 0.3019984
May 25 17:54:07.147003 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f6340c9-e473-41f9-b9b5-7f1b39136489 req-e987f7d3-f20b-4c2f-a476-742ce4a20e12 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:54:07.148373 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-5f6340c9-e473-41f9-b9b5-7f1b39136489 req-e987f7d3-f20b-4c2f-a476-742ce4a20e12 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] 10.222.0.122 "GET /v2.0/ports?device_id=a88a7518-b01c-49a5-96f0-7cb8608682c8 HTTP/1.1" status: 200  len: 943 time: 0.1418681
May 25 17:54:07.256100 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-055756b5-30e8-4510-964f-fece910e947f service neutron] Pushing event updated for resources: {'Port': ['ID=940c93c6-ab4c-47b9-9b48-31aabb845ba8,revision_number=2']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:54:07.263186 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-055756b5-30e8-4510-964f-fece910e947f service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.186s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:54:07.285590 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-5f6340c9-e473-41f9-b9b5-7f1b39136489 req-3b72eabe-3738-449e-84bd-acf097309008 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] 10.222.0.122 "GET /v2.0/security-groups?id=d5b71c00-54cd-4760-821a-82059bd31db8&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1162655
May 25 17:54:07.325286 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2eb2e737-92ef-4ee5-8f13-c0beeed1dc0a req-b00fd9bb-2e04-4f35-adc0-057495cb5716 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:54:07.327286 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-2eb2e737-92ef-4ee5-8f13-c0beeed1dc0a req-b00fd9bb-2e04-4f35-adc0-057495cb5716 service neutron] 10.222.0.125 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 871 time: 0.1779299
May 25 17:54:07.386553 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-231b7879-d906-4523-8088-b4caf9c1ef71 req-2b43d1e9-fbe0-4e8e-aa97-816022dd2222 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:54:07.387250 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-231b7879-d906-4523-8088-b4caf9c1ef71 req-2b43d1e9-fbe0-4e8e-aa97-816022dd2222 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Synchronizing usage tracker for tenant:cf02997eda314aee8fb322add2fbb921 on resource:port {{(pid=99027) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 17:54:07.414434 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.managers [req-3925f2dd-c91e-4328-bdef-909519739faf req-055756b5-30e8-4510-964f-fece910e947f service neutron] Attempting to bind port 940c93c6-ab4c-47b9-9b48-31aabb845ba8 on host hv-cinder-78956 for vnic_type normal with profile  {{(pid=99027) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 17:54:07.414960 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.managers [req-3925f2dd-c91e-4328-bdef-909519739faf req-055756b5-30e8-4510-964f-fece910e947f service neutron] Attempting to bind port 940c93c6-ab4c-47b9-9b48-31aabb845ba8 by drivers openvswitch,hyperv on host hv-cinder-78956 at level 0 using segments [{'id': 'e9a4953c-bd2f-4412-9030-8eb2cd20f5c5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1318, 'network_id': '45b850af-d423-458a-855a-d7f828a11fff'}] {{(pid=99027) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 17:54:07.415407 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3925f2dd-c91e-4328-bdef-909519739faf req-055756b5-30e8-4510-964f-fece910e947f service neutron] Attempting to bind port 940c93c6-ab4c-47b9-9b48-31aabb845ba8 on network 45b850af-d423-458a-855a-d7f828a11fff {{(pid=99027) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 17:54:07.420309 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3925f2dd-c91e-4328-bdef-909519739faf req-055756b5-30e8-4510-964f-fece910e947f service neutron] Port 940c93c6-ab4c-47b9-9b48-31aabb845ba8 on network 45b850af-d423-458a-855a-d7f828a11fff not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78956 {{(pid=99027) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 25 17:54:07.421186 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3925f2dd-c91e-4328-bdef-909519739faf req-055756b5-30e8-4510-964f-fece910e947f service neutron] Attempting to bind port 940c93c6-ab4c-47b9-9b48-31aabb845ba8 on network 45b850af-d423-458a-855a-d7f828a11fff {{(pid=99027) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 17:54:07.430004 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3925f2dd-c91e-4328-bdef-909519739faf req-055756b5-30e8-4510-964f-fece910e947f service neutron] Checking agent: {'id': '4d02a528-6a0e-4977-985f-4bcff1ca6cb7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78956', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 17, 40, 41), 'started_at': datetime.datetime(2021, 5, 25, 17, 40, 41), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 17, 53, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=99027) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 17:54:07.430004 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3925f2dd-c91e-4328-bdef-909519739faf req-055756b5-30e8-4510-964f-fece910e947f service neutron] Checking segment: {'id': 'e9a4953c-bd2f-4412-9030-8eb2cd20f5c5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1318, 'network_id': '45b850af-d423-458a-855a-d7f828a11fff'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=99027) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 17:54:07.430004 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3925f2dd-c91e-4328-bdef-909519739faf req-055756b5-30e8-4510-964f-fece910e947f service neutron] Bound using segment: {'id': 'e9a4953c-bd2f-4412-9030-8eb2cd20f5c5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1318, 'network_id': '45b850af-d423-458a-855a-d7f828a11fff'} {{(pid=99027) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 17:54:07.430004 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.managers [req-3925f2dd-c91e-4328-bdef-909519739faf req-055756b5-30e8-4510-964f-fece910e947f service neutron] Bound port: 940c93c6-ab4c-47b9-9b48-31aabb845ba8, host: hv-cinder-78956, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'e9a4953c-bd2f-4412-9030-8eb2cd20f5c5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1318, 'network_id': '45b850af-d423-458a-855a-d7f828a11fff'}}] {{(pid=99027) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 17:54:07.430004 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-3925f2dd-c91e-4328-bdef-909519739faf req-055756b5-30e8-4510-964f-fece910e947f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:54:07.436993 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2f9c9e8-4005-40f5-977b-95eea7e11bd8 req-686c74ad-7d47-46f6-b1fd-bb7d62b197bd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:54:07.438552 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-d2f9c9e8-4005-40f5-977b-95eea7e11bd8 req-686c74ad-7d47-46f6-b1fd-bb7d62b197bd service neutron] 10.222.0.125 "GET /v2.0/ports?tenant_id=b32a0178e35546828deb4b131cde3201&device_id=a88a7518-b01c-49a5-96f0-7cb8608682c8 HTTP/1.1" status: 200  len: 1096 time: 0.0724173
May 25 17:54:07.515283 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-d2f9c9e8-4005-40f5-977b-95eea7e11bd8 req-65ac5162-83ae-4e21-89a4-782e6a3dda9d service neutron] 10.222.0.125 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=e70c756f-3f35-4e5a-b4d2-444540756468 HTTP/1.1" status: 200  len: 217 time: 0.0674610
May 25 17:54:07.561122 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-231b7879-d906-4523-8088-b4caf9c1ef71 req-2b43d1e9-fbe0-4e8e-aa97-816022dd2222 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Unset dirty status for tenant:cf02997eda314aee8fb322add2fbb921 on resource:port {{(pid=99027) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 17:54:07.561989 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-231b7879-d906-4523-8088-b4caf9c1ef71 req-2b43d1e9-fbe0-4e8e-aa97-816022dd2222 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.122 "GET /v2.0/ports?device_id=6f66d198-4e81-4b59-a5ed-d28bf9c046e3 HTTP/1.1" status: 200  len: 944 time: 0.4480276
May 25 17:54:07.582258 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2f9c9e8-4005-40f5-977b-95eea7e11bd8 req-4db8739a-02e6-434a-82d3-7ba8f7a4fc2b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:54:07.583933 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-d2f9c9e8-4005-40f5-977b-95eea7e11bd8 req-4db8739a-02e6-434a-82d3-7ba8f7a4fc2b service neutron] 10.222.0.125 "GET /v2.0/subnets?id=69cd9818-8734-45ed-94ad-ee676be865a2 HTTP/1.1" status: 200  len: 847 time: 0.0616133
May 25 17:54:07.638573 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-231b7879-d906-4523-8088-b4caf9c1ef71 req-cf69a966-9dec-462e-a8d2-ba5876102ca8 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.122 "GET /v2.0/security-groups?id=f96a2660-11f5-4f6d-a34a-0a5f0713b90d&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0654981
May 25 17:54:07.644626 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.db [req-3925f2dd-c91e-4328-bdef-909519739faf req-055756b5-30e8-4510-964f-fece910e947f service neutron] For port 940c93c6-ab4c-47b9-9b48-31aabb845ba8, host hv-cinder-78956, cleared binding levels {{(pid=99027) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 17:54:07.648061 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.db [req-3925f2dd-c91e-4328-bdef-909519739faf req-055756b5-30e8-4510-964f-fece910e947f service neutron] For port 940c93c6-ab4c-47b9-9b48-31aabb845ba8, host hv-cinder-78956, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=940c93c6-ab4c-47b9-9b48-31aabb845ba8,segment=NetworkSegment(e9a4953c-bd2f-4412-9030-8eb2cd20f5c5),segment_id=e9a4953c-bd2f-4412-9030-8eb2cd20f5c5)] {{(pid=99027) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 17:54:07.682024 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2f9c9e8-4005-40f5-977b-95eea7e11bd8 req-88e2edd9-7d23-4cb8-a72e-d57403198254 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:54:07.683732 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-d2f9c9e8-4005-40f5-977b-95eea7e11bd8 req-88e2edd9-7d23-4cb8-a72e-d57403198254 service neutron] 10.222.0.125 "GET /v2.0/ports?network_id=0293f9ff-afda-47ba-aab9-1aac8ea6403d&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0911434
May 25 17:54:07.726754 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-3925f2dd-c91e-4328-bdef-909519739faf req-055756b5-30e8-4510-964f-fece910e947f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15468979'] for port, after_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:54:07.730785 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-837dd13d-d33c-460b-826b-8adb4f36a3ec tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:54:07.794561 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3925f2dd-c91e-4328-bdef-909519739faf req-055756b5-30e8-4510-964f-fece910e947f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:54:07.795207 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-3925f2dd-c91e-4328-bdef-909519739faf req-055756b5-30e8-4510-964f-fece910e947f service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-239387'] for port, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:54:07.796571 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-3925f2dd-c91e-4328-bdef-909519739faf req-055756b5-30e8-4510-964f-fece910e947f service neutron] 10.222.0.125 "PUT /v2.0/ports/940c93c6-ab4c-47b9-9b48-31aabb845ba8 HTTP/1.1" status: 200  len: 1094 time: 1.3625152
May 25 17:54:07.797100 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6f66d198-4e81-4b59-a5ed-d28bf9c046e3', 'tag': '940c93c6-ab4c-47b9-9b48-31aabb845ba8'}] {{(pid=99027) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 17:54:07.823542 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-055756b5-30e8-4510-964f-fece910e947f service neutron] Pushing event updated for resources: {'Port': ['ID=940c93c6-ab4c-47b9-9b48-31aabb845ba8,revision_number=3']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:54:07.823756 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-d2f9c9e8-4005-40f5-977b-95eea7e11bd8 req-dd445f47-f4c7-418d-bf66-21bc89707f22 service neutron] 10.222.0.125 "GET /v2.0/networks/0293f9ff-afda-47ba-aab9-1aac8ea6403d?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1342986
May 25 17:54:07.826916 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-055756b5-30e8-4510-964f-fece910e947f service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.096s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:54:07.915675 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6f66d198-4e81-4b59-a5ed-d28bf9c046e3', 'tag': '940c93c6-ab4c-47b9-9b48-31aabb845ba8', 'status': 'completed', 'code': 200}
May 25 17:54:07.963325 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-d2f9c9e8-4005-40f5-977b-95eea7e11bd8 req-8a6347eb-b69e-41d6-82ed-44c3ad376be8 service neutron] 10.222.0.125 "GET /v2.0/networks/0293f9ff-afda-47ba-aab9-1aac8ea6403d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1331925
May 25 17:54:07.997714 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3925f2dd-c91e-4328-bdef-909519739faf req-fe8e6cc2-c5e5-470d-b111-0babaf1a4a9c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:54:07.999183 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-3925f2dd-c91e-4328-bdef-909519739faf req-fe8e6cc2-c5e5-470d-b111-0babaf1a4a9c service neutron] 10.222.0.125 "GET /v2.0/ports?tenant_id=cf02997eda314aee8fb322add2fbb921&device_id=6f66d198-4e81-4b59-a5ed-d28bf9c046e3 HTTP/1.1" status: 200  len: 1097 time: 0.0741937
May 25 17:54:08.070678 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-3925f2dd-c91e-4328-bdef-909519739faf req-2c59c554-0de7-4ef5-82ff-ff28caf63b18 service neutron] 10.222.0.125 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=940c93c6-ab4c-47b9-9b48-31aabb845ba8 HTTP/1.1" status: 200  len: 217 time: 0.0652375
May 25 17:54:08.145659 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3925f2dd-c91e-4328-bdef-909519739faf req-3ea0e758-e545-4708-a5b8-de4795ae19b9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:54:08.147132 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-3925f2dd-c91e-4328-bdef-909519739faf req-3ea0e758-e545-4708-a5b8-de4795ae19b9 service neutron] 10.222.0.125 "GET /v2.0/subnets?id=704d0a85-ee4f-4df2-90a3-a525dfe28461 HTTP/1.1" status: 200  len: 856 time: 0.0609190
May 25 17:54:08.231620 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3925f2dd-c91e-4328-bdef-909519739faf req-93c48632-dff9-4eb2-9271-a3a0b442d055 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:54:08.233107 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-3925f2dd-c91e-4328-bdef-909519739faf req-93c48632-dff9-4eb2-9271-a3a0b442d055 service neutron] 10.222.0.125 "GET /v2.0/ports?network_id=45b850af-d423-458a-855a-d7f828a11fff&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0764921
May 25 17:54:08.387662 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-3925f2dd-c91e-4328-bdef-909519739faf req-e0893313-ecb7-4bd2-bd9c-c39c36f54834 service neutron] 10.222.0.125 "GET /v2.0/networks/45b850af-d423-458a-855a-d7f828a11fff?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1447420
May 25 17:54:08.480271 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9201589-414a-4892-a81d-03579f7ee3cd req-e45130af-ad7c-4efd-9e1a-d648451f9a40 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:54:08.482478 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-c9201589-414a-4892-a81d-03579f7ee3cd req-e45130af-ad7c-4efd-9e1a-d648451f9a40 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] 10.222.0.122 "GET /v2.0/ports?device_id=a88a7518-b01c-49a5-96f0-7cb8608682c8 HTTP/1.1" status: 200  len: 943 time: 0.0810742
May 25 17:54:08.528484 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-3925f2dd-c91e-4328-bdef-909519739faf req-8bf26875-d505-4e91-9582-2a7dc9de8253 service neutron] 10.222.0.125 "GET /v2.0/networks/45b850af-d423-458a-855a-d7f828a11fff?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1311300
May 25 17:54:08.528801 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-c9201589-414a-4892-a81d-03579f7ee3cd req-32c6649c-d712-4ead-bf9e-8700c64b9960 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] 10.222.0.122 "GET /v2.0/security-groups?id=d5b71c00-54cd-4760-821a-82059bd31db8&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0394809
May 25 17:54:08.711549 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c90d8ab-8640-49f6-bf93-b36b73103c22 req-e2d8a680-3713-4e23-9cce-63cfe417ac2c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:54:08.713524 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-6c90d8ab-8640-49f6-bf93-b36b73103c22 req-e2d8a680-3713-4e23-9cce-63cfe417ac2c service neutron] 10.222.0.125 "GET /v2.0/ports?tenant_id=cf02997eda314aee8fb322add2fbb921&device_id=6f66d198-4e81-4b59-a5ed-d28bf9c046e3 HTTP/1.1" status: 200  len: 1097 time: 0.0752103
May 25 17:54:08.910850 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c90d8ab-8640-49f6-bf93-b36b73103c22 req-1b362917-9142-4dd5-8cff-a7be6a800bff service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:54:08.912295 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-6c90d8ab-8640-49f6-bf93-b36b73103c22 req-1b362917-9142-4dd5-8cff-a7be6a800bff service neutron] 10.222.0.125 "GET /v2.0/networks?id=45b850af-d423-458a-855a-d7f828a11fff HTTP/1.1" status: 200  len: 919 time: 0.1895266
May 25 17:54:08.920217 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b278344-d4d7-4f25-850e-7f7bec205992 req-98b7925b-8605-43df-9f30-5b911aabd483 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:54:08.921699 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-4b278344-d4d7-4f25-850e-7f7bec205992 req-98b7925b-8605-43df-9f30-5b911aabd483 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.122 "GET /v2.0/ports?device_id=6f66d198-4e81-4b59-a5ed-d28bf9c046e3 HTTP/1.1" status: 200  len: 944 time: 0.1244950
May 25 17:54:08.995260 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-6c90d8ab-8640-49f6-bf93-b36b73103c22 req-38f7bd3b-0c18-418e-9030-44a99694b6b3 service neutron] 10.222.0.125 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=940c93c6-ab4c-47b9-9b48-31aabb845ba8 HTTP/1.1" status: 200  len: 217 time: 0.0726223
May 25 17:54:09.065043 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-4b278344-d4d7-4f25-850e-7f7bec205992 req-057dc82a-242e-4417-80c0-ef104f417550 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.122 "GET /v2.0/security-groups?id=f96a2660-11f5-4f6d-a34a-0a5f0713b90d&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0951381
May 25 17:54:09.076878 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c90d8ab-8640-49f6-bf93-b36b73103c22 req-3602b67e-c657-4407-a5c3-60732dbc4061 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:54:09.078352 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-6c90d8ab-8640-49f6-bf93-b36b73103c22 req-3602b67e-c657-4407-a5c3-60732dbc4061 service neutron] 10.222.0.125 "GET /v2.0/subnets?id=704d0a85-ee4f-4df2-90a3-a525dfe28461 HTTP/1.1" status: 200  len: 856 time: 0.0778244
May 25 17:54:09.157377 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c90d8ab-8640-49f6-bf93-b36b73103c22 req-e83d69c5-09f3-4ac0-9cde-79dc504cba34 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:54:09.159257 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-6c90d8ab-8640-49f6-bf93-b36b73103c22 req-e83d69c5-09f3-4ac0-9cde-79dc504cba34 service neutron] 10.222.0.125 "GET /v2.0/ports?network_id=45b850af-d423-458a-855a-d7f828a11fff&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0726058
May 25 17:54:09.296352 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-6c90d8ab-8640-49f6-bf93-b36b73103c22 req-99e2b35b-1db9-4dad-825c-2b068ab2938a service neutron] 10.222.0.125 "GET /v2.0/networks/45b850af-d423-458a-855a-d7f828a11fff?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1274025
May 25 17:54:09.427876 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-6c90d8ab-8640-49f6-bf93-b36b73103c22 req-e8d3d0bc-0506-43cf-a6c0-023b43710ab7 service neutron] 10.222.0.125 "GET /v2.0/networks/45b850af-d423-458a-855a-d7f828a11fff?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1262717
May 25 17:54:09.719905 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5219a535-4903-47fa-a7b2-34717e929650 req-3903aab1-c334-4845-9abf-2d51d3258eee tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:54:09.721966 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-5219a535-4903-47fa-a7b2-34717e929650 req-3903aab1-c334-4845-9abf-2d51d3258eee tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] 10.222.0.122 "GET /v2.0/ports?device_id=a88a7518-b01c-49a5-96f0-7cb8608682c8 HTTP/1.1" status: 200  len: 943 time: 0.0848293
May 25 17:54:09.765663 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-5219a535-4903-47fa-a7b2-34717e929650 req-5cba5072-692a-4a3d-ac85-81ec8fe6b062 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] 10.222.0.122 "GET /v2.0/security-groups?id=d5b71c00-54cd-4760-821a-82059bd31db8&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0380614
May 25 17:54:10.253321 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e9329ba-a682-492f-b94f-30e5a41404e2 req-4276b954-648f-4b23-8397-75b3fa26192f tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:54:10.255093 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-8e9329ba-a682-492f-b94f-30e5a41404e2 req-4276b954-648f-4b23-8397-75b3fa26192f tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.122 "GET /v2.0/ports?device_id=6f66d198-4e81-4b59-a5ed-d28bf9c046e3 HTTP/1.1" status: 200  len: 944 time: 0.0808287
May 25 17:54:10.306051 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-8e9329ba-a682-492f-b94f-30e5a41404e2 req-e3ec7afd-cce6-4a29-ba49-6fe0b3368c41 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.122 "GET /v2.0/security-groups?id=f96a2660-11f5-4f6d-a34a-0a5f0713b90d&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0452096
May 25 17:54:11.043377 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f85c4c15-9747-4791-89b9-78e014c15e3b req-41a04ad8-0550-4821-8455-5d880986d963 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:54:11.044846 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-f85c4c15-9747-4791-89b9-78e014c15e3b req-41a04ad8-0550-4821-8455-5d880986d963 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] 10.222.0.122 "GET /v2.0/ports?device_id=a88a7518-b01c-49a5-96f0-7cb8608682c8 HTTP/1.1" status: 200  len: 943 time: 0.1727436
May 25 17:54:11.091166 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-f85c4c15-9747-4791-89b9-78e014c15e3b req-40755f8b-03cc-45f1-a635-6bf6d7986d29 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] 10.222.0.122 "GET /v2.0/security-groups?id=d5b71c00-54cd-4760-821a-82059bd31db8&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0402210
May 25 17:54:11.497349 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94e7a88a-d6db-49fa-b2ff-6bbaeeb4672d req-3a5df5d8-2c50-488f-9ffc-7e32416b89a9 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:54:11.498816 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-94e7a88a-d6db-49fa-b2ff-6bbaeeb4672d req-3a5df5d8-2c50-488f-9ffc-7e32416b89a9 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.122 "GET /v2.0/ports?device_id=6f66d198-4e81-4b59-a5ed-d28bf9c046e3 HTTP/1.1" status: 200  len: 944 time: 0.0803900
May 25 17:54:11.516737 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Device 940c93c6-ab4c-47b9-9b48-31aabb845ba8 details requested by agent hyperv_hv-cinder-78956 with host hv-cinder-78956 {{(pid=99028) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 25 17:54:11.546203 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-94e7a88a-d6db-49fa-b2ff-6bbaeeb4672d req-68041447-26d3-4f8f-bdda-b7763ed2d918 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.122 "GET /v2.0/security-groups?id=f96a2660-11f5-4f6d-a34a-0a5f0713b90d&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0406020
May 25 17:54:11.644959 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:54:11.701780 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] For port 940c93c6-ab4c-47b9-9b48-31aabb845ba8, host hv-cinder-78956, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=940c93c6-ab4c-47b9-9b48-31aabb845ba8,segment=NetworkSegment(e9a4953c-bd2f-4412-9030-8eb2cd20f5c5),segment_id=e9a4953c-bd2f-4412-9030-8eb2cd20f5c5)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:54:11.715221 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Returning: {'device': '940c93c6-ab4c-47b9-9b48-31aabb845ba8', 'network_id': '45b850af-d423-458a-855a-d7f828a11fff', 'port_id': '940c93c6-ab4c-47b9-9b48-31aabb845ba8', 'mac_address': 'fa:16:3e:c9:71:50', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1318, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '704d0a85-ee4f-4df2-90a3-a525dfe28461', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=99028) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 25 17:54:11.769580 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:54:11.788423 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.notifiers.nova [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 940c93c6-ab4c-47b9-9b48-31aabb845ba8 {{(pid=99028) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 25 17:54:11.803714 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] For port 940c93c6-ab4c-47b9-9b48-31aabb845ba8, host hv-cinder-78956, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=940c93c6-ab4c-47b9-9b48-31aabb845ba8,segment=NetworkSegment(e9a4953c-bd2f-4412-9030-8eb2cd20f5c5),segment_id=e9a4953c-bd2f-4412-9030-8eb2cd20f5c5)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:54:11.878219 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:54:11.880196 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:54:11.945657 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Pushing event updated for resources: {'Port': ['ID=940c93c6-ab4c-47b9-9b48-31aabb845ba8,revision_number=4']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:54:11.953655 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:54:11.954034 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:54:11.954374 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:54:11.954956 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:54:11.955543 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:54:11.955989 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:54:11.956324 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:54:11.956687 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:54:11.957020 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:54:11.957393 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:54:11.957721 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:54:11.958045 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:54:11.962057 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:54:12.285494 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fed2d1de-87a4-44c8-900a-7156cbb41349 req-9c073197-cbd4-421b-bf87-3ecc56491e27 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:54:12.286992 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-fed2d1de-87a4-44c8-900a-7156cbb41349 req-9c073197-cbd4-421b-bf87-3ecc56491e27 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] 10.222.0.122 "GET /v2.0/ports?device_id=a88a7518-b01c-49a5-96f0-7cb8608682c8 HTTP/1.1" status: 200  len: 943 time: 0.0872025
May 25 17:54:12.341107 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-fed2d1de-87a4-44c8-900a-7156cbb41349 req-157d1318-e4a2-4949-a018-756abd2072e4 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] 10.222.0.122 "GET /v2.0/security-groups?id=d5b71c00-54cd-4760-821a-82059bd31db8&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0483677
May 25 17:54:12.345598 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] get_ports_and_sgs() called for port_ids ['940c93c6-ab4c-47b9-9b48-31aabb845ba8'] {{(pid=99028) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 25 17:54:12.783555 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-210b8b79-020d-4adb-b847-1618af3043f4 req-365ec17c-7f10-4f78-80d9-55b1d4ba0f70 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:54:12.784942 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-210b8b79-020d-4adb-b847-1618af3043f4 req-365ec17c-7f10-4f78-80d9-55b1d4ba0f70 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.122 "GET /v2.0/ports?device_id=6f66d198-4e81-4b59-a5ed-d28bf9c046e3 HTTP/1.1" status: 200  len: 945 time: 0.0815816
May 25 17:54:12.831690 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-210b8b79-020d-4adb-b847-1618af3043f4 req-b4a4df3b-701f-434e-8981-01100dc030a7 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.122 "GET /v2.0/security-groups?id=f96a2660-11f5-4f6d-a34a-0a5f0713b90d&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0409946
May 25 17:54:13.537996 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25b1e4ff-2af9-4903-a5e4-e40ce3ec5a64 req-cb3a45f3-5deb-4881-8be1-a735eb2c3892 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:54:13.538234 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Device 940c93c6-ab4c-47b9-9b48-31aabb845ba8 up at agent hyperv_hv-cinder-78956 {{(pid=99028) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 17:54:13.539397 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-25b1e4ff-2af9-4903-a5e4-e40ce3ec5a64 req-cb3a45f3-5deb-4881-8be1-a735eb2c3892 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] 10.222.0.122 "GET /v2.0/ports?device_id=a88a7518-b01c-49a5-96f0-7cb8608682c8 HTTP/1.1" status: 200  len: 943 time: 0.0843928
May 25 17:54:13.583937 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-25b1e4ff-2af9-4903-a5e4-e40ce3ec5a64 req-af3a52c2-b045-4d0c-b39c-dbb5978f7c4a tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] 10.222.0.122 "GET /v2.0/security-groups?id=d5b71c00-54cd-4760-821a-82059bd31db8&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0388932
May 25 17:54:13.677992 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Provisioning for port 940c93c6-ab4c-47b9-9b48-31aabb845ba8 completed by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 17:54:13.683088 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Provisioning complete for port 940c93c6-ab4c-47b9-9b48-31aabb845ba8 triggered by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 17:54:13.683460 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:54:13.812677 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:54:13.839586 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6f66d198-4e81-4b59-a5ed-d28bf9c046e3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '940c93c6-ab4c-47b9-9b48-31aabb845ba8'}] {{(pid=99028) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 17:54:13.848950 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] For port 940c93c6-ab4c-47b9-9b48-31aabb845ba8, host hv-cinder-78956, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=940c93c6-ab4c-47b9-9b48-31aabb845ba8,segment=NetworkSegment(e9a4953c-bd2f-4412-9030-8eb2cd20f5c5),segment_id=e9a4953c-bd2f-4412-9030-8eb2cd20f5c5)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:54:13.906880 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:54:13.909017 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:54:13.957709 dv-cinder-789564-2-iscsi neutron-server[99028]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6f66d198-4e81-4b59-a5ed-d28bf9c046e3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '940c93c6-ab4c-47b9-9b48-31aabb845ba8', 'code': 200}
May 25 17:54:13.978818 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Pushing event updated for resources: {'Port': ['ID=940c93c6-ab4c-47b9-9b48-31aabb845ba8,revision_number=5']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:54:13.982134 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:54:14.029348 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2df77f4-b8e2-4dcf-96d5-8a35c261739a req-64f802d7-20d7-4916-9fe2-ce0c7762594a tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:54:14.030871 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-c2df77f4-b8e2-4dcf-96d5-8a35c261739a req-64f802d7-20d7-4916-9fe2-ce0c7762594a tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.122 "GET /v2.0/ports?device_id=6f66d198-4e81-4b59-a5ed-d28bf9c046e3 HTTP/1.1" status: 200  len: 946 time: 0.0893576
May 25 17:54:14.079427 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-c2df77f4-b8e2-4dcf-96d5-8a35c261739a req-aaf582e8-a38f-4317-8411-fcb2b4e28f29 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.122 "GET /v2.0/security-groups?id=f96a2660-11f5-4f6d-a34a-0a5f0713b90d&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0421813
May 25 17:54:14.356738 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e6488ff-1822-426d-ac5a-cb3f6074beba req-71913e25-7be4-46dc-a8f4-49721481b750 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:54:14.358251 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-8e6488ff-1822-426d-ac5a-cb3f6074beba req-71913e25-7be4-46dc-a8f4-49721481b750 service neutron] 10.222.0.125 "GET /v2.0/ports?device_id=6f66d198-4e81-4b59-a5ed-d28bf9c046e3 HTTP/1.1" status: 200  len: 1099 time: 0.0755615
May 25 17:54:14.401646 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-8e6488ff-1822-426d-ac5a-cb3f6074beba req-65c1e581-86a5-41f1-85f9-bdfc2217a92e service neutron] 10.222.0.125 "GET /v2.0/security-groups?id=f96a2660-11f5-4f6d-a34a-0a5f0713b90d&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0346978
May 25 17:54:14.785742 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c413aa2-f2ee-4d58-89c5-3d9093e36e12 req-e49ebea4-fd52-4593-8ed9-a14ab1a9de81 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:54:14.787194 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-5c413aa2-f2ee-4d58-89c5-3d9093e36e12 req-e49ebea4-fd52-4593-8ed9-a14ab1a9de81 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] 10.222.0.122 "GET /v2.0/ports?device_id=a88a7518-b01c-49a5-96f0-7cb8608682c8 HTTP/1.1" status: 200  len: 943 time: 0.0883749
May 25 17:54:14.832585 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-5c413aa2-f2ee-4d58-89c5-3d9093e36e12 req-9e9ed7e8-108d-4f4d-8bb8-5a15a119fed3 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] 10.222.0.122 "GET /v2.0/security-groups?id=d5b71c00-54cd-4760-821a-82059bd31db8&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0397956
May 25 17:54:15.277820 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e698cd83-dce0-483c-8617-475d99e680e5 req-c0273056-e351-4591-a12f-3cd9568393f1 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:54:15.279319 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-e698cd83-dce0-483c-8617-475d99e680e5 req-c0273056-e351-4591-a12f-3cd9568393f1 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.122 "GET /v2.0/ports?device_id=6f66d198-4e81-4b59-a5ed-d28bf9c046e3 HTTP/1.1" status: 200  len: 946 time: 0.0846891
May 25 17:54:15.326300 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-e698cd83-dce0-483c-8617-475d99e680e5 req-10e67fb2-7ff2-46dc-9141-73065f5572f6 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.122 "GET /v2.0/security-groups?id=f96a2660-11f5-4f6d-a34a-0a5f0713b90d&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0405130
May 25 17:54:15.538501 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Device e70c756f-3f35-4e5a-b4d2-444540756468 details requested by agent hyperv_hv-cinder-78956 with host hv-cinder-78956 {{(pid=99028) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 25 17:54:15.673291 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] For port e70c756f-3f35-4e5a-b4d2-444540756468, host hv-cinder-78956, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=e70c756f-3f35-4e5a-b4d2-444540756468,segment=NetworkSegment(66d2a99c-6c47-4a92-ac51-31e984766b29),segment_id=66d2a99c-6c47-4a92-ac51-31e984766b29)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:54:15.689775 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Returning: {'device': 'e70c756f-3f35-4e5a-b4d2-444540756468', 'network_id': '0293f9ff-afda-47ba-aab9-1aac8ea6403d', 'port_id': 'e70c756f-3f35-4e5a-b4d2-444540756468', 'mac_address': 'fa:16:3e:f1:d3:c9', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1321, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '69cd9818-8734-45ed-94ad-ee676be865a2', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=99028) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 25 17:54:15.744068 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:54:15.760518 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.notifiers.nova [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id e70c756f-3f35-4e5a-b4d2-444540756468 {{(pid=99028) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 25 17:54:15.776196 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] For port e70c756f-3f35-4e5a-b4d2-444540756468, host hv-cinder-78956, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=e70c756f-3f35-4e5a-b4d2-444540756468,segment=NetworkSegment(66d2a99c-6c47-4a92-ac51-31e984766b29),segment_id=66d2a99c-6c47-4a92-ac51-31e984766b29)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:54:15.863451 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:54:15.865282 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-3d35ebac-72d2-4683-8434-7c10cdd203cb None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:54:15.931953 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Pushing event updated for resources: {'Port': ['ID=e70c756f-3f35-4e5a-b4d2-444540756468,revision_number=4']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:54:15.935252 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:54:16.023531 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b6fda65-c6a7-4a0b-a6e5-c74ecba237df req-51ec14c3-e21b-44c3-b783-bcd16255d1cb tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:54:16.024895 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-4b6fda65-c6a7-4a0b-a6e5-c74ecba237df req-51ec14c3-e21b-44c3-b783-bcd16255d1cb tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] 10.222.0.122 "GET /v2.0/ports?device_id=a88a7518-b01c-49a5-96f0-7cb8608682c8 HTTP/1.1" status: 200  len: 944 time: 0.0844488
May 25 17:54:16.069864 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-4b6fda65-c6a7-4a0b-a6e5-c74ecba237df req-7ef918e4-77f5-431b-a1af-6f6217faf789 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] 10.222.0.122 "GET /v2.0/security-groups?id=d5b71c00-54cd-4760-821a-82059bd31db8&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0391350
May 25 17:54:16.080145 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] get_ports_and_sgs() called for port_ids ['e70c756f-3f35-4e5a-b4d2-444540756468'] {{(pid=99028) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 25 17:54:16.526740 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2c64613-c6ab-4969-908e-61b70492a246 req-22ff6664-ad13-476b-87b4-b6baedba0de1 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:54:16.528228 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-c2c64613-c6ab-4969-908e-61b70492a246 req-22ff6664-ad13-476b-87b4-b6baedba0de1 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.122 "GET /v2.0/ports?device_id=6f66d198-4e81-4b59-a5ed-d28bf9c046e3 HTTP/1.1" status: 200  len: 946 time: 0.0806115
May 25 17:54:16.573832 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-c2c64613-c6ab-4969-908e-61b70492a246 req-2d35a6cf-03a5-434b-9eda-e0ce805648c0 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.122 "GET /v2.0/security-groups?id=f96a2660-11f5-4f6d-a34a-0a5f0713b90d&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0391252
May 25 17:54:16.763430 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68635301-a108-440c-89c0-d17389433f57 req-d2ceea06-d45e-4ac2-aeb6-8488f223ad4b tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:54:16.765485 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-68635301-a108-440c-89c0-d17389433f57 req-d2ceea06-d45e-4ac2-aeb6-8488f223ad4b tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.122 "GET /v2.0/ports?device_id=6f66d198-4e81-4b59-a5ed-d28bf9c046e3 HTTP/1.1" status: 200  len: 946 time: 0.0857787
May 25 17:54:16.778749 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 49566) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:54:16.785010 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.v2.base [None req-883780fe-21fe-4fe5-851d-2ebe253bd5ba tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Request body: {'floatingip': {'port_id': '940c93c6-ab4c-47b9-9b48-31aabb845ba8'}} {{(pid=99027) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:54:16.865341 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-883780fe-21fe-4fe5-851d-2ebe253bd5ba tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify callbacks [] for floatingip, before_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:54:17.425444 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f16453fc-456c-4bac-9f84-f8ab18ae7cbf req-f4083b53-b25e-4f5f-ba86-4a73977981c2 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:54:17.427950 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-f16453fc-456c-4bac-9f84-f8ab18ae7cbf req-f4083b53-b25e-4f5f-ba86-4a73977981c2 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] 10.222.0.122 "GET /v2.0/ports?device_id=a88a7518-b01c-49a5-96f0-7cb8608682c8 HTTP/1.1" status: 200  len: 944 time: 0.2290819
May 25 17:54:17.491565 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-f16453fc-456c-4bac-9f84-f8ab18ae7cbf req-be1a0b4c-1072-49cf-b4a6-8c3852369e2c tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] 10.222.0.122 "GET /v2.0/security-groups?id=d5b71c00-54cd-4760-821a-82059bd31db8&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0580392
May 25 17:54:17.570659 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Device e70c756f-3f35-4e5a-b4d2-444540756468 up at agent hyperv_hv-cinder-78956 {{(pid=99028) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 17:54:17.623556 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-883780fe-21fe-4fe5-851d-2ebe253bd5ba tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify callbacks [] for floatingip, precommit_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:54:17.690651 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-883780fe-21fe-4fe5-851d-2ebe253bd5ba tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-419865'] for floatingip, after_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:54:17.720555 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Provisioning for port e70c756f-3f35-4e5a-b4d2-444540756468 completed by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 17:54:17.730972 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Provisioning complete for port e70c756f-3f35-4e5a-b4d2-444540756468 triggered by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 17:54:17.730972 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:54:17.884745 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:54:17.913927 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a88a7518-b01c-49a5-96f0-7cb8608682c8', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e70c756f-3f35-4e5a-b4d2-444540756468'}] {{(pid=99028) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 17:54:17.926027 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] For port e70c756f-3f35-4e5a-b4d2-444540756468, host hv-cinder-78956, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=e70c756f-3f35-4e5a-b4d2-444540756468,segment=NetworkSegment(66d2a99c-6c47-4a92-ac51-31e984766b29),segment_id=66d2a99c-6c47-4a92-ac51-31e984766b29)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:54:17.962852 dv-cinder-789564-2-iscsi neutron-server[99028]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a88a7518-b01c-49a5-96f0-7cb8608682c8', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e70c756f-3f35-4e5a-b4d2-444540756468', 'code': 200}
May 25 17:54:18.000516 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:54:18.003903 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-cf99e660-9af1-46cc-87aa-177a195e457e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:54:18.018694 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.db.l3_db [None req-883780fe-21fe-4fe5-851d-2ebe253bd5ba tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Floating IP 9b152d50-4873-4dbd-83c3-834c259bfe6f associated. External IP: 172.27.3.115, port: 940c93c6-ab4c-47b9-9b48-31aabb845ba8.
May 25 17:54:18.103412 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Pushing event updated for resources: {'Port': ['ID=e70c756f-3f35-4e5a-b4d2-444540756468,revision_number=5']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:54:18.108004 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.104s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:54:18.144066 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-3f9e993b-30ef-400c-adf8-9ce4525af50d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:54:18.459517 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-883780fe-21fe-4fe5-851d-2ebe253bd5ba tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Router 3ca50ec5-218d-44ad-8ffc-4318f54d7350 has already been hosted by L3 agent eaeb6875-c4ed-43b6-8658-aa4e52324fdf {{(pid=99027) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 25 17:54:18.528767 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17727c2e-acbb-4c6e-b81a-f96ba9b5c8e2 req-34444527-b3e5-48f1-8f77-0096fca263a1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:54:18.530279 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-17727c2e-acbb-4c6e-b81a-f96ba9b5c8e2 req-34444527-b3e5-48f1-8f77-0096fca263a1 service neutron] 10.222.0.125 "GET /v2.0/ports?device_id=a88a7518-b01c-49a5-96f0-7cb8608682c8 HTTP/1.1" status: 200  len: 1098 time: 0.1717253
May 25 17:54:18.658511 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-17727c2e-acbb-4c6e-b81a-f96ba9b5c8e2 req-1fa67b79-a61f-4cfc-9663-b53e238db336 service neutron] 10.222.0.125 "GET /v2.0/security-groups?id=d5b71c00-54cd-4760-821a-82059bd31db8&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1164868
May 25 17:54:18.683371 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-883780fe-21fe-4fe5-851d-2ebe253bd5ba tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify agent at l3_agent.dv-cinder-789564-2-iscsi the message routers_updated {{(pid=99027) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 25 17:54:18.687798 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-883780fe-21fe-4fe5-851d-2ebe253bd5ba tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-239387'] for floatingip, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:54:18.695676 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-eee2647e-d7ce-4ffb-b5d8-a8cffa4e812c None None] Sync routers for ids ['3ca50ec5-218d-44ad-8ffc-4318f54d7350'] in dv-cinder-789564-2-iscsi {{(pid=99028) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 25 17:54:18.706646 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eee2647e-d7ce-4ffb-b5d8-a8cffa4e812c None None] Routers {'3ca50ec5-218d-44ad-8ffc-4318f54d7350'} bound to L3 agent in host dv-cinder-789564-2-iscsi {{(pid=99028) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 17:54:18.707381 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-eee2647e-d7ce-4ffb-b5d8-a8cffa4e812c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcae7130700>, 'dv-cinder-789564-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T17:34:21Z,description=<?>,heartbeat_timestamp=2021-05-25T17:53:51Z,host='dv-cinder-789564-2-iscsi',id=eaeb6875-c4ed-43b6-8658-aa4e52324fdf,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T17:34:21Z,topic='l3_agent')) {'router_ids': ['3ca50ec5-218d-44ad-8ffc-4318f54d7350'], 'active': True} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:54:18.747973 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-883780fe-21fe-4fe5-851d-2ebe253bd5ba tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.122 "PUT /v2.0/floatingips/9b152d50-4873-4dbd-83c3-834c259bfe6f HTTP/1.1" status: 200  len: 992 time: 1.9656277
May 25 17:54:18.747973 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6f66d198-4e81-4b59-a5ed-d28bf9c046e3', 'tag': '940c93c6-ab4c-47b9-9b48-31aabb845ba8'}] {{(pid=99027) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 17:54:18.800534 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79e02d2d-edf9-4f5b-8d2d-c8875e8ab3cb req-9f7dbb0d-da6f-427d-a862-6a9218f6be8b tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:54:18.802310 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-79e02d2d-edf9-4f5b-8d2d-c8875e8ab3cb req-9f7dbb0d-da6f-427d-a862-6a9218f6be8b tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] 10.222.0.122 "GET /v2.0/ports?device_id=a88a7518-b01c-49a5-96f0-7cb8608682c8 HTTP/1.1" status: 200  len: 945 time: 0.1998248
May 25 17:54:18.850731 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-79e02d2d-edf9-4f5b-8d2d-c8875e8ab3cb req-f138ba84-d5c3-4c77-8b71-6254327868ab tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] 10.222.0.122 "GET /v2.0/security-groups?id=d5b71c00-54cd-4760-821a-82059bd31db8&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0424376
May 25 17:54:18.888599 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvr_db [None req-eee2647e-d7ce-4ffb-b5d8-a8cffa4e812c None None] Set router 3ca50ec5-218d-44ad-8ffc-4318f54d7350 gateway port host: dv-cinder-789564-2-iscsi {{(pid=99028) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 17:54:18.903746 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6f66d198-4e81-4b59-a5ed-d28bf9c046e3', 'tag': '940c93c6-ab4c-47b9-9b48-31aabb845ba8', 'status': 'completed', 'code': 200}
May 25 17:54:18.999454 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac2f7906-5eb3-4b04-87f0-aba35e192541 req-a714a389-6f30-47d5-a75b-9b4b81118671 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:54:19.000937 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-ac2f7906-5eb3-4b04-87f0-aba35e192541 req-a714a389-6f30-47d5-a75b-9b4b81118671 service neutron] 10.222.0.125 "GET /v2.0/ports?tenant_id=cf02997eda314aee8fb322add2fbb921&device_id=6f66d198-4e81-4b59-a5ed-d28bf9c046e3 HTTP/1.1" status: 200  len: 1099 time: 0.0754201
May 25 17:54:19.134572 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac2f7906-5eb3-4b04-87f0-aba35e192541 req-dfd1be6c-ac42-441c-a8e0-86b5a51014bd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:54:19.135955 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-ac2f7906-5eb3-4b04-87f0-aba35e192541 req-dfd1be6c-ac42-441c-a8e0-86b5a51014bd service neutron] 10.222.0.125 "GET /v2.0/networks?id=45b850af-d423-458a-855a-d7f828a11fff HTTP/1.1" status: 200  len: 919 time: 0.1299715
May 25 17:54:19.243397 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-ac2f7906-5eb3-4b04-87f0-aba35e192541 req-55282cc1-7410-413c-84ef-c58c5bd79c3a service neutron] 10.222.0.125 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=940c93c6-ab4c-47b9-9b48-31aabb845ba8 HTTP/1.1" status: 200  len: 1000 time: 0.1025453
May 25 17:54:19.280589 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-eee2647e-d7ce-4ffb-b5d8-a8cffa4e812c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcae7130700>, [{'id': '3ca50ec5-218d-44ad-8ffc-4318f54d7350', 'name': 'tempest-AttachVolumeShelveTestJSON-2113890446-router', 'tenant_id': 'cf02997eda314aee8fb322add2fbb921', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.226'}], 'enable_snat': True}, 'gw_port_id': '1e97124a-073a-4947-a6f2-359fb12ffe5e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:43:31Z', 'updated_at': '2021-05-25T17:43:37Z', 'revision_number': 4, 'project_id': 'cf02997eda314aee8fb322add2fbb921', 'gw_port': {'id': '1e97124a-073a-4947-a6f2-359fb12ffe5e', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:c8:ed:c5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3ca50ec5-218d-44ad-8ffc-4318f54d7350', 'device_owner': 'network:router_gateway', 'standard_attr_id': 244, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.226', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:43:33Z', 'updated_at': '2021-05-25T17:43:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi', '_floatingips': [{'id': '9b152d50-4873-4dbd-83c3-834c259bfe6f', 'tenant_id': 'cf02997eda314aee8fb322add2fbb921', 'floating_ip_address': '172.27.3.115', 'floating_network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'router_id': '3ca50ec5-218d-44ad-8ffc-4318f54d7350', 'port_id': '940c93c6-ab4c-47b9-9b48-31aabb845ba8', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 556, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '45b850af-d423-458a-855a-d7f828a11fff', 'mac_address': 'fa:16:3e:c9:71:50', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6f66d198-4e81-4b59-a5ed-d28bf9c046e3', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T17:53:59Z', 'updated_at': '2021-05-25T17:54:17Z', 'revision_number': 1, 'project_id': 'cf02997eda314aee8fb322add2fbb921', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'ada7bf8b-4ba6-4629-8693-a2574922e458', 'name': '', 'network_id': '45b850af-d423-458a-855a-d7f828a11fff', 'tenant_id': 'cf02997eda314aee8fb322add2fbb921', 'mac_address': 'fa:16:3e:59:34:b7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3ca50ec5-218d-44ad-8ffc-4318f54d7350', 'device_owner': 'network:router_interface', 'standard_attr_id': 255, 'fixed_ips': [{'subnet_id': '704d0a85-ee4f-4df2-90a3-a525dfe28461', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:43:37Z', 'updated_at': '2021-05-25T17:43:45Z', 'revision_number': 5, 'project_id': 'cf02997eda314aee8fb322add2fbb921', 'subnets': [{'id': '704d0a85-ee4f-4df2-90a3-a525dfe28461', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-789564-2-iscsi', False) {} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:54:19.285204 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-eee2647e-d7ce-4ffb-b5d8-a8cffa4e812c None None] Checking router: 3ca50ec5-218d-44ad-8ffc-4318f54d7350 for host: dv-cinder-789564-2-iscsi {{(pid=99028) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 25 17:54:19.294112 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eee2647e-d7ce-4ffb-b5d8-a8cffa4e812c None None] Routers {'3ca50ec5-218d-44ad-8ffc-4318f54d7350'} bound to L3 agent in host dv-cinder-789564-2-iscsi {{(pid=99028) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 17:54:19.294796 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-eee2647e-d7ce-4ffb-b5d8-a8cffa4e812c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcae7130700>, 'dv-cinder-789564-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T17:34:21Z,description=<?>,heartbeat_timestamp=2021-05-25T17:53:51Z,host='dv-cinder-789564-2-iscsi',id=eaeb6875-c4ed-43b6-8658-aa4e52324fdf,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T17:34:21Z,topic='l3_agent')) {'router_ids': ['3ca50ec5-218d-44ad-8ffc-4318f54d7350'], 'active': True} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:54:19.312284 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac2f7906-5eb3-4b04-87f0-aba35e192541 req-d87972e0-6553-450b-99a3-697d034647c3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:54:19.314279 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-ac2f7906-5eb3-4b04-87f0-aba35e192541 req-d87972e0-6553-450b-99a3-697d034647c3 service neutron] 10.222.0.125 "GET /v2.0/subnets?id=704d0a85-ee4f-4df2-90a3-a525dfe28461 HTTP/1.1" status: 200  len: 856 time: 0.0646837
May 25 17:54:19.393121 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac2f7906-5eb3-4b04-87f0-aba35e192541 req-6080ee2f-0bd0-44e1-9f81-dafdb43476e3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:54:19.395032 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-ac2f7906-5eb3-4b04-87f0-aba35e192541 req-6080ee2f-0bd0-44e1-9f81-dafdb43476e3 service neutron] 10.222.0.125 "GET /v2.0/ports?network_id=45b850af-d423-458a-855a-d7f828a11fff&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0760028
May 25 17:54:19.489371 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvr_db [None req-eee2647e-d7ce-4ffb-b5d8-a8cffa4e812c None None] Set router 3ca50ec5-218d-44ad-8ffc-4318f54d7350 gateway port host: dv-cinder-789564-2-iscsi {{(pid=99028) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 17:54:19.639610 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-ac2f7906-5eb3-4b04-87f0-aba35e192541 req-a7f549b4-5a8a-4fb4-8a63-16d63dbc2d9a service neutron] 10.222.0.125 "GET /v2.0/networks/45b850af-d423-458a-855a-d7f828a11fff?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2358475
May 25 17:54:19.778819 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-ac2f7906-5eb3-4b04-87f0-aba35e192541 req-c7637e60-c2f6-4f89-8c0c-e4eefed826be service neutron] 10.222.0.125 "GET /v2.0/networks/45b850af-d423-458a-855a-d7f828a11fff?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1316810
May 25 17:54:19.851876 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-eee2647e-d7ce-4ffb-b5d8-a8cffa4e812c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcae7130700>, [{'id': '3ca50ec5-218d-44ad-8ffc-4318f54d7350', 'name': 'tempest-AttachVolumeShelveTestJSON-2113890446-router', 'tenant_id': 'cf02997eda314aee8fb322add2fbb921', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.226'}], 'enable_snat': True}, 'gw_port_id': '1e97124a-073a-4947-a6f2-359fb12ffe5e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:43:31Z', 'updated_at': '2021-05-25T17:43:37Z', 'revision_number': 4, 'project_id': 'cf02997eda314aee8fb322add2fbb921', 'gw_port': {'id': '1e97124a-073a-4947-a6f2-359fb12ffe5e', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:c8:ed:c5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3ca50ec5-218d-44ad-8ffc-4318f54d7350', 'device_owner': 'network:router_gateway', 'standard_attr_id': 244, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.226', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:43:33Z', 'updated_at': '2021-05-25T17:43:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi', '_floatingips': [{'id': '9b152d50-4873-4dbd-83c3-834c259bfe6f', 'tenant_id': 'cf02997eda314aee8fb322add2fbb921', 'floating_ip_address': '172.27.3.115', 'floating_network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'router_id': '3ca50ec5-218d-44ad-8ffc-4318f54d7350', 'port_id': '940c93c6-ab4c-47b9-9b48-31aabb845ba8', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 556, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '45b850af-d423-458a-855a-d7f828a11fff', 'mac_address': 'fa:16:3e:c9:71:50', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6f66d198-4e81-4b59-a5ed-d28bf9c046e3', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T17:53:59Z', 'updated_at': '2021-05-25T17:54:17Z', 'revision_number': 1, 'project_id': 'cf02997eda314aee8fb322add2fbb921', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'ada7bf8b-4ba6-4629-8693-a2574922e458', 'name': '', 'network_id': '45b850af-d423-458a-855a-d7f828a11fff', 'tenant_id': 'cf02997eda314aee8fb322add2fbb921', 'mac_address': 'fa:16:3e:59:34:b7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3ca50ec5-218d-44ad-8ffc-4318f54d7350', 'device_owner': 'network:router_interface', 'standard_attr_id': 255, 'fixed_ips': [{'subnet_id': '704d0a85-ee4f-4df2-90a3-a525dfe28461', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:43:37Z', 'updated_at': '2021-05-25T17:43:45Z', 'revision_number': 5, 'project_id': 'cf02997eda314aee8fb322add2fbb921', 'subnets': [{'id': '704d0a85-ee4f-4df2-90a3-a525dfe28461', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-789564-2-iscsi', False) {} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:54:19.855786 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-eee2647e-d7ce-4ffb-b5d8-a8cffa4e812c None None] The sync data for ids ['3ca50ec5-218d-44ad-8ffc-4318f54d7350'] in dv-cinder-789564-2-iscsi is: [{'id': '3ca50ec5-218d-44ad-8ffc-4318f54d7350', 'name': 'tempest-AttachVolumeShelveTestJSON-2113890446-router', 'tenant_id': 'cf02997eda314aee8fb322add2fbb921', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.226'}], 'enable_snat': True}, 'gw_port_id': '1e97124a-073a-4947-a6f2-359fb12ffe5e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:43:31Z', 'updated_at': '2021-05-25T17:43:37Z', 'revision_number': 4, 'project_id': 'cf02997eda314aee8fb322add2fbb921', 'gw_port': {'id': '1e97124a-073a-4947-a6f2-359fb12ffe5e', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:c8:ed:c5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3ca50ec5-218d-44ad-8ffc-4318f54d7350', 'device_owner': 'network:router_gateway', 'standard_attr_id': 244, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.226', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:43:33Z', 'updated_at': '2021-05-25T17:43:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi', '_floatingips': [{'id': '9b152d50-4873-4dbd-83c3-834c259bfe6f', 'tenant_id': 'cf02997eda314aee8fb322add2fbb921', 'floating_ip_address': '172.27.3.115', 'floating_network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'router_id': '3ca50ec5-218d-44ad-8ffc-4318f54d7350', 'port_id': '940c93c6-ab4c-47b9-9b48-31aabb845ba8', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 556, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '45b850af-d423-458a-855a-d7f828a11fff', 'mac_address': 'fa:16:3e:c9:71:50', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6f66d198-4e81-4b59-a5ed-d28bf9c046e3', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T17:53:59Z', 'updated_at': '2021-05-25T17:54:17Z', 'revision_number': 1, 'project_id': 'cf02997eda314aee8fb322add2fbb921', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'ada7bf8b-4ba6-4629-8693-a2574922e458', 'name': '', 'network_id': '45b850af-d423-458a-855a-d7f828a11fff', 'tenant_id': 'cf02997eda314aee8fb322add2fbb921', 'mac_address': 'fa:16:3e:59:34:b7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3ca50ec5-218d-44ad-8ffc-4318f54d7350', 'device_owner': 'network:router_interface', 'standard_attr_id': 255, 'fixed_ips': [{'subnet_id': '704d0a85-ee4f-4df2-90a3-a525dfe28461', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:43:37Z', 'updated_at': '2021-05-25T17:43:45Z', 'revision_number': 5, 'project_id': 'cf02997eda314aee8fb322add2fbb921', 'subnets': [{'id': '704d0a85-ee4f-4df2-90a3-a525dfe28461', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=99028) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 25 17:54:20.059355 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-616b8791-e845-4833-893d-2cf1518ba5ab req-507dbbb9-2a5e-49e8-8c6e-6a553615e836 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:54:20.060881 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-616b8791-e845-4833-893d-2cf1518ba5ab req-507dbbb9-2a5e-49e8-8c6e-6a553615e836 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] 10.222.0.122 "GET /v2.0/ports?device_id=a88a7518-b01c-49a5-96f0-7cb8608682c8 HTTP/1.1" status: 200  len: 945 time: 0.0913520
May 25 17:54:20.062875 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-273924a3-7bb9-480d-98f1-5abbf0ee91ed None None] New status for floating IP 9b152d50-4873-4dbd-83c3-834c259bfe6f: ACTIVE {{(pid=99029) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 25 17:54:20.110074 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-616b8791-e845-4833-893d-2cf1518ba5ab req-7ee0098a-3495-4b93-b839-0eafe327ede5 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] 10.222.0.122 "GET /v2.0/security-groups?id=d5b71c00-54cd-4760-821a-82059bd31db8&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0419936
May 25 17:54:20.301435 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae8d7a61-b8e2-4d97-b8df-e0ab63fd421e req-09a40e03-b3c3-4394-8a15-90a165ce7802 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:54:20.301435 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-ae8d7a61-b8e2-4d97-b8df-e0ab63fd421e req-09a40e03-b3c3-4394-8a15-90a165ce7802 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] 10.222.0.122 "GET /v2.0/ports?device_id=a88a7518-b01c-49a5-96f0-7cb8608682c8 HTTP/1.1" status: 200  len: 945 time: 0.0814965
May 25 17:54:20.343845 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-ae8d7a61-b8e2-4d97-b8df-e0ab63fd421e req-161a8d93-128d-4e4b-8353-e432fd3d1f01 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] 10.222.0.122 "GET /v2.0/security-groups?id=d5b71c00-54cd-4760-821a-82059bd31db8&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0395072
May 25 17:54:20.366930 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 49592) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:54:20.504328 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-028ec05e-8b50-4f7c-849a-25f3a966e593 tempest-TestShelveInstance-325094397 tempest-TestShelveInstance-325094397-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:54:20.505330 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-028ec05e-8b50-4f7c-849a-25f3a966e593 tempest-TestShelveInstance-325094397 tempest-TestShelveInstance-325094397-project-admin] Synchronizing usage tracker for tenant:d440d92738fa475c889c19df3d828036 on resource:port {{(pid=99027) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 17:54:20.566648 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-028ec05e-8b50-4f7c-849a-25f3a966e593 tempest-TestShelveInstance-325094397 tempest-TestShelveInstance-325094397-project-admin] Unset dirty status for tenant:d440d92738fa475c889c19df3d828036 on resource:port {{(pid=99027) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 17:54:20.567731 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-028ec05e-8b50-4f7c-849a-25f3a966e593 tempest-TestShelveInstance-325094397 tempest-TestShelveInstance-325094397-project-admin] 10.222.0.122 "GET /v2.0/ports?device_id=a88a7518-b01c-49a5-96f0-7cb8608682c8 HTTP/1.1" status: 200  len: 1093 time: 0.1997674
May 25 17:54:20.570599 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 49598) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:54:20.575874 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.v2.base [None req-5bf5ab37-2d67-453a-97b0-e08debb74997 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Request body: {'floatingip': {'floating_network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'port_id': 'e70c756f-3f35-4e5a-b4d2-444540756468', 'tenant_id': 'b32a0178e35546828deb4b131cde3201', 'fixed_ip_address': '172.20.0.5'}} {{(pid=99027) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 17:54:20.583099 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-5bf5ab37-2d67-453a-97b0-e08debb74997 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 17:54:20.586883 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-5bf5ab37-2d67-453a-97b0-e08debb74997 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Usage tracker for resource:floatingip and tenant:b32a0178e35546828deb4b131cde3201 is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 17:54:20.589765 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-5bf5ab37-2d67-453a-97b0-e08debb74997 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 17:54:20.595741 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-5bf5ab37-2d67-453a-97b0-e08debb74997 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 17:54:20.646674 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-996a142b-bffb-43b3-b2b0-3669148fb36b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:54:20.678265 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-5bf5ab37-2d67-453a-97b0-e08debb74997 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Notify callbacks [] for floatingip, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:54:20.765962 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.agents_db [None req-14fae233-15dc-4576-836b-621c5f95b584 None None] Agent healthcheck: found 6 active agents {{(pid=99029) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 17:54:20.816461 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-5bf5ab37-2d67-453a-97b0-e08debb74997 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:54:20.872305 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:54:20.951588 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.db_base_plugin_common [None req-5bf5ab37-2d67-453a-97b0-e08debb74997 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Allocated IP 172.27.3.147 (eb7ec72b-a691-481b-8d7e-42c05e13a8cb/d6898f5f-da0b-4428-97b4-4cbe3e83caaa/4f45d069-2fd2-41cf-953d-b25dad7ba173) {{(pid=99027) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 17:54:21.102476 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-5bf5ab37-2d67-453a-97b0-e08debb74997 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Notify callbacks [] for port, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:54:21.207003 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-5bf5ab37-2d67-453a-97b0-e08debb74997 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781840788179', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15468986'] for port, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:54:21.210835 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-68b3bb15-8e5c-45d3-b02b-f2bd04cb8d33 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:54:21.279766 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5bf5ab37-2d67-453a-97b0-e08debb74997 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Network eb7ec72b-a691-481b-8d7e-42c05e13a8cb is already hosted by enough agents. {{(pid=99027) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 17:54:21.282884 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.base_scheduler [None req-5bf5ab37-2d67-453a-97b0-e08debb74997 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Resources bound (agent type, host, resource id):  {{(pid=99027) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 17:54:21.286627 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5bf5ab37-2d67-453a-97b0-e08debb74997 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Received port after_create {{(pid=99027) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 17:54:21.319337 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5bf5ab37-2d67-453a-97b0-e08debb74997 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Pushing event updated for resources: {'Port': ['ID=4f45d069-2fd2-41cf-953d-b25dad7ba173,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:54:21.323352 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-5bf5ab37-2d67-453a-97b0-e08debb74997 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:54:21.708119 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-5bf5ab37-2d67-453a-97b0-e08debb74997 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Notify callbacks [] for floatingip, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:54:21.743233 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-7e261f94-b84f-443e-be49-3bc1ac903b55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:54:21.852791 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-5bf5ab37-2d67-453a-97b0-e08debb74997 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:54:22.060115 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-5bf5ab37-2d67-453a-97b0-e08debb74997 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Notify callbacks [] for port, precommit_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:54:22.131931 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-5bf5ab37-2d67-453a-97b0-e08debb74997 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15468979'] for port, after_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:54:22.135662 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-e581ed3a-f635-445e-ba70-76416e074208 tempest-ServerRescueNegativeTestJSON-277837739 tempest-ServerRescueNegativeTestJSON-277837739-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:54:22.339186 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5bf5ab37-2d67-453a-97b0-e08debb74997 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Pushing event updated for resources: {'Port': ['ID=4f45d069-2fd2-41cf-953d-b25dad7ba173,revision_number=2']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:54:22.341925 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-5bf5ab37-2d67-453a-97b0-e08debb74997 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.206s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:54:22.354764 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-5bf5ab37-2d67-453a-97b0-e08debb74997 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-419865'] for floatingip, after_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:54:22.532206 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.db.l3_db [None req-5bf5ab37-2d67-453a-97b0-e08debb74997 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Floating IP 183d5d99-b69e-4afa-8d14-7d9f631ef31b associated. External IP: 172.27.3.147, port: e70c756f-3f35-4e5a-b4d2-444540756468.
May 25 17:54:22.890472 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5bf5ab37-2d67-453a-97b0-e08debb74997 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Router e7c0703b-bced-4496-8da6-09afc21d0c08 has already been hosted by L3 agent eaeb6875-c4ed-43b6-8658-aa4e52324fdf {{(pid=99027) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 25 17:54:23.067111 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5bf5ab37-2d67-453a-97b0-e08debb74997 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Notify agent at l3_agent.dv-cinder-789564-2-iscsi the message routers_updated {{(pid=99027) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 25 17:54:23.076719 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-248cacf3-eee3-4bc0-9d5e-a403319c18fd None None] Sync routers for ids ['e7c0703b-bced-4496-8da6-09afc21d0c08'] in dv-cinder-789564-2-iscsi {{(pid=99028) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 25 17:54:23.086677 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvrscheduler_db [None req-248cacf3-eee3-4bc0-9d5e-a403319c18fd None None] Routers {'e7c0703b-bced-4496-8da6-09afc21d0c08'} bound to L3 agent in host dv-cinder-789564-2-iscsi {{(pid=99028) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 17:54:23.087304 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-248cacf3-eee3-4bc0-9d5e-a403319c18fd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcae701d790>, 'dv-cinder-789564-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T17:34:21Z,description=<?>,heartbeat_timestamp=2021-05-25T17:54:21Z,host='dv-cinder-789564-2-iscsi',id=eaeb6875-c4ed-43b6-8658-aa4e52324fdf,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T17:34:21Z,topic='l3_agent')) {'router_ids': ['e7c0703b-bced-4496-8da6-09afc21d0c08'], 'active': True} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:54:23.166397 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-5bf5ab37-2d67-453a-97b0-e08debb74997 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-239387'] for floatingip, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:54:23.242748 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-5bf5ab37-2d67-453a-97b0-e08debb74997 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] 10.222.0.122 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 996 time: 2.6709130
May 25 17:54:23.243462 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a88a7518-b01c-49a5-96f0-7cb8608682c8', 'tag': 'e70c756f-3f35-4e5a-b4d2-444540756468'}] {{(pid=99027) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 17:54:23.289918 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a88a7518-b01c-49a5-96f0-7cb8608682c8', 'tag': 'e70c756f-3f35-4e5a-b4d2-444540756468', 'status': 'completed', 'code': 200}
May 25 17:54:23.291198 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvr_db [None req-248cacf3-eee3-4bc0-9d5e-a403319c18fd None None] Set router e7c0703b-bced-4496-8da6-09afc21d0c08 gateway port host: dv-cinder-789564-2-iscsi {{(pid=99028) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 17:54:23.333849 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-6df2b2a7-a54e-4d57-9be3-033078b9d5b3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:54:23.389646 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ce04f18-0741-42b3-8535-319081e38c84 req-7c9ff75e-245f-416d-9a07-52fadd5e13ea service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:54:23.391219 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-1ce04f18-0741-42b3-8535-319081e38c84 req-7c9ff75e-245f-416d-9a07-52fadd5e13ea service neutron] 10.222.0.125 "GET /v2.0/ports?tenant_id=b32a0178e35546828deb4b131cde3201&device_id=a88a7518-b01c-49a5-96f0-7cb8608682c8 HTTP/1.1" status: 200  len: 1098 time: 0.0785856
May 25 17:54:23.539419 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ce04f18-0741-42b3-8535-319081e38c84 req-dd626183-de37-48cd-ae2f-4c94c9ff3704 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:54:23.540964 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-1ce04f18-0741-42b3-8535-319081e38c84 req-dd626183-de37-48cd-ae2f-4c94c9ff3704 service neutron] 10.222.0.125 "GET /v2.0/networks?id=0293f9ff-afda-47ba-aab9-1aac8ea6403d HTTP/1.1" status: 200  len: 910 time: 0.1449997
May 25 17:54:23.646942 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-1ce04f18-0741-42b3-8535-319081e38c84 req-19ceda6d-4efb-40ce-a6da-310e2f7f9ed3 service neutron] 10.222.0.125 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=e70c756f-3f35-4e5a-b4d2-444540756468 HTTP/1.1" status: 200  len: 999 time: 0.1003201
May 25 17:54:23.706105 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ce04f18-0741-42b3-8535-319081e38c84 req-baeeeb5c-269b-4a70-a03a-c61d4e5c21c5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:54:23.706461 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-248cacf3-eee3-4bc0-9d5e-a403319c18fd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcae701d790>, [{'id': 'e7c0703b-bced-4496-8da6-09afc21d0c08', 'name': 'tempest-TestShelveInstance-236747542-router', 'tenant_id': 'b32a0178e35546828deb4b131cde3201', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.219'}], 'enable_snat': True}, 'gw_port_id': '81c38a52-f89b-442f-a887-1536464ac16e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:53:22Z', 'updated_at': '2021-05-25T17:53:27Z', 'revision_number': 4, 'project_id': 'b32a0178e35546828deb4b131cde3201', 'gw_port': {'id': '81c38a52-f89b-442f-a887-1536464ac16e', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:58:82:cf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e7c0703b-bced-4496-8da6-09afc21d0c08', 'device_owner': 'network:router_gateway', 'standard_attr_id': 527, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.219', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:53:23Z', 'updated_at': '2021-05-25T17:53:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi', '_floatingips': [{'id': '183d5d99-b69e-4afa-8d14-7d9f631ef31b', 'tenant_id': 'b32a0178e35546828deb4b131cde3201', 'floating_ip_address': '172.27.3.147', 'floating_network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'router_id': 'e7c0703b-bced-4496-8da6-09afc21d0c08', 'port_id': 'e70c756f-3f35-4e5a-b4d2-444540756468', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 560, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '0293f9ff-afda-47ba-aab9-1aac8ea6403d', 'mac_address': 'fa:16:3e:f1:d3:c9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a88a7518-b01c-49a5-96f0-7cb8608682c8', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T17:54:21Z', 'updated_at': '2021-05-25T17:54:21Z', 'revision_number': 0, 'project_id': 'b32a0178e35546828deb4b131cde3201', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'd42b2822-3e3c-4030-974d-4cd1a0ba238f', 'name': '', 'network_id': '0293f9ff-afda-47ba-aab9-1aac8ea6403d', 'tenant_id': 'b32a0178e35546828deb4b131cde3201', 'mac_address': 'fa:16:3e:99:2a:b9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e7c0703b-bced-4496-8da6-09afc21d0c08', 'device_owner': 'network:router_interface', 'standard_attr_id': 528, 'fixed_ips': [{'subnet_id': '69cd9818-8734-45ed-94ad-ee676be865a2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:53:26Z', 'updated_at': '2021-05-25T17:53:33Z', 'revision_number': 5, 'project_id': 'b32a0178e35546828deb4b131cde3201', 'subnets': [{'id': '69cd9818-8734-45ed-94ad-ee676be865a2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-789564-2-iscsi', False) {} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:54:23.707553 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-1ce04f18-0741-42b3-8535-319081e38c84 req-baeeeb5c-269b-4a70-a03a-c61d4e5c21c5 service neutron] 10.222.0.125 "GET /v2.0/subnets?id=69cd9818-8734-45ed-94ad-ee676be865a2 HTTP/1.1" status: 200  len: 847 time: 0.0571823
May 25 17:54:23.710493 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-248cacf3-eee3-4bc0-9d5e-a403319c18fd None None] Checking router: e7c0703b-bced-4496-8da6-09afc21d0c08 for host: dv-cinder-789564-2-iscsi {{(pid=99028) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 25 17:54:23.719054 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvrscheduler_db [None req-248cacf3-eee3-4bc0-9d5e-a403319c18fd None None] Routers {'e7c0703b-bced-4496-8da6-09afc21d0c08'} bound to L3 agent in host dv-cinder-789564-2-iscsi {{(pid=99028) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 17:54:23.719666 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-248cacf3-eee3-4bc0-9d5e-a403319c18fd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcae701d790>, 'dv-cinder-789564-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T17:34:21Z,description=<?>,heartbeat_timestamp=2021-05-25T17:54:21Z,host='dv-cinder-789564-2-iscsi',id=eaeb6875-c4ed-43b6-8658-aa4e52324fdf,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T17:34:21Z,topic='l3_agent')) {'router_ids': ['e7c0703b-bced-4496-8da6-09afc21d0c08'], 'active': True} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:54:23.782351 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ce04f18-0741-42b3-8535-319081e38c84 req-3c2c16ca-6dbd-4179-adba-b66b41480980 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:54:23.783883 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-1ce04f18-0741-42b3-8535-319081e38c84 req-3c2c16ca-6dbd-4179-adba-b66b41480980 service neutron] 10.222.0.125 "GET /v2.0/ports?network_id=0293f9ff-afda-47ba-aab9-1aac8ea6403d&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0728724
May 25 17:54:23.899064 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvr_db [None req-248cacf3-eee3-4bc0-9d5e-a403319c18fd None None] Set router e7c0703b-bced-4496-8da6-09afc21d0c08 gateway port host: dv-cinder-789564-2-iscsi {{(pid=99028) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 17:54:24.019323 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-1ce04f18-0741-42b3-8535-319081e38c84 req-ee831c5b-961d-41e6-b44f-45a461cf062c service neutron] 10.222.0.125 "GET /v2.0/networks/0293f9ff-afda-47ba-aab9-1aac8ea6403d?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2312825
May 25 17:54:24.147388 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-1ce04f18-0741-42b3-8535-319081e38c84 req-16359e17-e393-45f7-9be5-13da5f6c119d service neutron] 10.222.0.125 "GET /v2.0/networks/0293f9ff-afda-47ba-aab9-1aac8ea6403d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1234407
May 25 17:54:24.253267 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-248cacf3-eee3-4bc0-9d5e-a403319c18fd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcae701d790>, [{'id': 'e7c0703b-bced-4496-8da6-09afc21d0c08', 'name': 'tempest-TestShelveInstance-236747542-router', 'tenant_id': 'b32a0178e35546828deb4b131cde3201', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.219'}], 'enable_snat': True}, 'gw_port_id': '81c38a52-f89b-442f-a887-1536464ac16e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:53:22Z', 'updated_at': '2021-05-25T17:53:27Z', 'revision_number': 4, 'project_id': 'b32a0178e35546828deb4b131cde3201', 'gw_port': {'id': '81c38a52-f89b-442f-a887-1536464ac16e', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:58:82:cf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e7c0703b-bced-4496-8da6-09afc21d0c08', 'device_owner': 'network:router_gateway', 'standard_attr_id': 527, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.219', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:53:23Z', 'updated_at': '2021-05-25T17:53:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi', '_floatingips': [{'id': '183d5d99-b69e-4afa-8d14-7d9f631ef31b', 'tenant_id': 'b32a0178e35546828deb4b131cde3201', 'floating_ip_address': '172.27.3.147', 'floating_network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'router_id': 'e7c0703b-bced-4496-8da6-09afc21d0c08', 'port_id': 'e70c756f-3f35-4e5a-b4d2-444540756468', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 560, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '0293f9ff-afda-47ba-aab9-1aac8ea6403d', 'mac_address': 'fa:16:3e:f1:d3:c9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a88a7518-b01c-49a5-96f0-7cb8608682c8', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T17:54:21Z', 'updated_at': '2021-05-25T17:54:21Z', 'revision_number': 0, 'project_id': 'b32a0178e35546828deb4b131cde3201', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'd42b2822-3e3c-4030-974d-4cd1a0ba238f', 'name': '', 'network_id': '0293f9ff-afda-47ba-aab9-1aac8ea6403d', 'tenant_id': 'b32a0178e35546828deb4b131cde3201', 'mac_address': 'fa:16:3e:99:2a:b9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e7c0703b-bced-4496-8da6-09afc21d0c08', 'device_owner': 'network:router_interface', 'standard_attr_id': 528, 'fixed_ips': [{'subnet_id': '69cd9818-8734-45ed-94ad-ee676be865a2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:53:26Z', 'updated_at': '2021-05-25T17:53:33Z', 'revision_number': 5, 'project_id': 'b32a0178e35546828deb4b131cde3201', 'subnets': [{'id': '69cd9818-8734-45ed-94ad-ee676be865a2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-789564-2-iscsi', False) {} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:54:24.258677 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-248cacf3-eee3-4bc0-9d5e-a403319c18fd None None] The sync data for ids ['e7c0703b-bced-4496-8da6-09afc21d0c08'] in dv-cinder-789564-2-iscsi is: [{'id': 'e7c0703b-bced-4496-8da6-09afc21d0c08', 'name': 'tempest-TestShelveInstance-236747542-router', 'tenant_id': 'b32a0178e35546828deb4b131cde3201', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.219'}], 'enable_snat': True}, 'gw_port_id': '81c38a52-f89b-442f-a887-1536464ac16e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:53:22Z', 'updated_at': '2021-05-25T17:53:27Z', 'revision_number': 4, 'project_id': 'b32a0178e35546828deb4b131cde3201', 'gw_port': {'id': '81c38a52-f89b-442f-a887-1536464ac16e', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:58:82:cf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e7c0703b-bced-4496-8da6-09afc21d0c08', 'device_owner': 'network:router_gateway', 'standard_attr_id': 527, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.219', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:53:23Z', 'updated_at': '2021-05-25T17:53:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi', '_floatingips': [{'id': '183d5d99-b69e-4afa-8d14-7d9f631ef31b', 'tenant_id': 'b32a0178e35546828deb4b131cde3201', 'floating_ip_address': '172.27.3.147', 'floating_network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'router_id': 'e7c0703b-bced-4496-8da6-09afc21d0c08', 'port_id': 'e70c756f-3f35-4e5a-b4d2-444540756468', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 560, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '0293f9ff-afda-47ba-aab9-1aac8ea6403d', 'mac_address': 'fa:16:3e:f1:d3:c9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a88a7518-b01c-49a5-96f0-7cb8608682c8', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T17:54:21Z', 'updated_at': '2021-05-25T17:54:21Z', 'revision_number': 0, 'project_id': 'b32a0178e35546828deb4b131cde3201', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'd42b2822-3e3c-4030-974d-4cd1a0ba238f', 'name': '', 'network_id': '0293f9ff-afda-47ba-aab9-1aac8ea6403d', 'tenant_id': 'b32a0178e35546828deb4b131cde3201', 'mac_address': 'fa:16:3e:99:2a:b9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e7c0703b-bced-4496-8da6-09afc21d0c08', 'device_owner': 'network:router_interface', 'standard_attr_id': 528, 'fixed_ips': [{'subnet_id': '69cd9818-8734-45ed-94ad-ee676be865a2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:53:26Z', 'updated_at': '2021-05-25T17:53:33Z', 'revision_number': 5, 'project_id': 'b32a0178e35546828deb4b131cde3201', 'subnets': [{'id': '69cd9818-8734-45ed-94ad-ee676be865a2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=99028) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 25 17:54:24.451930 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e4376efd-fcf8-4826-8344-27d4cf0450b8 None None] New status for floating IP 183d5d99-b69e-4afa-8d14-7d9f631ef31b: ACTIVE {{(pid=99029) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 25 17:54:41.577913 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:54:48.132614 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-eb5fbe94-26a9-444d-9585-166cb2cbe6a5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:54:50.698067 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-67d61bc2-9424-406d-8cc6-bcf46f9705b0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:54:50.874862 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:54:51.755118 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-7e261f94-b84f-443e-be49-3bc1ac903b55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:54:53.304013 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-6df2b2a7-a54e-4d57-9be3-033078b9d5b3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:54:57.766226 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.agents_db [None req-14fae233-15dc-4576-836b-621c5f95b584 None None] Agent healthcheck: found 6 active agents {{(pid=99029) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 17:55:11.669283 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:55:18.140895 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-ffad05a8-b64e-473a-80a7-5ec4e0b02e03 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:55:20.657941 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-f6edca74-7e01-428a-8658-6bd16bd16646 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:55:20.886999 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:55:21.772174 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-7e261f94-b84f-443e-be49-3bc1ac903b55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:55:23.301498 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-6df2b2a7-a54e-4d57-9be3-033078b9d5b3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:55:34.766509 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.agents_db [None req-14fae233-15dc-4576-836b-621c5f95b584 None None] Agent healthcheck: found 6 active agents {{(pid=99029) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 17:55:41.618130 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:55:47.884090 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-91e32fac-35cb-434a-9ec8-34884e58463a req-4dd26a89-f733-4228-aaaf-ed3a453ee599 service neutron] 10.222.0.125 "GET /v2.0/ports?device_id=13642fad-7755-444a-9c6e-d179ce91d0f4&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.0716801
May 25 17:55:48.034798 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91e32fac-35cb-434a-9ec8-34884e58463a req-043ce6c5-01d9-40b2-ab91-579689eef7cb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:55:48.036266 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-91e32fac-35cb-434a-9ec8-34884e58463a req-043ce6c5-01d9-40b2-ab91-579689eef7cb service neutron] 10.222.0.125 "GET /v2.0/ports?tenant_id=b4cdc54b260f4e79b87fdf4a43b12e16&device_id=13642fad-7755-444a-9c6e-d179ce91d0f4 HTTP/1.1" status: 200  len: 1098 time: 0.0754387
May 25 17:55:48.161352 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4be60f48-2e9e-44b7-95d0-4764c6dbb7ed None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:55:48.184883 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91e32fac-35cb-434a-9ec8-34884e58463a req-1437d290-44a9-49d1-9a2d-f1b76c164edb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:55:48.186388 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-91e32fac-35cb-434a-9ec8-34884e58463a req-1437d290-44a9-49d1-9a2d-f1b76c164edb service neutron] 10.222.0.125 "GET /v2.0/networks?id=defaef08-c0f9-4608-b66d-b97e06e185bf HTTP/1.1" status: 200  len: 913 time: 0.1291113
May 25 17:55:48.288880 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-91e32fac-35cb-434a-9ec8-34884e58463a req-957cef47-ff35-490f-bb3a-e8c7571f1f32 service neutron] 10.222.0.125 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=0d0462ae-dc68-4a19-b6a6-bfdd10328c4c HTTP/1.1" status: 200  len: 1000 time: 0.0944197
May 25 17:55:48.354500 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91e32fac-35cb-434a-9ec8-34884e58463a req-cb8d43d1-f1de-4697-a281-5f143aca303c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:55:48.355912 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-91e32fac-35cb-434a-9ec8-34884e58463a req-cb8d43d1-f1de-4697-a281-5f143aca303c service neutron] 10.222.0.125 "GET /v2.0/subnets?id=5be08358-9d04-4ee9-91ac-104e66e66e20 HTTP/1.1" status: 200  len: 850 time: 0.0623789
May 25 17:55:48.431302 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91e32fac-35cb-434a-9ec8-34884e58463a req-2bb77773-29a4-4e9f-bb5e-47fe55b8dbf5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:55:48.433441 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-91e32fac-35cb-434a-9ec8-34884e58463a req-2bb77773-29a4-4e9f-bb5e-47fe55b8dbf5 service neutron] 10.222.0.125 "GET /v2.0/ports?network_id=defaef08-c0f9-4608-b66d-b97e06e185bf&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0732024
May 25 17:55:48.568732 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-91e32fac-35cb-434a-9ec8-34884e58463a req-432c9fc0-4c11-4710-b31c-f7e093b6be5a service neutron] 10.222.0.125 "GET /v2.0/networks/defaef08-c0f9-4608-b66d-b97e06e185bf?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1289062
May 25 17:55:48.704489 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-91e32fac-35cb-434a-9ec8-34884e58463a req-0477b909-408a-4a75-82d1-30c573a7612a service neutron] 10.222.0.125 "GET /v2.0/networks/defaef08-c0f9-4608-b66d-b97e06e185bf?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1273952
May 25 17:55:50.681109 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-d1c0ca04-9575-4d88-bad0-c56403708c72 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:55:50.847009 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:55:51.752901 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-7e261f94-b84f-443e-be49-3bc1ac903b55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:55:53.305655 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-6df2b2a7-a54e-4d57-9be3-033078b9d5b3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:56:11.601201 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:56:11.765147 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.agents_db [None req-14fae233-15dc-4576-836b-621c5f95b584 None None] Agent healthcheck: found 6 active agents {{(pid=99029) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 17:56:18.178538 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-56a7b53b-a9b3-4bc1-b7f5-d31b2a73eaae None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:56:20.655070 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-6aa04fe9-08bb-4f9b-aef8-60498f760c32 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:56:20.876013 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:56:21.795793 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-7e261f94-b84f-443e-be49-3bc1ac903b55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:56:23.329633 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-6df2b2a7-a54e-4d57-9be3-033078b9d5b3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:56:41.630301 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:56:47.921271 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-ca7a19c5-43a5-4c7d-8677-f0a891b9960d req-d5d9fc48-1d8f-4612-a56a-94a10f5c5f80 service neutron] 10.222.0.125 "GET /v2.0/ports?device_id=a88a7518-b01c-49a5-96f0-7cb8608682c8&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.0734799
May 25 17:56:48.008365 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca7a19c5-43a5-4c7d-8677-f0a891b9960d req-3300ef0c-8ec4-4dd9-a1a8-eec043ec13d3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:56:48.010096 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-ca7a19c5-43a5-4c7d-8677-f0a891b9960d req-3300ef0c-8ec4-4dd9-a1a8-eec043ec13d3 service neutron] 10.222.0.125 "GET /v2.0/ports?tenant_id=b32a0178e35546828deb4b131cde3201&device_id=a88a7518-b01c-49a5-96f0-7cb8608682c8 HTTP/1.1" status: 200  len: 1098 time: 0.0710707
May 25 17:56:48.163910 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-09332dea-c16b-4ea4-b877-d9bb8eb5beec None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:56:48.168161 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca7a19c5-43a5-4c7d-8677-f0a891b9960d req-20f5e589-c870-48e4-9bd6-55bfe356fe00 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:56:48.172704 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-ca7a19c5-43a5-4c7d-8677-f0a891b9960d req-20f5e589-c870-48e4-9bd6-55bfe356fe00 service neutron] 10.222.0.125 "GET /v2.0/networks?id=0293f9ff-afda-47ba-aab9-1aac8ea6403d HTTP/1.1" status: 200  len: 910 time: 0.1363568
May 25 17:56:48.279794 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-ca7a19c5-43a5-4c7d-8677-f0a891b9960d req-89abdec4-2c43-459f-b381-ccc501dbf2c4 service neutron] 10.222.0.125 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=e70c756f-3f35-4e5a-b4d2-444540756468 HTTP/1.1" status: 200  len: 1001 time: 0.1050420
May 25 17:56:48.346214 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca7a19c5-43a5-4c7d-8677-f0a891b9960d req-f2d6f847-50f0-45ac-b989-7b3e260e4b97 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:56:48.348314 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-ca7a19c5-43a5-4c7d-8677-f0a891b9960d req-f2d6f847-50f0-45ac-b989-7b3e260e4b97 service neutron] 10.222.0.125 "GET /v2.0/subnets?id=69cd9818-8734-45ed-94ad-ee676be865a2 HTTP/1.1" status: 200  len: 847 time: 0.0636795
May 25 17:56:48.430605 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca7a19c5-43a5-4c7d-8677-f0a891b9960d req-da42d643-5d22-4fb3-923e-24ba954b7f64 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:56:48.432003 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-ca7a19c5-43a5-4c7d-8677-f0a891b9960d req-da42d643-5d22-4fb3-923e-24ba954b7f64 service neutron] 10.222.0.125 "GET /v2.0/ports?network_id=0293f9ff-afda-47ba-aab9-1aac8ea6403d&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0743637
May 25 17:56:48.646236 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-ca7a19c5-43a5-4c7d-8677-f0a891b9960d req-5f396c0a-b161-403c-b80e-78a94e83323a service neutron] 10.222.0.125 "GET /v2.0/networks/0293f9ff-afda-47ba-aab9-1aac8ea6403d?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2062507
May 25 17:56:48.764012 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.agents_db [None req-14fae233-15dc-4576-836b-621c5f95b584 None None] Agent healthcheck: found 6 active agents {{(pid=99029) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 17:56:48.780260 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-ca7a19c5-43a5-4c7d-8677-f0a891b9960d req-8af748df-7e48-449a-a983-2b77e9dd3845 service neutron] 10.222.0.125 "GET /v2.0/networks/0293f9ff-afda-47ba-aab9-1aac8ea6403d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1253657
May 25 17:56:50.632363 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-91b50e3b-25be-421e-80fc-c6c2c87a4898 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:56:50.849521 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:56:51.784032 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-7e261f94-b84f-443e-be49-3bc1ac903b55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:56:53.315158 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-6df2b2a7-a54e-4d57-9be3-033078b9d5b3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:57:11.652707 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:57:18.144522 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-9ce50155-d5fd-4fc9-90e9-0b3ef24364f0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:57:20.635739 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-883b4388-faa7-4fe7-ac7d-0b497672f7aa None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:57:20.869972 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:57:21.746484 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-7e261f94-b84f-443e-be49-3bc1ac903b55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:57:23.327044 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-6df2b2a7-a54e-4d57-9be3-033078b9d5b3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:57:25.763400 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.agents_db [None req-14fae233-15dc-4576-836b-621c5f95b584 None None] Agent healthcheck: found 6 active agents {{(pid=99029) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 17:57:41.655362 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:57:48.155985 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-e0a67293-1e28-40d9-915c-e8051bad5732 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:57:49.987471 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-fa54d660-8279-41cb-9561-f89303f40636 req-858086ab-e120-4f4d-a701-b86be39db094 service neutron] 10.222.0.125 "GET /v2.0/ports?device_id=6f66d198-4e81-4b59-a5ed-d28bf9c046e3&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.1480515
May 25 17:57:50.082582 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa54d660-8279-41cb-9561-f89303f40636 req-9b2c3929-8b54-4f9d-99d0-232482f4bdb5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:57:50.084089 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-fa54d660-8279-41cb-9561-f89303f40636 req-9b2c3929-8b54-4f9d-99d0-232482f4bdb5 service neutron] 10.222.0.125 "GET /v2.0/ports?tenant_id=cf02997eda314aee8fb322add2fbb921&device_id=6f66d198-4e81-4b59-a5ed-d28bf9c046e3 HTTP/1.1" status: 200  len: 1099 time: 0.0734785
May 25 17:57:50.231386 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa54d660-8279-41cb-9561-f89303f40636 req-136428e6-b2f4-4b51-bf91-b6edd5ee52ec service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:57:50.232831 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-fa54d660-8279-41cb-9561-f89303f40636 req-136428e6-b2f4-4b51-bf91-b6edd5ee52ec service neutron] 10.222.0.125 "GET /v2.0/networks?id=45b850af-d423-458a-855a-d7f828a11fff HTTP/1.1" status: 200  len: 919 time: 0.1278234
May 25 17:57:50.336437 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-fa54d660-8279-41cb-9561-f89303f40636 req-1634c86c-36ce-4f09-8007-4649a73bb918 service neutron] 10.222.0.125 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=940c93c6-ab4c-47b9-9b48-31aabb845ba8 HTTP/1.1" status: 200  len: 1002 time: 0.0954204
May 25 17:57:50.403464 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa54d660-8279-41cb-9561-f89303f40636 req-7672ee13-e862-4fee-b90e-7ad2eb41be1d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:57:50.404858 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-fa54d660-8279-41cb-9561-f89303f40636 req-7672ee13-e862-4fee-b90e-7ad2eb41be1d service neutron] 10.222.0.125 "GET /v2.0/subnets?id=704d0a85-ee4f-4df2-90a3-a525dfe28461 HTTP/1.1" status: 200  len: 856 time: 0.0595524
May 25 17:57:50.486919 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa54d660-8279-41cb-9561-f89303f40636 req-2717850e-2bfd-4c52-b44a-7527281c1a8b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:57:50.488274 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-fa54d660-8279-41cb-9561-f89303f40636 req-2717850e-2bfd-4c52-b44a-7527281c1a8b service neutron] 10.222.0.125 "GET /v2.0/ports?network_id=45b850af-d423-458a-855a-d7f828a11fff&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0790002
May 25 17:57:50.624214 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-fa54d660-8279-41cb-9561-f89303f40636 req-c5b0ba71-ef8d-4b3d-a037-e78560b78bc8 service neutron] 10.222.0.125 "GET /v2.0/networks/45b850af-d423-458a-855a-d7f828a11fff?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1274679
May 25 17:57:50.647550 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-3e70e3ec-c768-4585-a141-9c1447f167fa None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:57:50.756534 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-fa54d660-8279-41cb-9561-f89303f40636 req-b5edb15a-c56d-4fb6-be58-57d76ecfa853 service neutron] 10.222.0.125 "GET /v2.0/networks/45b850af-d423-458a-855a-d7f828a11fff?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1271930
May 25 17:57:50.887187 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:57:51.769707 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-7e261f94-b84f-443e-be49-3bc1ac903b55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:57:53.404857 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-6df2b2a7-a54e-4d57-9be3-033078b9d5b3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:57:56.874328 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 50418) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:57:57.138537 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.plugin [None req-08215083-6821-43e8-be87-76ad726cf736 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Deleting port 4f45d069-2fd2-41cf-953d-b25dad7ba173 {{(pid=99027) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 17:57:57.138774 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-08215083-6821-43e8-be87-76ad726cf736 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781841220419'] for port, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:57:57.258068 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-08215083-6821-43e8-be87-76ad726cf736 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-418810'] for port, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:57:57.258404 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-08215083-6821-43e8-be87-76ad726cf736 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:57:57.394389 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.plugin [None req-08215083-6821-43e8-be87-76ad726cf736 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Calling delete_port for 4f45d069-2fd2-41cf-953d-b25dad7ba173 owned by network:floatingip {{(pid=99027) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 17:57:57.687298 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-08215083-6821-43e8-be87-76ad726cf736 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781841222566', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781840788188', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15468986'] for port, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:57:57.691071 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-9dd1d841-7ccb-4484-b27b-74938eb3e8b7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:57:57.737344 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08215083-6821-43e8-be87-76ad726cf736 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Pushing event deleted for resources: {'Port': ['ID=4f45d069-2fd2-41cf-953d-b25dad7ba173,revision_number=None']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:57:57.770650 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-08215083-6821-43e8-be87-76ad726cf736 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:57:57.772503 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-08215083-6821-43e8-be87-76ad726cf736 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:57:57.772503 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-08215083-6821-43e8-be87-76ad726cf736 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:57:57.772503 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-08215083-6821-43e8-be87-76ad726cf736 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:57:57.772503 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-08215083-6821-43e8-be87-76ad726cf736 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:57:57.772503 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-08215083-6821-43e8-be87-76ad726cf736 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:57:57.772991 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-08215083-6821-43e8-be87-76ad726cf736 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:57:57.773140 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-08215083-6821-43e8-be87-76ad726cf736 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:57:57.773484 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-08215083-6821-43e8-be87-76ad726cf736 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:57:57.773823 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-08215083-6821-43e8-be87-76ad726cf736 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:57:57.774160 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-08215083-6821-43e8-be87-76ad726cf736 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:57:57.774493 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-08215083-6821-43e8-be87-76ad726cf736 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:57:57.781891 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-08215083-6821-43e8-be87-76ad726cf736 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:57:57.838367 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-08215083-6821-43e8-be87-76ad726cf736 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Notify callbacks [] for floatingip, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:57:57.838743 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.db.l3_db [None req-08215083-6821-43e8-be87-76ad726cf736 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Floating IP 183d5d99-b69e-4afa-8d14-7d9f631ef31b disassociated (deleted). External IP: 172.27.3.147, port: e70c756f-3f35-4e5a-b4d2-444540756468.
May 25 17:57:58.194863 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-08215083-6821-43e8-be87-76ad726cf736 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Router e7c0703b-bced-4496-8da6-09afc21d0c08 has already been hosted by L3 agent eaeb6875-c4ed-43b6-8658-aa4e52324fdf {{(pid=99027) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 25 17:57:58.373172 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-08215083-6821-43e8-be87-76ad726cf736 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Notify agent at l3_agent.dv-cinder-789564-2-iscsi the message routers_updated {{(pid=99027) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 25 17:57:58.382863 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6feb696b-2052-4e7b-94ae-a650e5918e2a None None] Sync routers for ids ['e7c0703b-bced-4496-8da6-09afc21d0c08'] in dv-cinder-789564-2-iscsi {{(pid=99028) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 25 17:57:58.394393 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6feb696b-2052-4e7b-94ae-a650e5918e2a None None] Routers {'e7c0703b-bced-4496-8da6-09afc21d0c08'} bound to L3 agent in host dv-cinder-789564-2-iscsi {{(pid=99028) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 17:57:58.395004 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-6feb696b-2052-4e7b-94ae-a650e5918e2a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcae71dcca0>, 'dv-cinder-789564-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T17:34:21Z,description=<?>,heartbeat_timestamp=2021-05-25T17:57:51Z,host='dv-cinder-789564-2-iscsi',id=eaeb6875-c4ed-43b6-8658-aa4e52324fdf,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T17:34:21Z,topic='l3_agent')) {'router_ids': ['e7c0703b-bced-4496-8da6-09afc21d0c08'], 'active': True} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:57:58.486260 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-08215083-6821-43e8-be87-76ad726cf736 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-239387'] for floatingip, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:57:58.547173 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-08215083-6821-43e8-be87-76ad726cf736 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] 10.222.0.122 "DELETE /v2.0/floatingips/183d5d99-b69e-4afa-8d14-7d9f631ef31b HTTP/1.1" status: 204  len: 168 time: 1.6717494
May 25 17:57:58.553406 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a88a7518-b01c-49a5-96f0-7cb8608682c8', 'tag': 'e70c756f-3f35-4e5a-b4d2-444540756468'}] {{(pid=99027) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 17:57:58.588730 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvr_db [None req-6feb696b-2052-4e7b-94ae-a650e5918e2a None None] Set router e7c0703b-bced-4496-8da6-09afc21d0c08 gateway port host: dv-cinder-789564-2-iscsi {{(pid=99028) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 17:57:58.740820 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a88a7518-b01c-49a5-96f0-7cb8608682c8', 'tag': 'e70c756f-3f35-4e5a-b4d2-444540756468', 'status': 'completed', 'code': 200}
May 25 17:57:58.834415 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e82c51f3-0ff5-41bd-a940-9a4917f23127 req-141470ee-99c5-4e9b-b87e-209132e5c15c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:57:58.835899 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-e82c51f3-0ff5-41bd-a940-9a4917f23127 req-141470ee-99c5-4e9b-b87e-209132e5c15c service neutron] 10.222.0.125 "GET /v2.0/ports?tenant_id=b32a0178e35546828deb4b131cde3201&device_id=a88a7518-b01c-49a5-96f0-7cb8608682c8 HTTP/1.1" status: 200  len: 1098 time: 0.0737510
May 25 17:57:58.968832 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e82c51f3-0ff5-41bd-a940-9a4917f23127 req-af705761-9ed1-4b54-b39a-7742e92ead11 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:57:58.970364 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-e82c51f3-0ff5-41bd-a940-9a4917f23127 req-af705761-9ed1-4b54-b39a-7742e92ead11 service neutron] 10.222.0.125 "GET /v2.0/networks?id=0293f9ff-afda-47ba-aab9-1aac8ea6403d HTTP/1.1" status: 200  len: 910 time: 0.1301668
May 25 17:57:58.972365 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-6feb696b-2052-4e7b-94ae-a650e5918e2a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcae71dcca0>, [{'id': 'e7c0703b-bced-4496-8da6-09afc21d0c08', 'name': 'tempest-TestShelveInstance-236747542-router', 'tenant_id': 'b32a0178e35546828deb4b131cde3201', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.219'}], 'enable_snat': True}, 'gw_port_id': '81c38a52-f89b-442f-a887-1536464ac16e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:53:22Z', 'updated_at': '2021-05-25T17:53:27Z', 'revision_number': 4, 'project_id': 'b32a0178e35546828deb4b131cde3201', 'gw_port': {'id': '81c38a52-f89b-442f-a887-1536464ac16e', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:58:82:cf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e7c0703b-bced-4496-8da6-09afc21d0c08', 'device_owner': 'network:router_gateway', 'standard_attr_id': 527, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.219', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:53:23Z', 'updated_at': '2021-05-25T17:53:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi', '_interfaces': [{'id': 'd42b2822-3e3c-4030-974d-4cd1a0ba238f', 'name': '', 'network_id': '0293f9ff-afda-47ba-aab9-1aac8ea6403d', 'tenant_id': 'b32a0178e35546828deb4b131cde3201', 'mac_address': 'fa:16:3e:99:2a:b9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e7c0703b-bced-4496-8da6-09afc21d0c08', 'device_owner': 'network:router_interface', 'standard_attr_id': 528, 'fixed_ips': [{'subnet_id': '69cd9818-8734-45ed-94ad-ee676be865a2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:53:26Z', 'updated_at': '2021-05-25T17:53:33Z', 'revision_number': 5, 'project_id': 'b32a0178e35546828deb4b131cde3201', 'subnets': [{'id': '69cd9818-8734-45ed-94ad-ee676be865a2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-789564-2-iscsi', False) {} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:57:58.976637 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6feb696b-2052-4e7b-94ae-a650e5918e2a None None] Checking router: e7c0703b-bced-4496-8da6-09afc21d0c08 for host: dv-cinder-789564-2-iscsi {{(pid=99028) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 25 17:57:58.985101 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6feb696b-2052-4e7b-94ae-a650e5918e2a None None] Routers {'e7c0703b-bced-4496-8da6-09afc21d0c08'} bound to L3 agent in host dv-cinder-789564-2-iscsi {{(pid=99028) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 17:57:58.985720 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-6feb696b-2052-4e7b-94ae-a650e5918e2a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcae71dcca0>, 'dv-cinder-789564-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T17:34:21Z,description=<?>,heartbeat_timestamp=2021-05-25T17:57:51Z,host='dv-cinder-789564-2-iscsi',id=eaeb6875-c4ed-43b6-8658-aa4e52324fdf,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T17:34:21Z,topic='l3_agent')) {'router_ids': ['e7c0703b-bced-4496-8da6-09afc21d0c08'], 'active': True} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:57:59.047480 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-e82c51f3-0ff5-41bd-a940-9a4917f23127 req-6dfd5868-fcb2-4129-85cf-8a310e49ecbe service neutron] 10.222.0.125 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=e70c756f-3f35-4e5a-b4d2-444540756468 HTTP/1.1" status: 200  len: 217 time: 0.0690496
May 25 17:57:59.112648 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e82c51f3-0ff5-41bd-a940-9a4917f23127 req-75738c19-ff70-4011-84af-dc2dd0829ff3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:57:59.115331 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-e82c51f3-0ff5-41bd-a940-9a4917f23127 req-75738c19-ff70-4011-84af-dc2dd0829ff3 service neutron] 10.222.0.125 "GET /v2.0/subnets?id=69cd9818-8734-45ed-94ad-ee676be865a2 HTTP/1.1" status: 200  len: 847 time: 0.0599754
May 25 17:57:59.167157 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvr_db [None req-6feb696b-2052-4e7b-94ae-a650e5918e2a None None] Set router e7c0703b-bced-4496-8da6-09afc21d0c08 gateway port host: dv-cinder-789564-2-iscsi {{(pid=99028) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 17:57:59.198924 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e82c51f3-0ff5-41bd-a940-9a4917f23127 req-c1cc049f-73e2-499c-a2a6-4f463e16d67e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:57:59.200576 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-e82c51f3-0ff5-41bd-a940-9a4917f23127 req-c1cc049f-73e2-499c-a2a6-4f463e16d67e service neutron] 10.222.0.125 "GET /v2.0/ports?network_id=0293f9ff-afda-47ba-aab9-1aac8ea6403d&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0772829
May 25 17:57:59.344889 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-e82c51f3-0ff5-41bd-a940-9a4917f23127 req-62bf4719-3e08-421e-96cf-e21e54e9bb7f service neutron] 10.222.0.125 "GET /v2.0/networks/0293f9ff-afda-47ba-aab9-1aac8ea6403d?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1377654
May 25 17:57:59.495129 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-6feb696b-2052-4e7b-94ae-a650e5918e2a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcae71dcca0>, [{'id': 'e7c0703b-bced-4496-8da6-09afc21d0c08', 'name': 'tempest-TestShelveInstance-236747542-router', 'tenant_id': 'b32a0178e35546828deb4b131cde3201', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.219'}], 'enable_snat': True}, 'gw_port_id': '81c38a52-f89b-442f-a887-1536464ac16e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:53:22Z', 'updated_at': '2021-05-25T17:53:27Z', 'revision_number': 4, 'project_id': 'b32a0178e35546828deb4b131cde3201', 'gw_port': {'id': '81c38a52-f89b-442f-a887-1536464ac16e', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:58:82:cf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e7c0703b-bced-4496-8da6-09afc21d0c08', 'device_owner': 'network:router_gateway', 'standard_attr_id': 527, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.219', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:53:23Z', 'updated_at': '2021-05-25T17:53:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi', '_interfaces': [{'id': 'd42b2822-3e3c-4030-974d-4cd1a0ba238f', 'name': '', 'network_id': '0293f9ff-afda-47ba-aab9-1aac8ea6403d', 'tenant_id': 'b32a0178e35546828deb4b131cde3201', 'mac_address': 'fa:16:3e:99:2a:b9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e7c0703b-bced-4496-8da6-09afc21d0c08', 'device_owner': 'network:router_interface', 'standard_attr_id': 528, 'fixed_ips': [{'subnet_id': '69cd9818-8734-45ed-94ad-ee676be865a2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:53:26Z', 'updated_at': '2021-05-25T17:53:33Z', 'revision_number': 5, 'project_id': 'b32a0178e35546828deb4b131cde3201', 'subnets': [{'id': '69cd9818-8734-45ed-94ad-ee676be865a2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-789564-2-iscsi', False) {} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:57:59.499221 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6feb696b-2052-4e7b-94ae-a650e5918e2a None None] The sync data for ids ['e7c0703b-bced-4496-8da6-09afc21d0c08'] in dv-cinder-789564-2-iscsi is: [{'id': 'e7c0703b-bced-4496-8da6-09afc21d0c08', 'name': 'tempest-TestShelveInstance-236747542-router', 'tenant_id': 'b32a0178e35546828deb4b131cde3201', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.219'}], 'enable_snat': True}, 'gw_port_id': '81c38a52-f89b-442f-a887-1536464ac16e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:53:22Z', 'updated_at': '2021-05-25T17:53:27Z', 'revision_number': 4, 'project_id': 'b32a0178e35546828deb4b131cde3201', 'gw_port': {'id': '81c38a52-f89b-442f-a887-1536464ac16e', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:58:82:cf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e7c0703b-bced-4496-8da6-09afc21d0c08', 'device_owner': 'network:router_gateway', 'standard_attr_id': 527, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.219', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:53:23Z', 'updated_at': '2021-05-25T17:53:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi', '_interfaces': [{'id': 'd42b2822-3e3c-4030-974d-4cd1a0ba238f', 'name': '', 'network_id': '0293f9ff-afda-47ba-aab9-1aac8ea6403d', 'tenant_id': 'b32a0178e35546828deb4b131cde3201', 'mac_address': 'fa:16:3e:99:2a:b9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e7c0703b-bced-4496-8da6-09afc21d0c08', 'device_owner': 'network:router_interface', 'standard_attr_id': 528, 'fixed_ips': [{'subnet_id': '69cd9818-8734-45ed-94ad-ee676be865a2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:53:26Z', 'updated_at': '2021-05-25T17:53:33Z', 'revision_number': 5, 'project_id': 'b32a0178e35546828deb4b131cde3201', 'subnets': [{'id': '69cd9818-8734-45ed-94ad-ee676be865a2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=99028) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 25 17:57:59.634538 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-e82c51f3-0ff5-41bd-a940-9a4917f23127 req-ef188c98-9216-408b-aa63-08c58149a637 service neutron] 10.222.0.125 "GET /v2.0/networks/0293f9ff-afda-47ba-aab9-1aac8ea6403d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2816944
May 25 17:57:59.650576 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7c44d06-de8f-4e4a-b322-3e0556ca400c req-40e804cc-ca9a-493e-96e4-162aaad89718 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:57:59.651298 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-d7c44d06-de8f-4e4a-b322-3e0556ca400c req-40e804cc-ca9a-493e-96e4-162aaad89718 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Synchronizing usage tracker for tenant:b32a0178e35546828deb4b131cde3201 on resource:port {{(pid=99027) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 17:57:59.740540 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-743f7f66-b286-4959-ab63-f2c4db99e1e0 None None] New status for floating IP 183d5d99-b69e-4afa-8d14-7d9f631ef31b: DOWN {{(pid=99029) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 25 17:57:59.820829 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-d7c44d06-de8f-4e4a-b322-3e0556ca400c req-40e804cc-ca9a-493e-96e4-162aaad89718 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Unset dirty status for tenant:b32a0178e35546828deb4b131cde3201 on resource:port {{(pid=99027) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 17:57:59.822037 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-d7c44d06-de8f-4e4a-b322-3e0556ca400c req-40e804cc-ca9a-493e-96e4-162aaad89718 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] 10.222.0.122 "GET /v2.0/ports?device_id=a88a7518-b01c-49a5-96f0-7cb8608682c8 HTTP/1.1" status: 200  len: 945 time: 0.4763656
May 25 17:57:59.872202 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-d7c44d06-de8f-4e4a-b322-3e0556ca400c req-d39ef875-7596-45ef-b702-b00bfeaf907f tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] 10.222.0.122 "GET /v2.0/security-groups?id=d5b71c00-54cd-4760-821a-82059bd31db8&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0439563
May 25 17:58:00.725675 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60de4fb3-4d23-4299-a360-b978b526f145 req-bb4f11c7-94e3-4866-80b9-1d978d152edc tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:58:00.727035 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-60de4fb3-4d23-4299-a360-b978b526f145 req-bb4f11c7-94e3-4866-80b9-1d978d152edc tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] 10.222.0.125 "GET /v2.0/ports?device_id=a88a7518-b01c-49a5-96f0-7cb8608682c8 HTTP/1.1" status: 200  len: 945 time: 0.0849273
May 25 17:58:00.870537 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.plugin [req-60de4fb3-4d23-4299-a360-b978b526f145 req-9850a6ad-1568-4bcb-9bf1-c6750d231a46 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Deleting port e70c756f-3f35-4e5a-b4d2-444540756468 {{(pid=99027) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 17:58:00.870870 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-60de4fb3-4d23-4299-a360-b978b526f145 req-9850a6ad-1568-4bcb-9bf1-c6750d231a46 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781841220419'] for port, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:01.023491 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.db [req-60de4fb3-4d23-4299-a360-b978b526f145 req-9850a6ad-1568-4bcb-9bf1-c6750d231a46 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] For port e70c756f-3f35-4e5a-b4d2-444540756468, host hv-cinder-78956, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=e70c756f-3f35-4e5a-b4d2-444540756468,segment=NetworkSegment(66d2a99c-6c47-4a92-ac51-31e984766b29),segment_id=66d2a99c-6c47-4a92-ac51-31e984766b29)] {{(pid=99027) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:58:01.024214 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-60de4fb3-4d23-4299-a360-b978b526f145 req-9850a6ad-1568-4bcb-9bf1-c6750d231a46 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-418810'] for port, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:01.138992 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53a9470c-cac2-464e-9d7e-b21869a909b9 req-3b416158-6e5b-454a-a1df-5cae3fd7789f tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:58:01.140526 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-53a9470c-cac2-464e-9d7e-b21869a909b9 req-3b416158-6e5b-454a-a1df-5cae3fd7789f tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] 10.222.0.122 "GET /v2.0/ports?device_id=a88a7518-b01c-49a5-96f0-7cb8608682c8 HTTP/1.1" status: 200  len: 945 time: 0.1492887
May 25 17:58:01.158532 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.plugin [req-60de4fb3-4d23-4299-a360-b978b526f145 req-9850a6ad-1568-4bcb-9bf1-c6750d231a46 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Calling delete_port for e70c756f-3f35-4e5a-b4d2-444540756468 owned by compute:nova {{(pid=99027) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 17:58:01.199675 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-53a9470c-cac2-464e-9d7e-b21869a909b9 req-2acf9970-591c-40c9-a3e6-fea5a3caac99 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] 10.222.0.122 "GET /v2.0/security-groups?id=d5b71c00-54cd-4760-821a-82059bd31db8&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0428915
May 25 17:58:01.403972 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-60de4fb3-4d23-4299-a360-b978b526f145 req-9850a6ad-1568-4bcb-9bf1-c6750d231a46 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781841222566', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781840788188', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15468986'] for port, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:01.409645 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-ec5f4143-1aae-4bb4-b9a2-f3eb9771efb1 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:58:01.454116 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9850a6ad-1568-4bcb-9bf1-c6750d231a46 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Pushing event deleted for resources: {'Port': ['ID=e70c756f-3f35-4e5a-b4d2-444540756468,revision_number=None']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:58:01.457183 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-9850a6ad-1568-4bcb-9bf1-c6750d231a46 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:58:01.534588 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.l3_dvrscheduler_db [req-60de4fb3-4d23-4299-a360-b978b526f145 req-9850a6ad-1568-4bcb-9bf1-c6750d231a46 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] No DVR routers for this DVR port e70c756f-3f35-4e5a-b4d2-444540756468 on host hv-cinder-78956 {{(pid=99027) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 25 17:58:01.535858 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-60de4fb3-4d23-4299-a360-b978b526f145 req-9850a6ad-1568-4bcb-9bf1-c6750d231a46 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-239387'] for port, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:01.538543 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a88a7518-b01c-49a5-96f0-7cb8608682c8', 'name': 'network-vif-deleted', 'tag': 'e70c756f-3f35-4e5a-b4d2-444540756468'}] {{(pid=99027) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 17:58:01.587517 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a88a7518-b01c-49a5-96f0-7cb8608682c8', 'name': 'network-vif-deleted', 'tag': 'e70c756f-3f35-4e5a-b4d2-444540756468', 'status': 'completed', 'code': 200}
May 25 17:58:01.653909 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-60de4fb3-4d23-4299-a360-b978b526f145 req-9850a6ad-1568-4bcb-9bf1-c6750d231a46 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] 10.222.0.125 "DELETE /v2.0/ports/e70c756f-3f35-4e5a-b4d2-444540756468 HTTP/1.1" status: 204  len: 173 time: 0.9200323
May 25 17:58:02.351743 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-76631687-a639-487f-afaa-f1e1267d114b req-994c10d7-455b-4fe4-b729-4d1c6b08dbb7 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] 10.222.0.122 "GET /v2.0/ports?device_id=a88a7518-b01c-49a5-96f0-7cb8608682c8 HTTP/1.1" status: 200  len: 210 time: 0.0432539
May 25 17:58:02.762384 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.agents_db [None req-14fae233-15dc-4576-836b-621c5f95b584 None None] Agent healthcheck: found 6 active agents {{(pid=99029) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 17:58:03.450569 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 50464) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:58:03.518115 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-eb95e6a7-23dd-4853-89b8-c8046c3e6833 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Notify callbacks [] for security_group, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:03.548399 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-eb95e6a7-23dd-4853-89b8-c8046c3e6833 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Notify callbacks [] for security_group, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:03.709920 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-eb95e6a7-23dd-4853-89b8-c8046c3e6833 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:03.714923 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-d0435101-67d6-459b-9f6a-99961701b86b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:58:03.729137 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb95e6a7-23dd-4853-89b8-c8046c3e6833 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=d5b71c00-54cd-4760-821a-82059bd31db8,revision_number=None']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:58:03.731737 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-eb95e6a7-23dd-4853-89b8-c8046c3e6833 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:58:03.818260 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-eb95e6a7-23dd-4853-89b8-c8046c3e6833 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Notify callbacks [] for security_group, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:03.819406 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-eb95e6a7-23dd-4853-89b8-c8046c3e6833 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] 10.222.0.122 "DELETE /v2.0/security-groups/d5b71c00-54cd-4760-821a-82059bd31db8 HTTP/1.1" status: 204  len: 168 time: 0.3709850
May 25 17:58:04.015809 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 50470) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:58:04.558642 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-37b44996-52bb-4fad-b09f-5c0dc34761a4 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-420907'] for router_interface, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:04.724560 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Device e70c756f-3f35-4e5a-b4d2-444540756468 no longer exists at agent hyperv_hv-cinder-78956 {{(pid=99028) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 17:58:04.762021 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.plugin [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] No Port match for: e70c756f-3f35-4e5a-b4d2-444540756468 {{(pid=99028) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 25 17:58:04.762364 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Device e70c756f-3f35-4e5a-b4d2-444540756468 not bound to the agent host hv-cinder-78956 {{(pid=99028) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 25 17:58:04.968544 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.plugin [None req-37b44996-52bb-4fad-b09f-5c0dc34761a4 admin admin] Deleting port d42b2822-3e3c-4030-974d-4cd1a0ba238f {{(pid=99026) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 17:58:04.968884 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-37b44996-52bb-4fad-b09f-5c0dc34761a4 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781841220419'] for port, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:05.192752 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.db [None req-37b44996-52bb-4fad-b09f-5c0dc34761a4 admin admin] For port d42b2822-3e3c-4030-974d-4cd1a0ba238f, host dv-cinder-789564-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=d42b2822-3e3c-4030-974d-4cd1a0ba238f,segment=NetworkSegment(66d2a99c-6c47-4a92-ac51-31e984766b29),segment_id=66d2a99c-6c47-4a92-ac51-31e984766b29)] {{(pid=99026) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:58:05.193503 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-37b44996-52bb-4fad-b09f-5c0dc34761a4 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-418810'] for port, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:05.324245 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.plugin [None req-37b44996-52bb-4fad-b09f-5c0dc34761a4 admin admin] Calling delete_port for d42b2822-3e3c-4030-974d-4cd1a0ba238f owned by network:router_interface {{(pid=99026) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 17:58:05.598465 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-37b44996-52bb-4fad-b09f-5c0dc34761a4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781841222566', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781840788188', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15476536'] for port, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:05.602433 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-47e1e66b-17e3-4026-bd18-6d82608ee271 tempest-AttachVolumeNegativeTest-1393349778 tempest-AttachVolumeNegativeTest-1393349778-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:58:05.647672 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-37b44996-52bb-4fad-b09f-5c0dc34761a4 admin admin] Pushing event deleted for resources: {'Port': ['ID=d42b2822-3e3c-4030-974d-4cd1a0ba238f,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:58:05.691371 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37b44996-52bb-4fad-b09f-5c0dc34761a4 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:58:05.692274 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37b44996-52bb-4fad-b09f-5c0dc34761a4 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:58:05.692748 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37b44996-52bb-4fad-b09f-5c0dc34761a4 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:58:05.693352 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37b44996-52bb-4fad-b09f-5c0dc34761a4 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:58:05.693728 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37b44996-52bb-4fad-b09f-5c0dc34761a4 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:58:05.694090 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37b44996-52bb-4fad-b09f-5c0dc34761a4 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:58:05.694445 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37b44996-52bb-4fad-b09f-5c0dc34761a4 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:58:05.694798 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37b44996-52bb-4fad-b09f-5c0dc34761a4 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:58:05.695152 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37b44996-52bb-4fad-b09f-5c0dc34761a4 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:58:05.695497 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37b44996-52bb-4fad-b09f-5c0dc34761a4 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:58:05.695842 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37b44996-52bb-4fad-b09f-5c0dc34761a4 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:58:05.696186 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37b44996-52bb-4fad-b09f-5c0dc34761a4 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:58:05.725629 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-37b44996-52bb-4fad-b09f-5c0dc34761a4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.123s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:58:05.928579 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-37b44996-52bb-4fad-b09f-5c0dc34761a4 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-551393', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-420795'] for router_interface, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:06.289433 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-37b44996-52bb-4fad-b09f-5c0dc34761a4 admin admin] Router e7c0703b-bced-4496-8da6-09afc21d0c08 has already been hosted by L3 agent eaeb6875-c4ed-43b6-8658-aa4e52324fdf {{(pid=99026) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 25 17:58:06.466324 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-37b44996-52bb-4fad-b09f-5c0dc34761a4 admin admin] Notify agent at l3_agent.dv-cinder-789564-2-iscsi the message routers_updated {{(pid=99026) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 25 17:58:06.475391 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2bd895c4-f5c8-4b15-9b5a-aa247856aaf7 None None] Sync routers for ids ['e7c0703b-bced-4496-8da6-09afc21d0c08'] in dv-cinder-789564-2-iscsi {{(pid=99028) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 25 17:58:06.479663 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-37b44996-52bb-4fad-b09f-5c0dc34761a4 admin admin] 10.222.0.122 "PUT /v2.0/routers/e7c0703b-bced-4496-8da6-09afc21d0c08/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.4627030
May 25 17:58:06.482313 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 50484) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:58:06.484802 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2bd895c4-f5c8-4b15-9b5a-aa247856aaf7 None None] Routers {'e7c0703b-bced-4496-8da6-09afc21d0c08'} bound to L3 agent in host dv-cinder-789564-2-iscsi {{(pid=99028) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 17:58:06.485433 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-2bd895c4-f5c8-4b15-9b5a-aa247856aaf7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcae71f9160>, 'dv-cinder-789564-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T17:34:21Z,description=<?>,heartbeat_timestamp=2021-05-25T17:57:51Z,host='dv-cinder-789564-2-iscsi',id=eaeb6875-c4ed-43b6-8658-aa4e52324fdf,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T17:34:21Z,topic='l3_agent')) {'router_ids': ['e7c0703b-bced-4496-8da6-09afc21d0c08'], 'active': True} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:58:06.681568 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvr_db [None req-2bd895c4-f5c8-4b15-9b5a-aa247856aaf7 None None] Set router e7c0703b-bced-4496-8da6-09afc21d0c08 gateway port host: dv-cinder-789564-2-iscsi {{(pid=99028) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 17:58:06.790381 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-923c356a-c3df-4dbf-ae26-3cb98c8ee9a5 admin admin] Notify callbacks [] for router, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:06.970089 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-923c356a-c3df-4dbf-ae26-3cb98c8ee9a5 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:07.021293 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-2bd895c4-f5c8-4b15-9b5a-aa247856aaf7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcae71f9160>, [{'id': 'e7c0703b-bced-4496-8da6-09afc21d0c08', 'name': 'tempest-TestShelveInstance-236747542-router', 'tenant_id': 'b32a0178e35546828deb4b131cde3201', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.219'}], 'enable_snat': True}, 'gw_port_id': '81c38a52-f89b-442f-a887-1536464ac16e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:53:22Z', 'updated_at': '2021-05-25T17:58:05Z', 'revision_number': 5, 'project_id': 'b32a0178e35546828deb4b131cde3201', 'gw_port': {'id': '81c38a52-f89b-442f-a887-1536464ac16e', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:58:82:cf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e7c0703b-bced-4496-8da6-09afc21d0c08', 'device_owner': 'network:router_gateway', 'standard_attr_id': 527, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.219', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:53:23Z', 'updated_at': '2021-05-25T17:53:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi'}], 'dv-cinder-789564-2-iscsi', False) {} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:58:07.025240 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2bd895c4-f5c8-4b15-9b5a-aa247856aaf7 None None] Checking router: e7c0703b-bced-4496-8da6-09afc21d0c08 for host: dv-cinder-789564-2-iscsi {{(pid=99028) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 25 17:58:07.033422 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2bd895c4-f5c8-4b15-9b5a-aa247856aaf7 None None] Routers {'e7c0703b-bced-4496-8da6-09afc21d0c08'} bound to L3 agent in host dv-cinder-789564-2-iscsi {{(pid=99028) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 17:58:07.034035 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-2bd895c4-f5c8-4b15-9b5a-aa247856aaf7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcae71f9160>, 'dv-cinder-789564-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T17:34:21Z,description=<?>,heartbeat_timestamp=2021-05-25T17:57:51Z,host='dv-cinder-789564-2-iscsi',id=eaeb6875-c4ed-43b6-8658-aa4e52324fdf,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T17:34:21Z,topic='l3_agent')) {'router_ids': ['e7c0703b-bced-4496-8da6-09afc21d0c08'], 'active': True} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:58:07.168978 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.plugin [None req-923c356a-c3df-4dbf-ae26-3cb98c8ee9a5 admin admin] Deleting port 81c38a52-f89b-442f-a887-1536464ac16e {{(pid=99026) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 17:58:07.169238 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-923c356a-c3df-4dbf-ae26-3cb98c8ee9a5 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781841220419'] for port, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:07.214764 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvr_db [None req-2bd895c4-f5c8-4b15-9b5a-aa247856aaf7 None None] Set router e7c0703b-bced-4496-8da6-09afc21d0c08 gateway port host: dv-cinder-789564-2-iscsi {{(pid=99028) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 17:58:07.305291 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.db [None req-923c356a-c3df-4dbf-ae26-3cb98c8ee9a5 admin admin] For port 81c38a52-f89b-442f-a887-1536464ac16e, host dv-cinder-789564-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=81c38a52-f89b-442f-a887-1536464ac16e,segment=NetworkSegment(471771f9-c462-4865-800d-0d5029e9eb3e),segment_id=471771f9-c462-4865-800d-0d5029e9eb3e)] {{(pid=99026) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:58:07.305873 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-923c356a-c3df-4dbf-ae26-3cb98c8ee9a5 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-418810'] for port, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:07.431153 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.plugin [None req-923c356a-c3df-4dbf-ae26-3cb98c8ee9a5 admin admin] Calling delete_port for 81c38a52-f89b-442f-a887-1536464ac16e owned by network:router_gateway {{(pid=99026) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 17:58:07.505963 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-2bd895c4-f5c8-4b15-9b5a-aa247856aaf7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcae71f9160>, [{'id': 'e7c0703b-bced-4496-8da6-09afc21d0c08', 'name': 'tempest-TestShelveInstance-236747542-router', 'tenant_id': 'b32a0178e35546828deb4b131cde3201', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.219'}], 'enable_snat': True}, 'gw_port_id': '81c38a52-f89b-442f-a887-1536464ac16e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:53:22Z', 'updated_at': '2021-05-25T17:58:05Z', 'revision_number': 5, 'project_id': 'b32a0178e35546828deb4b131cde3201', 'gw_port': {'id': '81c38a52-f89b-442f-a887-1536464ac16e', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:58:82:cf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e7c0703b-bced-4496-8da6-09afc21d0c08', 'device_owner': 'network:router_gateway', 'standard_attr_id': 527, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.219', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:53:23Z', 'updated_at': '2021-05-25T17:53:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi'}], 'dv-cinder-789564-2-iscsi', False) {} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:58:07.510772 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2bd895c4-f5c8-4b15-9b5a-aa247856aaf7 None None] The sync data for ids ['e7c0703b-bced-4496-8da6-09afc21d0c08'] in dv-cinder-789564-2-iscsi is: [{'id': 'e7c0703b-bced-4496-8da6-09afc21d0c08', 'name': 'tempest-TestShelveInstance-236747542-router', 'tenant_id': 'b32a0178e35546828deb4b131cde3201', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.219'}], 'enable_snat': True}, 'gw_port_id': '81c38a52-f89b-442f-a887-1536464ac16e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:53:22Z', 'updated_at': '2021-05-25T17:58:05Z', 'revision_number': 5, 'project_id': 'b32a0178e35546828deb4b131cde3201', 'gw_port': {'id': '81c38a52-f89b-442f-a887-1536464ac16e', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:58:82:cf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e7c0703b-bced-4496-8da6-09afc21d0c08', 'device_owner': 'network:router_gateway', 'standard_attr_id': 527, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.219', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:53:23Z', 'updated_at': '2021-05-25T17:53:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi'}] {{(pid=99028) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 25 17:58:07.638588 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-923c356a-c3df-4dbf-ae26-3cb98c8ee9a5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781841222566', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781840788188', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15476536'] for port, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:07.642520 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-85a95637-f68d-436d-888f-9b1b91c99771 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:58:07.686784 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-923c356a-c3df-4dbf-ae26-3cb98c8ee9a5 admin admin] Pushing event deleted for resources: {'Port': ['ID=81c38a52-f89b-442f-a887-1536464ac16e,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:58:07.689853 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-923c356a-c3df-4dbf-ae26-3cb98c8ee9a5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:58:07.780998 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-923c356a-c3df-4dbf-ae26-3cb98c8ee9a5 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-419894'] for router_gateway, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:07.961195 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-923c356a-c3df-4dbf-ae26-3cb98c8ee9a5 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-415163', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-6965'] for router, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:07.963617 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-923c356a-c3df-4dbf-ae26-3cb98c8ee9a5 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:07.979648 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device d42b2822-3e3c-4030-974d-4cd1a0ba238f no longer exists at agent ovs-agent-dv-cinder-789564-2-iscsi {{(pid=99028) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 17:58:08.016284 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.plugin [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] No Port match for: d42b2822-3e3c-4030-974d-4cd1a0ba238f {{(pid=99028) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 25 17:58:08.016632 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device d42b2822-3e3c-4030-974d-4cd1a0ba238f not bound to the agent host dv-cinder-789564-2-iscsi {{(pid=99028) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 25 17:58:08.067101 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-923c356a-c3df-4dbf-ae26-3cb98c8ee9a5 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-414855'] for router, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:08.067649 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-923c356a-c3df-4dbf-ae26-3cb98c8ee9a5 admin admin] Fanout notify agent at l3_agent the message router_deleted on router e7c0703b-bced-4496-8da6-09afc21d0c08 {{(pid=99026) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
May 25 17:58:08.080302 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-923c356a-c3df-4dbf-ae26-3cb98c8ee9a5 admin admin] Notify callbacks [] for router, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:08.081468 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-923c356a-c3df-4dbf-ae26-3cb98c8ee9a5 admin admin] 10.222.0.122 "DELETE /v2.0/routers/e7c0703b-bced-4496-8da6-09afc21d0c08 HTTP/1.1" status: 204  len: 168 time: 1.5982382
May 25 17:58:08.084237 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 50494) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:58:08.150499 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.db_base_plugin_v2 [None req-9db26069-2694-4603-bdda-a425a8acf5ec admin admin] Deleting subnet 69cd9818-8734-45ed-94ad-ee676be865a2 {{(pid=99027) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 25 17:58:08.153860 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-9db26069-2694-4603-bdda-a425a8acf5ec admin admin] Notify callbacks [] for subnet, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:08.204559 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-9db26069-2694-4603-bdda-a425a8acf5ec admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-15628865'] for subnet, precommit_delete_associations {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:08.322950 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-9db26069-2694-4603-bdda-a425a8acf5ec admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1474503'] for subnet, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:08.744841 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-9db26069-2694-4603-bdda-a425a8acf5ec admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1473138', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114466', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-15467081', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-14778143'] for subnet, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:08.748950 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:58:08.784511 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9db26069-2694-4603-bdda-a425a8acf5ec admin admin] Pushing event deleted for resources: {'Subnet': ['ID=69cd9818-8734-45ed-94ad-ee676be865a2,revision_number=None']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:58:08.788686 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-9db26069-2694-4603-bdda-a425a8acf5ec admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:58:08.791026 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-9db26069-2694-4603-bdda-a425a8acf5ec admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for subnet, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:08.796663 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-57fe6755-f019-4ab7-9076-5b6dad5bdb40 None None] Network 0293f9ff-afda-47ba-aab9-1aac8ea6403d requested from dv-cinder-789564-2-iscsi {{(pid=99028) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 17:58:08.797138 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-9db26069-2694-4603-bdda-a425a8acf5ec admin admin] 10.222.0.122 "DELETE /v2.0/subnets/69cd9818-8734-45ed-94ad-ee676be865a2 HTTP/1.1" status: 204  len: 168 time: 0.7115440
May 25 17:58:08.799337 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 50500) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:58:08.909168 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-8628caf5-64ec-4f2f-9007-11eaed1bd4a2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1492659'] for network, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:08.982847 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.plugin [None req-8628caf5-64ec-4f2f-9007-11eaed1bd4a2 admin admin] Deleting port ab1cd90a-dd09-419b-a6d3-0042229602bc {{(pid=99027) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 17:58:08.983185 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-8628caf5-64ec-4f2f-9007-11eaed1bd4a2 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781841220419'] for port, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:09.040409 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4282d590-f646-4271-babb-21d5b9e261ff None None] DHCP port deletion for 0293f9ff-afda-47ba-aab9-1aac8ea6403d request from dv-cinder-789564-2-iscsi {{(pid=99028) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
May 25 17:58:09.086937 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.db [None req-8628caf5-64ec-4f2f-9007-11eaed1bd4a2 admin admin] For port ab1cd90a-dd09-419b-a6d3-0042229602bc, host dv-cinder-789564-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=ab1cd90a-dd09-419b-a6d3-0042229602bc,segment=NetworkSegment(66d2a99c-6c47-4a92-ac51-31e984766b29),segment_id=66d2a99c-6c47-4a92-ac51-31e984766b29)] {{(pid=99027) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:58:09.087644 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-8628caf5-64ec-4f2f-9007-11eaed1bd4a2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-418810'] for port, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:09.104455 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.plugin [None req-4282d590-f646-4271-babb-21d5b9e261ff None None] Deleting port ab1cd90a-dd09-419b-a6d3-0042229602bc {{(pid=99028) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 17:58:09.104834 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4282d590-f646-4271-babb-21d5b9e261ff None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781841220419'] for port, before_delete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:09.209635 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-4282d590-f646-4271-babb-21d5b9e261ff None None] For port ab1cd90a-dd09-419b-a6d3-0042229602bc, host dv-cinder-789564-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=ab1cd90a-dd09-419b-a6d3-0042229602bc,segment=NetworkSegment(66d2a99c-6c47-4a92-ac51-31e984766b29),segment_id=66d2a99c-6c47-4a92-ac51-31e984766b29)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:58:09.210028 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4282d590-f646-4271-babb-21d5b9e261ff None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-418810'] for port, precommit_delete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:09.214813 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.plugin [None req-8628caf5-64ec-4f2f-9007-11eaed1bd4a2 admin admin] Calling delete_port for ab1cd90a-dd09-419b-a6d3-0042229602bc owned by network:dhcp {{(pid=99027) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 17:58:09.330149 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-8628caf5-64ec-4f2f-9007-11eaed1bd4a2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781841222566', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781840788188', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15468986'] for port, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:09.335880 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-577dbb22-05d6-4722-be01-34214c371a84 tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:58:09.338224 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.plugin [None req-4282d590-f646-4271-babb-21d5b9e261ff None None] Calling delete_port for ab1cd90a-dd09-419b-a6d3-0042229602bc owned by network:dhcp {{(pid=99028) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 17:58:09.384420 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8628caf5-64ec-4f2f-9007-11eaed1bd4a2 admin admin] Pushing event deleted for resources: {'Port': ['ID=ab1cd90a-dd09-419b-a6d3-0042229602bc,revision_number=None']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:58:09.385257 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4282d590-f646-4271-babb-21d5b9e261ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781841222566', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781840788188'] for port, after_delete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:09.386588 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8628caf5-64ec-4f2f-9007-11eaed1bd4a2 admin admin] No DVR routers for this DVR port ab1cd90a-dd09-419b-a6d3-0042229602bc on host dv-cinder-789564-2-iscsi {{(pid=99027) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 25 17:58:09.388098 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-8628caf5-64ec-4f2f-9007-11eaed1bd4a2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:58:09.389583 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-2cccbc58-093b-4648-a206-1e82bc09d06a None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:58:09.433695 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4282d590-f646-4271-babb-21d5b9e261ff None None] Pushing event deleted for resources: {'Port': ['ID=ab1cd90a-dd09-419b-a6d3-0042229602bc,revision_number=None']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:58:09.443697 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4282d590-f646-4271-babb-21d5b9e261ff None None] No DVR routers for this DVR port ab1cd90a-dd09-419b-a6d3-0042229602bc on host dv-cinder-789564-2-iscsi {{(pid=99028) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 25 17:58:09.445600 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4282d590-f646-4271-babb-21d5b9e261ff None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:58:09.445942 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4282d590-f646-4271-babb-21d5b9e261ff None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:58:09.446279 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4282d590-f646-4271-babb-21d5b9e261ff None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:58:09.446611 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4282d590-f646-4271-babb-21d5b9e261ff None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:58:09.446938 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4282d590-f646-4271-babb-21d5b9e261ff None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:58:09.447268 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4282d590-f646-4271-babb-21d5b9e261ff None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:58:09.447591 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4282d590-f646-4271-babb-21d5b9e261ff None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:58:09.447914 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4282d590-f646-4271-babb-21d5b9e261ff None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:58:09.448239 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4282d590-f646-4271-babb-21d5b9e261ff None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:58:09.448572 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4282d590-f646-4271-babb-21d5b9e261ff None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:58:09.448874 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4282d590-f646-4271-babb-21d5b9e261ff None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:58:09.449224 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4282d590-f646-4271-babb-21d5b9e261ff None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 17:58:09.452228 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-4282d590-f646-4271-babb-21d5b9e261ff None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.063s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:58:09.508074 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-8628caf5-64ec-4f2f-9007-11eaed1bd4a2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1470792', 'neutron.services.segments.db._delete_segments_for_network-8781841233116'] for network, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:09.521425 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.services.segments.db [None req-8628caf5-64ec-4f2f-9007-11eaed1bd4a2 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fcae6a8a550>,) {'filters': {'network_id': ['0293f9ff-afda-47ba-aab9-1aac8ea6403d']}} {{(pid=99027) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:58:09.533310 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.services.segments.db [None req-8628caf5-64ec-4f2f-9007-11eaed1bd4a2 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fcae6a8a550>, '66d2a99c-6c47-4a92-ac51-31e984766b29') {'for_net_delete': True} {{(pid=99027) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:58:09.533596 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.services.segments.db [None req-8628caf5-64ec-4f2f-9007-11eaed1bd4a2 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fcae6a8a550>, '66d2a99c-6c47-4a92-ac51-31e984766b29') {} {{(pid=99027) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:58:09.544624 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-8628caf5-64ec-4f2f-9007-11eaed1bd4a2 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8781841242525', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-15628874'] for segment, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:09.560329 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-8628caf5-64ec-4f2f-9007-11eaed1bd4a2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1469168'] for segment, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:09.566098 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-8628caf5-64ec-4f2f-9007-11eaed1bd4a2 admin admin] Releasing vlan 1321 on physical network physnet1 to pool {{(pid=99027) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 25 17:58:09.566462 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-8628caf5-64ec-4f2f-9007-11eaed1bd4a2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1469168', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-15469039'] for segment, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:09.579818 dv-cinder-789564-2-iscsi neutron-server[99027]: Traceback (most recent call last):
May 25 17:58:09.579818 dv-cinder-789564-2-iscsi neutron-server[99027]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 25 17:58:09.579818 dv-cinder-789564-2-iscsi neutron-server[99027]:     timer()
May 25 17:58:09.579818 dv-cinder-789564-2-iscsi neutron-server[99027]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 25 17:58:09.579818 dv-cinder-789564-2-iscsi neutron-server[99027]:     cb(*args, **kw)
May 25 17:58:09.579818 dv-cinder-789564-2-iscsi neutron-server[99027]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 25 17:58:09.579818 dv-cinder-789564-2-iscsi neutron-server[99027]:     return func(*args, **kwargs)
May 25 17:58:09.579818 dv-cinder-789564-2-iscsi neutron-server[99027]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 25 17:58:09.579818 dv-cinder-789564-2-iscsi neutron-server[99027]:     self._notify()
May 25 17:58:09.579818 dv-cinder-789564-2-iscsi neutron-server[99027]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 25 17:58:09.579818 dv-cinder-789564-2-iscsi neutron-server[99027]:     self.callback(batched_events)
May 25 17:58:09.579818 dv-cinder-789564-2-iscsi neutron-server[99027]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 25 17:58:09.579818 dv-cinder-789564-2-iscsi neutron-server[99027]:     event.method(event)
May 25 17:58:09.579818 dv-cinder-789564-2-iscsi neutron-server[99027]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 25 17:58:09.579818 dv-cinder-789564-2-iscsi neutron-server[99027]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 25 17:58:09.579818 dv-cinder-789564-2-iscsi neutron-server[99027]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 25 17:58:09.579818 dv-cinder-789564-2-iscsi neutron-server[99027]:     aggregate_uuid = self.p_client.list_aggregates(
May 25 17:58:09.579818 dv-cinder-789564-2-iscsi neutron-server[99027]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 25 17:58:09.579818 dv-cinder-789564-2-iscsi neutron-server[99027]:     return f(self, *a, **k)
May 25 17:58:09.579818 dv-cinder-789564-2-iscsi neutron-server[99027]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 25 17:58:09.579818 dv-cinder-789564-2-iscsi neutron-server[99027]:     return self._get(url).json()
May 25 17:58:09.579818 dv-cinder-789564-2-iscsi neutron-server[99027]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 25 17:58:09.579818 dv-cinder-789564-2-iscsi neutron-server[99027]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 25 17:58:09.579818 dv-cinder-789564-2-iscsi neutron-server[99027]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 25 17:58:09.579818 dv-cinder-789564-2-iscsi neutron-server[99027]:     return self.request(url, 'GET', **kwargs)
May 25 17:58:09.579818 dv-cinder-789564-2-iscsi neutron-server[99027]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 25 17:58:09.579818 dv-cinder-789564-2-iscsi neutron-server[99027]:     base_url = self.get_endpoint(auth, allow=allow,
May 25 17:58:09.579818 dv-cinder-789564-2-iscsi neutron-server[99027]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 25 17:58:09.579818 dv-cinder-789564-2-iscsi neutron-server[99027]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 25 17:58:09.579818 dv-cinder-789564-2-iscsi neutron-server[99027]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 25 17:58:09.579818 dv-cinder-789564-2-iscsi neutron-server[99027]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 25 17:58:09.579818 dv-cinder-789564-2-iscsi neutron-server[99027]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 25 17:58:09.633714 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device 81c38a52-f89b-442f-a887-1536464ac16e no longer exists at agent ovs-agent-dv-cinder-789564-2-iscsi {{(pid=99028) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 17:58:09.668967 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.plugin [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] No Port match for: 81c38a52-f89b-442f-a887-1536464ac16e {{(pid=99028) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 25 17:58:09.669347 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device 81c38a52-f89b-442f-a887-1536464ac16e not bound to the agent host dv-cinder-789564-2-iscsi {{(pid=99028) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 25 17:58:09.669764 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device ab1cd90a-dd09-419b-a6d3-0042229602bc no longer exists at agent ovs-agent-dv-cinder-789564-2-iscsi {{(pid=99028) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 17:58:09.703127 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.plugin [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] No Port match for: ab1cd90a-dd09-419b-a6d3-0042229602bc {{(pid=99028) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 25 17:58:09.703478 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device ab1cd90a-dd09-419b-a6d3-0042229602bc not bound to the agent host dv-cinder-789564-2-iscsi {{(pid=99028) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 25 17:58:09.763862 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-8628caf5-64ec-4f2f-9007-11eaed1bd4a2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1470785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-459299', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551400', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-419883'] for network, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:09.767420 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-904e32c8-a8a4-4c07-995f-ee8fbea79424 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:58:09.780536 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-8628caf5-64ec-4f2f-9007-11eaed1bd4a2 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for network, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:09.790977 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8628caf5-64ec-4f2f-9007-11eaed1bd4a2 admin admin] Pushing event deleted for resources: {'Network': ['ID=0293f9ff-afda-47ba-aab9-1aac8ea6403d,revision_number=None']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:58:09.794255 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-8628caf5-64ec-4f2f-9007-11eaed1bd4a2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:58:09.947546 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-8628caf5-64ec-4f2f-9007-11eaed1bd4a2 admin admin] 10.222.0.122 "DELETE /v2.0/networks/0293f9ff-afda-47ba-aab9-1aac8ea6403d HTTP/1.1" status: 204  len: 168 time: 1.1471684
May 25 17:58:09.950365 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 50510) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:58:10.492697 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-cf2f4965-b63e-42c9-91bb-0273971f7405 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-420907'] for router_interface, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:11.001426 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.plugin [None req-cf2f4965-b63e-42c9-91bb-0273971f7405 admin admin] Deleting port 755f4579-cae9-48c8-b5ad-a366ef203726 {{(pid=99027) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 17:58:11.001756 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-cf2f4965-b63e-42c9-91bb-0273971f7405 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781841220419'] for port, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:11.131151 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.db [None req-cf2f4965-b63e-42c9-91bb-0273971f7405 admin admin] For port 755f4579-cae9-48c8-b5ad-a366ef203726, host dv-cinder-789564-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=755f4579-cae9-48c8-b5ad-a366ef203726,segment=NetworkSegment(25860488-309b-44b3-a089-322389b1576c),segment_id=25860488-309b-44b3-a089-322389b1576c)] {{(pid=99027) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:58:11.131499 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-cf2f4965-b63e-42c9-91bb-0273971f7405 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-418810'] for port, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:11.257943 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.plugin [None req-cf2f4965-b63e-42c9-91bb-0273971f7405 admin admin] Calling delete_port for 755f4579-cae9-48c8-b5ad-a366ef203726 owned by network:router_interface {{(pid=99027) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 17:58:11.618751 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-cf2f4965-b63e-42c9-91bb-0273971f7405 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781841222566', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781840788188', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15468986'] for port, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:11.622731 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-055756b5-30e8-4510-964f-fece910e947f service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:58:11.647340 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:11.670077 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf2f4965-b63e-42c9-91bb-0273971f7405 admin admin] Pushing event deleted for resources: {'Port': ['ID=755f4579-cae9-48c8-b5ad-a366ef203726,revision_number=None']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:58:11.672559 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-cf2f4965-b63e-42c9-91bb-0273971f7405 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:58:11.939006 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-cf2f4965-b63e-42c9-91bb-0273971f7405 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-551393', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-420795'] for router_interface, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:12.403579 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-cf2f4965-b63e-42c9-91bb-0273971f7405 admin admin] Router 9f3abaf6-6698-4faf-a235-07b94569540c has already been hosted by L3 agent eaeb6875-c4ed-43b6-8658-aa4e52324fdf {{(pid=99027) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 25 17:58:12.587084 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cf2f4965-b63e-42c9-91bb-0273971f7405 admin admin] Notify agent at l3_agent.dv-cinder-789564-2-iscsi the message routers_updated {{(pid=99027) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 25 17:58:12.602762 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ee01860d-b898-4e72-9ad4-e165cdcfa08c None None] Sync routers for ids ['9f3abaf6-6698-4faf-a235-07b94569540c'] in dv-cinder-789564-2-iscsi {{(pid=99029) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 25 17:58:12.611948 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ee01860d-b898-4e72-9ad4-e165cdcfa08c None None] Routers {'9f3abaf6-6698-4faf-a235-07b94569540c'} bound to L3 agent in host dv-cinder-789564-2-iscsi {{(pid=99029) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 17:58:12.612545 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_hamode_db [None req-ee01860d-b898-4e72-9ad4-e165cdcfa08c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcae7c02c10>, 'dv-cinder-789564-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T17:34:21Z,description=<?>,heartbeat_timestamp=2021-05-25T17:57:51Z,host='dv-cinder-789564-2-iscsi',id=eaeb6875-c4ed-43b6-8658-aa4e52324fdf,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T17:34:21Z,topic='l3_agent')) {'router_ids': ['9f3abaf6-6698-4faf-a235-07b94569540c'], 'active': True} {{(pid=99029) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:58:12.675714 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-cf2f4965-b63e-42c9-91bb-0273971f7405 admin admin] 10.222.0.122 "PUT /v2.0/routers/9f3abaf6-6698-4faf-a235-07b94569540c/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.7240219
May 25 17:58:12.678459 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 50522) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:58:12.819091 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_dvr_db [None req-ee01860d-b898-4e72-9ad4-e165cdcfa08c None None] Set router 9f3abaf6-6698-4faf-a235-07b94569540c gateway port host: dv-cinder-789564-2-iscsi {{(pid=99029) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 17:58:12.887282 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-e1dd23eb-a2fb-461a-85d8-3ccfbcc37457 admin admin] Notify callbacks [] for router, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:13.069910 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-e1dd23eb-a2fb-461a-85d8-3ccfbcc37457 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:13.116532 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_hamode_db [None req-ee01860d-b898-4e72-9ad4-e165cdcfa08c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcae7c02c10>, [{'id': '9f3abaf6-6698-4faf-a235-07b94569540c', 'name': 'tempest-TestShelveInstance-2008156234-router', 'tenant_id': 'd440d92738fa475c889c19df3d828036', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.14'}], 'enable_snat': True}, 'gw_port_id': '00b1d19d-649f-4ed3-863e-f862f91d943b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:53:30Z', 'updated_at': '2021-05-25T17:58:11Z', 'revision_number': 5, 'project_id': 'd440d92738fa475c889c19df3d828036', 'gw_port': {'id': '00b1d19d-649f-4ed3-863e-f862f91d943b', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:5d:6e:b8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9f3abaf6-6698-4faf-a235-07b94569540c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 539, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.14', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:53:31Z', 'updated_at': '2021-05-25T17:53:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi'}], 'dv-cinder-789564-2-iscsi', False) {} {{(pid=99029) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:58:13.120290 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ee01860d-b898-4e72-9ad4-e165cdcfa08c None None] Checking router: 9f3abaf6-6698-4faf-a235-07b94569540c for host: dv-cinder-789564-2-iscsi {{(pid=99029) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 25 17:58:13.128647 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ee01860d-b898-4e72-9ad4-e165cdcfa08c None None] Routers {'9f3abaf6-6698-4faf-a235-07b94569540c'} bound to L3 agent in host dv-cinder-789564-2-iscsi {{(pid=99029) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 17:58:13.129816 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_hamode_db [None req-ee01860d-b898-4e72-9ad4-e165cdcfa08c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcae7c02c10>, 'dv-cinder-789564-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T17:34:21Z,description=<?>,heartbeat_timestamp=2021-05-25T17:57:51Z,host='dv-cinder-789564-2-iscsi',id=eaeb6875-c4ed-43b6-8658-aa4e52324fdf,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T17:34:21Z,topic='l3_agent')) {'router_ids': ['9f3abaf6-6698-4faf-a235-07b94569540c'], 'active': True} {{(pid=99029) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:58:13.250527 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.plugin [None req-e1dd23eb-a2fb-461a-85d8-3ccfbcc37457 admin admin] Deleting port 00b1d19d-649f-4ed3-863e-f862f91d943b {{(pid=99027) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 17:58:13.250841 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-e1dd23eb-a2fb-461a-85d8-3ccfbcc37457 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781841220419'] for port, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:13.333508 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_dvr_db [None req-ee01860d-b898-4e72-9ad4-e165cdcfa08c None None] Set router 9f3abaf6-6698-4faf-a235-07b94569540c gateway port host: None {{(pid=99029) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 17:58:13.409797 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.db [None req-e1dd23eb-a2fb-461a-85d8-3ccfbcc37457 admin admin] For port 00b1d19d-649f-4ed3-863e-f862f91d943b, host dv-cinder-789564-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=00b1d19d-649f-4ed3-863e-f862f91d943b,segment=NetworkSegment(471771f9-c462-4865-800d-0d5029e9eb3e),segment_id=471771f9-c462-4865-800d-0d5029e9eb3e)] {{(pid=99027) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:58:13.410148 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-e1dd23eb-a2fb-461a-85d8-3ccfbcc37457 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-418810'] for port, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:13.450904 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_hamode_db [None req-ee01860d-b898-4e72-9ad4-e165cdcfa08c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcae7c02c10>, [{'id': '9f3abaf6-6698-4faf-a235-07b94569540c', 'name': 'tempest-TestShelveInstance-2008156234-router', 'tenant_id': 'd440d92738fa475c889c19df3d828036', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:53:30Z', 'updated_at': '2021-05-25T17:58:13Z', 'revision_number': 6, 'project_id': 'd440d92738fa475c889c19df3d828036', 'gw_port_host': None}], 'dv-cinder-789564-2-iscsi', False) {} {{(pid=99029) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:58:13.455194 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ee01860d-b898-4e72-9ad4-e165cdcfa08c None None] The sync data for ids ['9f3abaf6-6698-4faf-a235-07b94569540c'] in dv-cinder-789564-2-iscsi is: [{'id': '9f3abaf6-6698-4faf-a235-07b94569540c', 'name': 'tempest-TestShelveInstance-2008156234-router', 'tenant_id': 'd440d92738fa475c889c19df3d828036', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:53:30Z', 'updated_at': '2021-05-25T17:58:13Z', 'revision_number': 6, 'project_id': 'd440d92738fa475c889c19df3d828036', 'gw_port_host': None}] {{(pid=99029) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 25 17:58:13.545847 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.plugin [None req-e1dd23eb-a2fb-461a-85d8-3ccfbcc37457 admin admin] Calling delete_port for 00b1d19d-649f-4ed3-863e-f862f91d943b owned by network:router_gateway {{(pid=99027) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 17:58:13.839269 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device 755f4579-cae9-48c8-b5ad-a366ef203726 no longer exists at agent ovs-agent-dv-cinder-789564-2-iscsi {{(pid=99028) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 17:58:13.879875 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.plugin [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] No Port match for: 755f4579-cae9-48c8-b5ad-a366ef203726 {{(pid=99028) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 25 17:58:13.880230 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device 755f4579-cae9-48c8-b5ad-a366ef203726 not bound to the agent host dv-cinder-789564-2-iscsi {{(pid=99028) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 25 17:58:13.913039 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-e1dd23eb-a2fb-461a-85d8-3ccfbcc37457 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781841222566', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781840788188', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15468986'] for port, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:13.917773 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-096bbb1a-3995-4635-8e42-939b50fe5fae tempest-VolumesSnapshotTestJSON-1043879885 tempest-VolumesSnapshotTestJSON-1043879885-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:58:13.968536 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1dd23eb-a2fb-461a-85d8-3ccfbcc37457 admin admin] Pushing event deleted for resources: {'Port': ['ID=00b1d19d-649f-4ed3-863e-f862f91d943b,revision_number=None']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:58:13.972306 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-e1dd23eb-a2fb-461a-85d8-3ccfbcc37457 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.055s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:58:14.080664 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-e1dd23eb-a2fb-461a-85d8-3ccfbcc37457 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-419894'] for router_gateway, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:14.295980 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-e1dd23eb-a2fb-461a-85d8-3ccfbcc37457 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-415163', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-6965'] for router, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:14.299153 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-e1dd23eb-a2fb-461a-85d8-3ccfbcc37457 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:14.416199 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-e1dd23eb-a2fb-461a-85d8-3ccfbcc37457 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-414855'] for router, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:14.416952 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e1dd23eb-a2fb-461a-85d8-3ccfbcc37457 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 9f3abaf6-6698-4faf-a235-07b94569540c {{(pid=99027) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
May 25 17:58:14.437805 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-e1dd23eb-a2fb-461a-85d8-3ccfbcc37457 admin admin] Notify callbacks [] for router, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:14.439445 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-e1dd23eb-a2fb-461a-85d8-3ccfbcc37457 admin admin] 10.222.0.122 "DELETE /v2.0/routers/9f3abaf6-6698-4faf-a235-07b94569540c HTTP/1.1" status: 204  len: 168 time: 1.7595661
May 25 17:58:14.442363 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 50532) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:58:14.528825 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.db_base_plugin_v2 [None req-aeeb8b24-e4d2-4f01-aa2a-132f39d17256 admin admin] Deleting subnet fefe3428-f312-48c3-a442-12fb15c37143 {{(pid=99026) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 25 17:58:14.534169 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-aeeb8b24-e4d2-4f01-aa2a-132f39d17256 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:14.613277 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-aeeb8b24-e4d2-4f01-aa2a-132f39d17256 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-14735050'] for subnet, precommit_delete_associations {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:14.695182 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-aeeb8b24-e4d2-4f01-aa2a-132f39d17256 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1474503'] for subnet, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:15.215953 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-aeeb8b24-e4d2-4f01-aa2a-132f39d17256 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1473138', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114466', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-15477963', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-14794250'] for subnet, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:15.221144 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:58:15.256885 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aeeb8b24-e4d2-4f01-aa2a-132f39d17256 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=fefe3428-f312-48c3-a442-12fb15c37143,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:58:15.260159 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-aeeb8b24-e4d2-4f01-aa2a-132f39d17256 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.039s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:58:15.261511 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-aeeb8b24-e4d2-4f01-aa2a-132f39d17256 admin admin] Notify callbacks [] for subnet, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:15.267692 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-aeeb8b24-e4d2-4f01-aa2a-132f39d17256 admin admin] 10.222.0.122 "DELETE /v2.0/subnets/fefe3428-f312-48c3-a442-12fb15c37143 HTTP/1.1" status: 204  len: 168 time: 0.8239708
May 25 17:58:15.268178 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c61ffaa1-5334-4e2c-9f8a-a16102d00736 None None] Network 137490af-32dc-4466-832c-959b96aa867d requested from dv-cinder-789564-2-iscsi {{(pid=99028) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 17:58:15.270835 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 50538) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:58:15.378344 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-b06d900d-b4a1-4b00-a5c2-dd35115aed39 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1492659'] for network, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:15.454055 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.plugin [None req-b06d900d-b4a1-4b00-a5c2-dd35115aed39 admin admin] Deleting port 67cb78bc-708f-450f-9e19-ef7b06a381d0 {{(pid=99026) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 17:58:15.454779 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-b06d900d-b4a1-4b00-a5c2-dd35115aed39 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781841220419'] for port, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:15.564419 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.db [None req-b06d900d-b4a1-4b00-a5c2-dd35115aed39 admin admin] For port 67cb78bc-708f-450f-9e19-ef7b06a381d0, host dv-cinder-789564-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=67cb78bc-708f-450f-9e19-ef7b06a381d0,segment=NetworkSegment(25860488-309b-44b3-a089-322389b1576c),segment_id=25860488-309b-44b3-a089-322389b1576c)] {{(pid=99026) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:58:15.564771 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-b06d900d-b4a1-4b00-a5c2-dd35115aed39 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-418810'] for port, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:15.575890 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4f5d8397-5d69-4084-858a-c1856d72be07 None None] DHCP port deletion for 137490af-32dc-4466-832c-959b96aa867d request from dv-cinder-789564-2-iscsi {{(pid=99028) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
May 25 17:58:15.657884 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device 00b1d19d-649f-4ed3-863e-f862f91d943b no longer exists at agent ovs-agent-dv-cinder-789564-2-iscsi {{(pid=99028) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 17:58:15.694907 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.plugin [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] No Port match for: 00b1d19d-649f-4ed3-863e-f862f91d943b {{(pid=99028) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 25 17:58:15.695249 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device 00b1d19d-649f-4ed3-863e-f862f91d943b not bound to the agent host dv-cinder-789564-2-iscsi {{(pid=99028) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 25 17:58:15.695662 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device 67cb78bc-708f-450f-9e19-ef7b06a381d0 no longer exists at agent ovs-agent-dv-cinder-789564-2-iscsi {{(pid=99028) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 17:58:15.709139 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.plugin [None req-b06d900d-b4a1-4b00-a5c2-dd35115aed39 admin admin] Calling delete_port for 67cb78bc-708f-450f-9e19-ef7b06a381d0 owned by network:dhcp {{(pid=99026) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 17:58:15.751848 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.plugin [None req-4f5d8397-5d69-4084-858a-c1856d72be07 None None] Deleting port 67cb78bc-708f-450f-9e19-ef7b06a381d0 {{(pid=99028) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 17:58:15.752251 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4f5d8397-5d69-4084-858a-c1856d72be07 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781841220419'] for port, before_delete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:15.887918 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-b06d900d-b4a1-4b00-a5c2-dd35115aed39 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781841222566', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781840788188', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15476536'] for port, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:15.892659 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-88a72984-6d49-4b78-b3e5-cd7b079f88b9 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:58:15.904060 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-4f5d8397-5d69-4084-858a-c1856d72be07 None None] For port 67cb78bc-708f-450f-9e19-ef7b06a381d0, host dv-cinder-789564-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=67cb78bc-708f-450f-9e19-ef7b06a381d0,segment=NetworkSegment(25860488-309b-44b3-a089-322389b1576c),segment_id=25860488-309b-44b3-a089-322389b1576c)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 17:58:15.905978 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4f5d8397-5d69-4084-858a-c1856d72be07 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-418810'] for port, precommit_delete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:15.937128 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b06d900d-b4a1-4b00-a5c2-dd35115aed39 admin admin] Pushing event deleted for resources: {'Port': ['ID=67cb78bc-708f-450f-9e19-ef7b06a381d0,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:58:15.938880 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b06d900d-b4a1-4b00-a5c2-dd35115aed39 admin admin] No DVR routers for this DVR port 67cb78bc-708f-450f-9e19-ef7b06a381d0 on host dv-cinder-789564-2-iscsi {{(pid=99026) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 25 17:58:15.940300 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-b06d900d-b4a1-4b00-a5c2-dd35115aed39 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:58:16.039966 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.plugin [None req-4f5d8397-5d69-4084-858a-c1856d72be07 None None] Calling delete_port for 67cb78bc-708f-450f-9e19-ef7b06a381d0 owned by network:dhcp {{(pid=99028) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 17:58:16.045761 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:16.060367 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-b06d900d-b4a1-4b00-a5c2-dd35115aed39 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1470792', 'neutron.services.segments.db._delete_segments_for_network-8781841233116'] for network, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:16.074620 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.services.segments.db [None req-b06d900d-b4a1-4b00-a5c2-dd35115aed39 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fcae6ad8910>,) {'filters': {'network_id': ['137490af-32dc-4466-832c-959b96aa867d']}} {{(pid=99026) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:58:16.088285 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.services.segments.db [None req-b06d900d-b4a1-4b00-a5c2-dd35115aed39 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fcae6ad8910>, '25860488-309b-44b3-a089-322389b1576c') {'for_net_delete': True} {{(pid=99026) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:58:16.088797 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.services.segments.db [None req-b06d900d-b4a1-4b00-a5c2-dd35115aed39 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fcae6ad8910>, '25860488-309b-44b3-a089-322389b1576c') {} {{(pid=99026) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 17:58:16.101597 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-b06d900d-b4a1-4b00-a5c2-dd35115aed39 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8781841242525', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-14735041'] for segment, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:16.118258 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-b06d900d-b4a1-4b00-a5c2-dd35115aed39 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1469168'] for segment, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:16.124360 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-b06d900d-b4a1-4b00-a5c2-dd35115aed39 admin admin] Releasing vlan 1320 on physical network physnet1 to pool {{(pid=99026) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 25 17:58:16.124746 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-b06d900d-b4a1-4b00-a5c2-dd35115aed39 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1469168', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-15476589'] for segment, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:16.140715 dv-cinder-789564-2-iscsi neutron-server[99026]: Traceback (most recent call last):
May 25 17:58:16.140715 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 25 17:58:16.140715 dv-cinder-789564-2-iscsi neutron-server[99026]:     timer()
May 25 17:58:16.140715 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 25 17:58:16.140715 dv-cinder-789564-2-iscsi neutron-server[99026]:     cb(*args, **kw)
May 25 17:58:16.140715 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 25 17:58:16.140715 dv-cinder-789564-2-iscsi neutron-server[99026]:     return func(*args, **kwargs)
May 25 17:58:16.140715 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 25 17:58:16.140715 dv-cinder-789564-2-iscsi neutron-server[99026]:     self._notify()
May 25 17:58:16.140715 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 25 17:58:16.140715 dv-cinder-789564-2-iscsi neutron-server[99026]:     self.callback(batched_events)
May 25 17:58:16.140715 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 25 17:58:16.140715 dv-cinder-789564-2-iscsi neutron-server[99026]:     event.method(event)
May 25 17:58:16.140715 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 25 17:58:16.140715 dv-cinder-789564-2-iscsi neutron-server[99026]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 25 17:58:16.140715 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 25 17:58:16.140715 dv-cinder-789564-2-iscsi neutron-server[99026]:     aggregate_uuid = self.p_client.list_aggregates(
May 25 17:58:16.140715 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 25 17:58:16.140715 dv-cinder-789564-2-iscsi neutron-server[99026]:     return f(self, *a, **k)
May 25 17:58:16.140715 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 25 17:58:16.140715 dv-cinder-789564-2-iscsi neutron-server[99026]:     return self._get(url).json()
May 25 17:58:16.140715 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 25 17:58:16.140715 dv-cinder-789564-2-iscsi neutron-server[99026]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 25 17:58:16.140715 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 25 17:58:16.140715 dv-cinder-789564-2-iscsi neutron-server[99026]:     return self.request(url, 'GET', **kwargs)
May 25 17:58:16.140715 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 25 17:58:16.140715 dv-cinder-789564-2-iscsi neutron-server[99026]:     base_url = self.get_endpoint(auth, allow=allow,
May 25 17:58:16.140715 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 25 17:58:16.140715 dv-cinder-789564-2-iscsi neutron-server[99026]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 25 17:58:16.140715 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 25 17:58:16.140715 dv-cinder-789564-2-iscsi neutron-server[99026]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 25 17:58:16.140715 dv-cinder-789564-2-iscsi neutron-server[99026]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 25 17:58:16.146551 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4f5d8397-5d69-4084-858a-c1856d72be07 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781841222566', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781840788188'] for port, after_delete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:16.151161 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:58:16.195912 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4f5d8397-5d69-4084-858a-c1856d72be07 None None] No DVR routers for this DVR port 67cb78bc-708f-450f-9e19-ef7b06a381d0 on host dv-cinder-789564-2-iscsi {{(pid=99028) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 25 17:58:16.198137 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f5d8397-5d69-4084-858a-c1856d72be07 None None] Pushing event deleted for resources: {'Port': ['ID=67cb78bc-708f-450f-9e19-ef7b06a381d0,revision_number=None']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:58:16.200341 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-4f5d8397-5d69-4084-858a-c1856d72be07 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:58:16.341175 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-b06d900d-b4a1-4b00-a5c2-dd35115aed39 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1470785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-459299', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551400', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-419883'] for network, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:16.349418 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-b06d900d-b4a1-4b00-a5c2-dd35115aed39 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for network, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:16.350559 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:58:16.371595 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b06d900d-b4a1-4b00-a5c2-dd35115aed39 admin admin] Pushing event deleted for resources: {'Network': ['ID=137490af-32dc-4466-832c-959b96aa867d,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:58:16.374066 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-b06d900d-b4a1-4b00-a5c2-dd35115aed39 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:58:16.378264 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-b06d900d-b4a1-4b00-a5c2-dd35115aed39 admin admin] 10.222.0.122 "DELETE /v2.0/networks/137490af-32dc-4466-832c-959b96aa867d HTTP/1.1" status: 204  len: 168 time: 1.1063149
May 25 17:58:16.958510 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 50552) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:58:17.009668 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-57747956-d4dc-49bc-acb9-312ca5dc2ad7 admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=b32a0178e35546828deb4b131cde3201&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0493290
May 25 17:58:17.012394 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 50556) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:58:17.080201 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-4be2d66a-f2f0-4acd-8f64-9e58e0d537de admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:17.108454 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-4be2d66a-f2f0-4acd-8f64-9e58e0d537de admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:17.324276 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-4be2d66a-f2f0-4acd-8f64-9e58e0d537de admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:17.328458 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-5b0d741e-6b2b-4c9e-81ee-8794e4730620 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:58:17.344052 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4be2d66a-f2f0-4acd-8f64-9e58e0d537de admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8e6f725e-0056-4b9b-a856-453c550e6fb7,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:58:17.347780 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-4be2d66a-f2f0-4acd-8f64-9e58e0d537de admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:58:17.352836 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-4be2d66a-f2f0-4acd-8f64-9e58e0d537de admin admin] Notify callbacks [] for security_group, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:17.354029 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-4be2d66a-f2f0-4acd-8f64-9e58e0d537de admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/8e6f725e-0056-4b9b-a856-453c550e6fb7 HTTP/1.1" status: 204  len: 168 time: 0.3406751
May 25 17:58:18.187000 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-623a1ae4-9c39-461b-8ed9-c5cbfe1b9cd4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:18.429291 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 50568) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:58:18.481654 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-38db632d-5041-41dd-af8d-376f4b8086db admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=d440d92738fa475c889c19df3d828036&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0510323
May 25 17:58:18.484030 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 50572) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 17:58:18.545120 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-a1358841-2cc1-40e9-92a2-f065a104dac8 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:18.576074 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-a1358841-2cc1-40e9-92a2-f065a104dac8 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:18.716498 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-a1358841-2cc1-40e9-92a2-f065a104dac8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:18.720340 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-f4e73b4e-7a12-4522-b416-9750c9cf01b5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 17:58:18.734210 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1358841-2cc1-40e9-92a2-f065a104dac8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e50b3a44-5660-4014-aa76-544a66134be5,revision_number=None']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 17:58:18.737280 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-a1358841-2cc1-40e9-92a2-f065a104dac8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 17:58:18.740467 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-a1358841-2cc1-40e9-92a2-f065a104dac8 admin admin] Notify callbacks [] for security_group, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:18.741374 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-a1358841-2cc1-40e9-92a2-f065a104dac8 admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/e50b3a44-5660-4014-aa76-544a66134be5 HTTP/1.1" status: 204  len: 168 time: 0.2563720
May 25 17:58:20.763951 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-ffcfee8e-de23-4919-9f85-aa1645f18187 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:20.876452 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:21.787221 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-7e261f94-b84f-443e-be49-3bc1ac903b55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:23.350381 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-6df2b2a7-a54e-4d57-9be3-033078b9d5b3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:39.761635 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.agents_db [None req-14fae233-15dc-4576-836b-621c5f95b584 None None] Agent healthcheck: found 6 active agents {{(pid=99029) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 17:58:41.644053 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:48.175486 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-1434fd3b-c8b0-46e9-a003-4e26cdff1255 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:49.885445 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-5999ab2c-d6b3-4e44-aa4f-88a9ed7d92a4 req-bb6897b7-22ec-4417-bd31-0d2f52533e11 service neutron] 10.222.0.125 "GET /v2.0/ports?device_id=13642fad-7755-444a-9c6e-d179ce91d0f4&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.0717697
May 25 17:58:50.027650 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5999ab2c-d6b3-4e44-aa4f-88a9ed7d92a4 req-c7b42661-ee41-43bd-bee6-d106f9a444a3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:58:50.029133 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-5999ab2c-d6b3-4e44-aa4f-88a9ed7d92a4 req-c7b42661-ee41-43bd-bee6-d106f9a444a3 service neutron] 10.222.0.125 "GET /v2.0/ports?tenant_id=b4cdc54b260f4e79b87fdf4a43b12e16&device_id=13642fad-7755-444a-9c6e-d179ce91d0f4 HTTP/1.1" status: 200  len: 1098 time: 0.0753224
May 25 17:58:50.171052 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5999ab2c-d6b3-4e44-aa4f-88a9ed7d92a4 req-529c50d0-063d-4d7d-9d29-24854167021c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:58:50.172366 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-5999ab2c-d6b3-4e44-aa4f-88a9ed7d92a4 req-529c50d0-063d-4d7d-9d29-24854167021c service neutron] 10.222.0.125 "GET /v2.0/networks?id=defaef08-c0f9-4608-b66d-b97e06e185bf HTTP/1.1" status: 200  len: 913 time: 0.1268353
May 25 17:58:50.272740 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-5999ab2c-d6b3-4e44-aa4f-88a9ed7d92a4 req-9cd6431d-55ad-4dc1-9783-38fb1e218454 service neutron] 10.222.0.125 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=0d0462ae-dc68-4a19-b6a6-bfdd10328c4c HTTP/1.1" status: 200  len: 1000 time: 0.0956299
May 25 17:58:50.336503 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5999ab2c-d6b3-4e44-aa4f-88a9ed7d92a4 req-415f3f52-340d-468f-b86d-19614f6160a4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:58:50.338039 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-5999ab2c-d6b3-4e44-aa4f-88a9ed7d92a4 req-415f3f52-340d-468f-b86d-19614f6160a4 service neutron] 10.222.0.125 "GET /v2.0/subnets?id=5be08358-9d04-4ee9-91ac-104e66e66e20 HTTP/1.1" status: 200  len: 850 time: 0.0610571
May 25 17:58:50.415856 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5999ab2c-d6b3-4e44-aa4f-88a9ed7d92a4 req-61187d98-2099-4730-a734-858594ee4ca4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:58:50.417358 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-5999ab2c-d6b3-4e44-aa4f-88a9ed7d92a4 req-61187d98-2099-4730-a734-858594ee4ca4 service neutron] 10.222.0.125 "GET /v2.0/ports?network_id=defaef08-c0f9-4608-b66d-b97e06e185bf&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0714412
May 25 17:58:50.546996 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-5999ab2c-d6b3-4e44-aa4f-88a9ed7d92a4 req-c6c6a31f-9458-4a9a-b3d0-70b75c06202c service neutron] 10.222.0.125 "GET /v2.0/networks/defaef08-c0f9-4608-b66d-b97e06e185bf?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1249924
May 25 17:58:50.649405 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-bdf94802-e469-488d-947c-7d78c6841e15 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:50.679594 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-5999ab2c-d6b3-4e44-aa4f-88a9ed7d92a4 req-7012f0af-82e5-4c37-98b1-979fdf8b263d service neutron] 10.222.0.125 "GET /v2.0/networks/defaef08-c0f9-4608-b66d-b97e06e185bf?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1279089
May 25 17:58:50.870643 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:51.752297 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-7e261f94-b84f-443e-be49-3bc1ac903b55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:58:53.375985 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-6df2b2a7-a54e-4d57-9be3-033078b9d5b3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:59:11.744764 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:59:16.760303 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.agents_db [None req-14fae233-15dc-4576-836b-621c5f95b584 None None] Agent healthcheck: found 6 active agents {{(pid=99029) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 17:59:18.238565 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-3e1827f3-0a37-4cf2-9dd5-b090a0145ba3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:59:20.638448 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-636d7914-baf9-41c0-847f-c415d7ed048d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:59:20.876295 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:59:21.821009 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-7e261f94-b84f-443e-be49-3bc1ac903b55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:59:23.390872 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-6df2b2a7-a54e-4d57-9be3-033078b9d5b3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:59:41.718341 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:59:48.201524 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-792ac3d1-d0d3-429f-a76c-c0138afe62b2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:59:49.965724 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-784a6680-4035-460a-8407-5b8f4c04abfc req-6e1bbc04-e5af-4f1f-9048-b26104102449 service neutron] 10.222.0.125 "GET /v2.0/ports?device_id=6f66d198-4e81-4b59-a5ed-d28bf9c046e3&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.0764186
May 25 17:59:50.054210 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-784a6680-4035-460a-8407-5b8f4c04abfc req-56ec2d43-9f33-45d4-b87f-d9b321b65355 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:59:50.055682 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-784a6680-4035-460a-8407-5b8f4c04abfc req-56ec2d43-9f33-45d4-b87f-d9b321b65355 service neutron] 10.222.0.125 "GET /v2.0/ports?tenant_id=cf02997eda314aee8fb322add2fbb921&device_id=6f66d198-4e81-4b59-a5ed-d28bf9c046e3 HTTP/1.1" status: 200  len: 1099 time: 0.0720601
May 25 17:59:50.296357 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-784a6680-4035-460a-8407-5b8f4c04abfc req-bd3760c8-47d3-4ba6-b5c8-aae5dc7e56f4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:59:50.297831 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-784a6680-4035-460a-8407-5b8f4c04abfc req-bd3760c8-47d3-4ba6-b5c8-aae5dc7e56f4 service neutron] 10.222.0.125 "GET /v2.0/networks?id=45b850af-d423-458a-855a-d7f828a11fff HTTP/1.1" status: 200  len: 919 time: 0.2249019
May 25 17:59:50.399980 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-784a6680-4035-460a-8407-5b8f4c04abfc req-49a183df-b539-427a-a2f8-305029d57140 service neutron] 10.222.0.125 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=940c93c6-ab4c-47b9-9b48-31aabb845ba8 HTTP/1.1" status: 200  len: 1002 time: 0.0971031
May 25 17:59:50.466080 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-784a6680-4035-460a-8407-5b8f4c04abfc req-a44e7a7c-3c22-431d-b1e8-2e32d19315bf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:59:50.467513 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-784a6680-4035-460a-8407-5b8f4c04abfc req-a44e7a7c-3c22-431d-b1e8-2e32d19315bf service neutron] 10.222.0.125 "GET /v2.0/subnets?id=704d0a85-ee4f-4df2-90a3-a525dfe28461 HTTP/1.1" status: 200  len: 856 time: 0.0611205
May 25 17:59:50.554610 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-784a6680-4035-460a-8407-5b8f4c04abfc req-9a990c85-b538-4494-b599-4b10209d05df service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 17:59:50.556008 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-784a6680-4035-460a-8407-5b8f4c04abfc req-9a990c85-b538-4494-b599-4b10209d05df service neutron] 10.222.0.125 "GET /v2.0/ports?network_id=45b850af-d423-458a-855a-d7f828a11fff&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0835822
May 25 17:59:50.664242 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4106b57f-c5bb-4b31-9428-17ba542b46fb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:59:50.690079 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-784a6680-4035-460a-8407-5b8f4c04abfc req-8077ff0d-8469-4a93-be03-1259ce643f76 service neutron] 10.222.0.125 "GET /v2.0/networks/45b850af-d423-458a-855a-d7f828a11fff?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1293600
May 25 17:59:50.825846 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-784a6680-4035-460a-8407-5b8f4c04abfc req-029d0b9b-252f-437f-bbde-238d4a834e50 service neutron] 10.222.0.125 "GET /v2.0/networks/45b850af-d423-458a-855a-d7f828a11fff?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1304774
May 25 17:59:50.904045 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:59:51.830559 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-7e261f94-b84f-443e-be49-3bc1ac903b55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:59:53.403277 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-6df2b2a7-a54e-4d57-9be3-033078b9d5b3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 17:59:53.759580 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.agents_db [None req-14fae233-15dc-4576-836b-621c5f95b584 None None] Agent healthcheck: found 6 active agents {{(pid=99029) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 18:00:11.784162 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:00:18.143874 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-fb23564d-90d7-47f8-9102-86c34c9653f9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:00:20.697468 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-7a0f82dd-fea4-4a38-be0e-a4f4558466e5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:00:20.970311 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:00:21.938386 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-7e261f94-b84f-443e-be49-3bc1ac903b55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:00:23.583524 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-6df2b2a7-a54e-4d57-9be3-033078b9d5b3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:00:30.757982 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.agents_db [None req-14fae233-15dc-4576-836b-621c5f95b584 None None] Agent healthcheck: found 6 active agents {{(pid=99029) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 18:00:41.723388 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:00:47.590311 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [req-e5f55d6b-a5ec-4893-acc8-221448b04015 req-11432c2e-f36f-410f-86f7-b5c96236b6ec service neutron] (99026) timed out ('10.222.0.125', 55486) {{(pid=99026) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:830}}
May 25 18:00:48.255193 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-eadc9bee-64b9-4359-8808-fbbff1d16bae None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:00:49.878904 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-dc66fed3-5ca7-4b04-a728-07443d2c2d5d req-ebdb7dd6-2f7c-4293-a285-0a553d9a601a service neutron] 10.222.0.125 "GET /v2.0/ports?device_id=13642fad-7755-444a-9c6e-d179ce91d0f4&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.0685627
May 25 18:00:50.021843 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc66fed3-5ca7-4b04-a728-07443d2c2d5d req-fe88bacb-d43f-46df-bc96-48b4159e80b4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:00:50.023317 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-dc66fed3-5ca7-4b04-a728-07443d2c2d5d req-fe88bacb-d43f-46df-bc96-48b4159e80b4 service neutron] 10.222.0.125 "GET /v2.0/ports?tenant_id=b4cdc54b260f4e79b87fdf4a43b12e16&device_id=13642fad-7755-444a-9c6e-d179ce91d0f4 HTTP/1.1" status: 200  len: 1098 time: 0.0748386
May 25 18:00:50.170466 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc66fed3-5ca7-4b04-a728-07443d2c2d5d req-6f3f3d7c-a3c0-435b-88eb-136df994189b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:00:50.171910 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-dc66fed3-5ca7-4b04-a728-07443d2c2d5d req-6f3f3d7c-a3c0-435b-88eb-136df994189b service neutron] 10.222.0.125 "GET /v2.0/networks?id=defaef08-c0f9-4608-b66d-b97e06e185bf HTTP/1.1" status: 200  len: 913 time: 0.1257885
May 25 18:00:50.278890 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-dc66fed3-5ca7-4b04-a728-07443d2c2d5d req-ed47fb2a-0057-4b2a-b3ad-8fed7ac652d5 service neutron] 10.222.0.125 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=0d0462ae-dc68-4a19-b6a6-bfdd10328c4c HTTP/1.1" status: 200  len: 1000 time: 0.0991833
May 25 18:00:50.344687 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc66fed3-5ca7-4b04-a728-07443d2c2d5d req-9e00d0bd-e161-4fc9-803f-ce1e70bfd59f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:00:50.346168 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-dc66fed3-5ca7-4b04-a728-07443d2c2d5d req-9e00d0bd-e161-4fc9-803f-ce1e70bfd59f service neutron] 10.222.0.125 "GET /v2.0/subnets?id=5be08358-9d04-4ee9-91ac-104e66e66e20 HTTP/1.1" status: 200  len: 850 time: 0.0584431
May 25 18:00:50.424374 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc66fed3-5ca7-4b04-a728-07443d2c2d5d req-38e71aee-2774-4a0d-9452-9bb8281a339d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:00:50.425880 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-dc66fed3-5ca7-4b04-a728-07443d2c2d5d req-38e71aee-2774-4a0d-9452-9bb8281a339d service neutron] 10.222.0.125 "GET /v2.0/ports?network_id=defaef08-c0f9-4608-b66d-b97e06e185bf&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0714417
May 25 18:00:50.564270 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-dc66fed3-5ca7-4b04-a728-07443d2c2d5d req-28f1f59a-d481-4a36-b086-9cd63a3604f4 service neutron] 10.222.0.125 "GET /v2.0/networks/defaef08-c0f9-4608-b66d-b97e06e185bf?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1293566
May 25 18:00:50.661100 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-e1c6c128-0b9f-44d4-85ea-5a9aea5ecf94 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:00:50.867330 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-dc66fed3-5ca7-4b04-a728-07443d2c2d5d req-5be09244-b9ac-4e3b-878e-f1185aaae775 service neutron] 10.222.0.125 "GET /v2.0/networks/defaef08-c0f9-4608-b66d-b97e06e185bf?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2950025
May 25 18:00:50.956288 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:00:51.877818 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-7e261f94-b84f-443e-be49-3bc1ac903b55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:00:53.436907 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-6df2b2a7-a54e-4d57-9be3-033078b9d5b3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:01:07.757403 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.agents_db [None req-14fae233-15dc-4576-836b-621c5f95b584 None None] Agent healthcheck: found 6 active agents {{(pid=99029) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 18:01:11.819536 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:01:18.167264 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-b3fe2b89-ee0d-4aa1-95b8-f4ec298364f5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:01:20.668308 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-49f43b84-8417-4a24-ac25-9c7ff49892d6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:01:20.897410 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:01:21.772953 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-7e261f94-b84f-443e-be49-3bc1ac903b55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:01:23.342444 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-6df2b2a7-a54e-4d57-9be3-033078b9d5b3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:01:41.691479 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:01:44.760462 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.agents_db [None req-14fae233-15dc-4576-836b-621c5f95b584 None None] Agent healthcheck: found 6 active agents {{(pid=99029) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 18:01:48.148066 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-5abab88c-82b1-4dab-bd1e-e46cedb7d2a9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:01:50.810766 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-0d859681-0f6e-428b-bf90-1ee9a65008a8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:01:50.867844 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:01:50.913411 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-2034cfc0-f8c3-479d-a06e-d289d07ffdaf req-a019339d-4ba1-4d66-b015-41920a733cbd service neutron] 10.222.0.125 "GET /v2.0/ports?device_id=6f66d198-4e81-4b59-a5ed-d28bf9c046e3&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.0758886
May 25 18:01:51.007956 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2034cfc0-f8c3-479d-a06e-d289d07ffdaf req-85e9ccd6-caf6-4709-bfe7-3448619ae4c0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:01:51.009479 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-2034cfc0-f8c3-479d-a06e-d289d07ffdaf req-85e9ccd6-caf6-4709-bfe7-3448619ae4c0 service neutron] 10.222.0.125 "GET /v2.0/ports?tenant_id=cf02997eda314aee8fb322add2fbb921&device_id=6f66d198-4e81-4b59-a5ed-d28bf9c046e3 HTTP/1.1" status: 200  len: 1099 time: 0.0711441
May 25 18:01:51.264844 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2034cfc0-f8c3-479d-a06e-d289d07ffdaf req-00728e4f-efd4-43a2-958f-5d43a3ede0de service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:01:51.273449 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-2034cfc0-f8c3-479d-a06e-d289d07ffdaf req-00728e4f-efd4-43a2-958f-5d43a3ede0de service neutron] 10.222.0.125 "GET /v2.0/networks?id=45b850af-d423-458a-855a-d7f828a11fff HTTP/1.1" status: 200  len: 919 time: 0.2337720
May 25 18:01:51.374885 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-2034cfc0-f8c3-479d-a06e-d289d07ffdaf req-4e6db417-6b2e-4152-ba54-b5c2c513e8ab service neutron] 10.222.0.125 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=940c93c6-ab4c-47b9-9b48-31aabb845ba8 HTTP/1.1" status: 200  len: 1002 time: 0.0988688
May 25 18:01:51.444308 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2034cfc0-f8c3-479d-a06e-d289d07ffdaf req-d9e2e272-9782-4a3c-9fd4-b69bb34f753a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:01:51.445821 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-2034cfc0-f8c3-479d-a06e-d289d07ffdaf req-d9e2e272-9782-4a3c-9fd4-b69bb34f753a service neutron] 10.222.0.125 "GET /v2.0/subnets?id=704d0a85-ee4f-4df2-90a3-a525dfe28461 HTTP/1.1" status: 200  len: 856 time: 0.0632470
May 25 18:01:51.524318 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2034cfc0-f8c3-479d-a06e-d289d07ffdaf req-fb2a86cc-f288-44a5-a547-8048f02ff8f8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:01:51.525749 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-2034cfc0-f8c3-479d-a06e-d289d07ffdaf req-fb2a86cc-f288-44a5-a547-8048f02ff8f8 service neutron] 10.222.0.125 "GET /v2.0/ports?network_id=45b850af-d423-458a-855a-d7f828a11fff&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0720356
May 25 18:01:51.662742 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-2034cfc0-f8c3-479d-a06e-d289d07ffdaf req-055ad537-087a-4abe-b866-07fc8b3b37ea service neutron] 10.222.0.125 "GET /v2.0/networks/45b850af-d423-458a-855a-d7f828a11fff?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1279683
May 25 18:01:51.800904 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-2034cfc0-f8c3-479d-a06e-d289d07ffdaf req-05de68b8-8006-4d47-8ded-fe9632253153 service neutron] 10.222.0.125 "GET /v2.0/networks/45b850af-d423-458a-855a-d7f828a11fff?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1292882
May 25 18:01:51.873318 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-7e261f94-b84f-443e-be49-3bc1ac903b55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:01:53.535342 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-6df2b2a7-a54e-4d57-9be3-033078b9d5b3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:02:11.740425 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:02:18.157414 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-3020adc4-469e-455c-a913-4f7398961080 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:02:20.722991 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-c5d7db65-2119-4cd7-9fc6-5656cbf629b6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:02:20.974248 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:02:21.760674 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.agents_db [None req-14fae233-15dc-4576-836b-621c5f95b584 None None] Agent healthcheck: found 6 active agents {{(pid=99029) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 18:02:21.882646 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-7e261f94-b84f-443e-be49-3bc1ac903b55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:02:23.437405 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-6df2b2a7-a54e-4d57-9be3-033078b9d5b3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:02:41.778282 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:02:48.190504 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-ad8b4bda-61e8-4a38-99ae-c35b701ea281 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:02:50.766397 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-11797286-eeaa-48e4-8315-fa5216fbc715 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:02:50.920711 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:02:51.783757 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-7e261f94-b84f-443e-be49-3bc1ac903b55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:02:52.976722 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-ab5caabb-311f-40d5-97ae-d4a42f82d876 req-0eb886bc-4608-4d84-b2b7-13f4bb24ff43 service neutron] 10.222.0.125 "GET /v2.0/ports?device_id=13642fad-7755-444a-9c6e-d179ce91d0f4&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.1791897
May 25 18:02:53.135429 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab5caabb-311f-40d5-97ae-d4a42f82d876 req-74c0f5ec-78e1-48aa-9d53-cd9f301ff5a6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:02:53.136943 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-ab5caabb-311f-40d5-97ae-d4a42f82d876 req-74c0f5ec-78e1-48aa-9d53-cd9f301ff5a6 service neutron] 10.222.0.125 "GET /v2.0/ports?tenant_id=b4cdc54b260f4e79b87fdf4a43b12e16&device_id=13642fad-7755-444a-9c6e-d179ce91d0f4 HTTP/1.1" status: 200  len: 1098 time: 0.0738170
May 25 18:02:53.290964 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab5caabb-311f-40d5-97ae-d4a42f82d876 req-34b33fa2-ea4a-436e-9a65-81d0a64eade4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:02:53.292411 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-ab5caabb-311f-40d5-97ae-d4a42f82d876 req-34b33fa2-ea4a-436e-9a65-81d0a64eade4 service neutron] 10.222.0.125 "GET /v2.0/networks?id=defaef08-c0f9-4608-b66d-b97e06e185bf HTTP/1.1" status: 200  len: 913 time: 0.1316803
May 25 18:02:53.343671 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-6df2b2a7-a54e-4d57-9be3-033078b9d5b3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:02:53.399475 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-ab5caabb-311f-40d5-97ae-d4a42f82d876 req-e4f93f4f-cd4e-49ee-8f5d-1ad627a7e5f7 service neutron] 10.222.0.125 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=0d0462ae-dc68-4a19-b6a6-bfdd10328c4c HTTP/1.1" status: 200  len: 1000 time: 0.1002362
May 25 18:02:53.466650 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab5caabb-311f-40d5-97ae-d4a42f82d876 req-7c99f15a-a916-4e31-a66f-b4f51cd336c8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:02:53.468093 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-ab5caabb-311f-40d5-97ae-d4a42f82d876 req-7c99f15a-a916-4e31-a66f-b4f51cd336c8 service neutron] 10.222.0.125 "GET /v2.0/subnets?id=5be08358-9d04-4ee9-91ac-104e66e66e20 HTTP/1.1" status: 200  len: 850 time: 0.0590212
May 25 18:02:53.548793 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab5caabb-311f-40d5-97ae-d4a42f82d876 req-7a694af7-d9a5-4aae-9620-0ea3836bded9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:02:53.550326 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-ab5caabb-311f-40d5-97ae-d4a42f82d876 req-7a694af7-d9a5-4aae-9620-0ea3836bded9 service neutron] 10.222.0.125 "GET /v2.0/ports?network_id=defaef08-c0f9-4608-b66d-b97e06e185bf&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0773938
May 25 18:02:53.559438 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [req-ab5caabb-311f-40d5-97ae-d4a42f82d876 req-1e31ca19-9a59-4963-84d3-0e922bb547f7 service neutron] http://10.222.0.122:9696/v2.0/extensions returned with HTTP 200 {{(pid=99027) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 25 18:02:53.560430 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-ab5caabb-311f-40d5-97ae-d4a42f82d876 req-1e31ca19-9a59-4963-84d3-0e922bb547f7 service neutron] 10.222.0.125 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.0048354
May 25 18:02:53.692050 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-ab5caabb-311f-40d5-97ae-d4a42f82d876 req-3ccc96ae-b76e-40ff-8f63-e118ed46e7e9 service neutron] 10.222.0.125 "GET /v2.0/networks/defaef08-c0f9-4608-b66d-b97e06e185bf?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1265280
May 25 18:02:53.827820 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-ab5caabb-311f-40d5-97ae-d4a42f82d876 req-1c9b8249-0493-4f2b-808b-7b31bb90eef2 service neutron] 10.222.0.125 "GET /v2.0/networks/defaef08-c0f9-4608-b66d-b97e06e185bf?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1271768
May 25 18:02:57.765722 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e293e159-89d9-4600-b787-6253b37e26e0 req-ecaaf2eb-4404-4da4-99cf-1ae335a08cbe tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:02:57.767744 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-e293e159-89d9-4600-b787-6253b37e26e0 req-ecaaf2eb-4404-4da4-99cf-1ae335a08cbe tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] 10.222.0.122 "GET /v2.0/ports?device_id=13642fad-7755-444a-9c6e-d179ce91d0f4 HTTP/1.1" status: 200  len: 945 time: 0.0830204
May 25 18:02:57.816419 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-e293e159-89d9-4600-b787-6253b37e26e0 req-4d33eb34-a610-4038-94e2-af63c09e22e0 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] 10.222.0.122 "GET /v2.0/security-groups?id=beb878a4-0349-4b8d-8e49-88c1a35c8216&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0428462
May 25 18:02:58.611285 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2bf8f981-ec69-4ccd-8fc6-149985ec20ad req-4d96bfde-bec4-41a5-8ac7-253ab82e302e tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:02:58.611913 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-2bf8f981-ec69-4ccd-8fc6-149985ec20ad req-4d96bfde-bec4-41a5-8ac7-253ab82e302e tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] 10.222.0.125 "GET /v2.0/ports?device_id=13642fad-7755-444a-9c6e-d179ce91d0f4 HTTP/1.1" status: 200  len: 945 time: 0.0812335
May 25 18:02:58.759834 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.agents_db [None req-14fae233-15dc-4576-836b-621c5f95b584 None None] Agent healthcheck: found 6 active agents {{(pid=99029) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 18:02:58.841682 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.plugin [req-2bf8f981-ec69-4ccd-8fc6-149985ec20ad req-77b2d102-b3a1-4ec8-9eab-235e80503e85 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Deleting port 0d0462ae-dc68-4a19-b6a6-bfdd10328c4c {{(pid=99027) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 18:02:58.842015 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-2bf8f981-ec69-4ccd-8fc6-149985ec20ad req-77b2d102-b3a1-4ec8-9eab-235e80503e85 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781841220419'] for port, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:02:59.028072 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.db [req-2bf8f981-ec69-4ccd-8fc6-149985ec20ad req-77b2d102-b3a1-4ec8-9eab-235e80503e85 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] For port 0d0462ae-dc68-4a19-b6a6-bfdd10328c4c, host hv-cinder-78956, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=0d0462ae-dc68-4a19-b6a6-bfdd10328c4c,segment=NetworkSegment(9ffd894c-b357-4c03-93af-a222f8984466),segment_id=9ffd894c-b357-4c03-93af-a222f8984466)] {{(pid=99027) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 18:02:59.028423 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-2bf8f981-ec69-4ccd-8fc6-149985ec20ad req-77b2d102-b3a1-4ec8-9eab-235e80503e85 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-418810'] for port, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:02:59.130801 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e3edfd8-30b3-42c3-bad0-5a29534f59bc req-e9e83b75-530c-4f6b-a041-77bf9b3a83b9 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:02:59.132265 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-3e3edfd8-30b3-42c3-bad0-5a29534f59bc req-e9e83b75-530c-4f6b-a041-77bf9b3a83b9 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] 10.222.0.122 "GET /v2.0/ports?device_id=13642fad-7755-444a-9c6e-d179ce91d0f4 HTTP/1.1" status: 200  len: 945 time: 0.2061226
May 25 18:02:59.260202 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-3e3edfd8-30b3-42c3-bad0-5a29534f59bc req-b96f4020-08db-418f-babb-6243625b4ffe tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] 10.222.0.122 "GET /v2.0/security-groups?id=beb878a4-0349-4b8d-8e49-88c1a35c8216&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1208053
May 25 18:02:59.367245 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-2bf8f981-ec69-4ccd-8fc6-149985ec20ad req-77b2d102-b3a1-4ec8-9eab-235e80503e85 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify callbacks [] for floatingip, precommit_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:02:59.367528 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-2bf8f981-ec69-4ccd-8fc6-149985ec20ad req-77b2d102-b3a1-4ec8-9eab-235e80503e85 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-419865'] for floatingip, after_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:02:59.367834 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.db.l3_db [req-2bf8f981-ec69-4ccd-8fc6-149985ec20ad req-77b2d102-b3a1-4ec8-9eab-235e80503e85 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Floating IP 4f3dd01e-d02b-4d74-a3a3-2b672f5cc2e4 disassociated. External IP: 172.27.3.37, port: 0d0462ae-dc68-4a19-b6a6-bfdd10328c4c.
May 25 18:02:59.368160 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.plugin [req-2bf8f981-ec69-4ccd-8fc6-149985ec20ad req-77b2d102-b3a1-4ec8-9eab-235e80503e85 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Calling delete_port for 0d0462ae-dc68-4a19-b6a6-bfdd10328c4c owned by compute:nova {{(pid=99027) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 18:02:59.595676 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-2bf8f981-ec69-4ccd-8fc6-149985ec20ad req-77b2d102-b3a1-4ec8-9eab-235e80503e85 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781841222566', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781840788188', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15468986'] for port, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:02:59.601106 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-0ebbd0f5-6944-4853-9286-5bc45d7bb720 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:02:59.645738 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77b2d102-b3a1-4ec8-9eab-235e80503e85 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Pushing event deleted for resources: {'Port': ['ID=0d0462ae-dc68-4a19-b6a6-bfdd10328c4c,revision_number=None']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:02:59.667476 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77b2d102-b3a1-4ec8-9eab-235e80503e85 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:02:59.667476 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77b2d102-b3a1-4ec8-9eab-235e80503e85 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:02:59.667476 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77b2d102-b3a1-4ec8-9eab-235e80503e85 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:02:59.667476 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77b2d102-b3a1-4ec8-9eab-235e80503e85 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:02:59.667476 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77b2d102-b3a1-4ec8-9eab-235e80503e85 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:02:59.667476 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77b2d102-b3a1-4ec8-9eab-235e80503e85 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:02:59.667476 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77b2d102-b3a1-4ec8-9eab-235e80503e85 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:02:59.667476 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77b2d102-b3a1-4ec8-9eab-235e80503e85 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:02:59.667476 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77b2d102-b3a1-4ec8-9eab-235e80503e85 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:02:59.667476 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77b2d102-b3a1-4ec8-9eab-235e80503e85 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:02:59.667476 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77b2d102-b3a1-4ec8-9eab-235e80503e85 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:02:59.667476 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-77b2d102-b3a1-4ec8-9eab-235e80503e85 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:02:59.667476 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-77b2d102-b3a1-4ec8-9eab-235e80503e85 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.063s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:02:59.867378 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.l3_agent_scheduler [req-2bf8f981-ec69-4ccd-8fc6-149985ec20ad req-77b2d102-b3a1-4ec8-9eab-235e80503e85 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Router d71e624d-d858-442b-b878-577be49edd03 has already been hosted by L3 agent eaeb6875-c4ed-43b6-8658-aa4e52324fdf {{(pid=99027) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 25 18:03:00.062992 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-2bf8f981-ec69-4ccd-8fc6-149985ec20ad req-77b2d102-b3a1-4ec8-9eab-235e80503e85 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify agent at l3_agent.dv-cinder-789564-2-iscsi the message routers_updated {{(pid=99027) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 25 18:03:00.073165 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5855aeb1-9131-46b3-9378-730cdedf09bc None None] Sync routers for ids ['d71e624d-d858-442b-b878-577be49edd03'] in dv-cinder-789564-2-iscsi {{(pid=99028) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 25 18:03:00.083967 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5855aeb1-9131-46b3-9378-730cdedf09bc None None] Routers {'d71e624d-d858-442b-b878-577be49edd03'} bound to L3 agent in host dv-cinder-789564-2-iscsi {{(pid=99028) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 18:03:00.084596 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-5855aeb1-9131-46b3-9378-730cdedf09bc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcae6d9e5e0>, 'dv-cinder-789564-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-25T17:34:21Z,description=<?>,heartbeat_timestamp=2021-05-25T18:02:51Z,host='dv-cinder-789564-2-iscsi',id=eaeb6875-c4ed-43b6-8658-aa4e52324fdf,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T17:34:21Z,topic='l3_agent')) {'router_ids': ['d71e624d-d858-442b-b878-577be49edd03'], 'active': True} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 18:03:00.149057 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.l3_dvrscheduler_db [req-2bf8f981-ec69-4ccd-8fc6-149985ec20ad req-77b2d102-b3a1-4ec8-9eab-235e80503e85 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] No DVR routers for this DVR port 0d0462ae-dc68-4a19-b6a6-bfdd10328c4c on host hv-cinder-78956 {{(pid=99027) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 25 18:03:00.151748 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-2bf8f981-ec69-4ccd-8fc6-149985ec20ad req-77b2d102-b3a1-4ec8-9eab-235e80503e85 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-239387'] for port, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:00.154497 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '13642fad-7755-444a-9c6e-d179ce91d0f4', 'name': 'network-vif-deleted', 'tag': '0d0462ae-dc68-4a19-b6a6-bfdd10328c4c'}] {{(pid=99027) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 18:03:00.257436 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '13642fad-7755-444a-9c6e-d179ce91d0f4', 'name': 'network-vif-deleted', 'tag': '0d0462ae-dc68-4a19-b6a6-bfdd10328c4c', 'status': 'completed', 'code': 200}
May 25 18:03:00.272512 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvr_db [None req-5855aeb1-9131-46b3-9378-730cdedf09bc None None] Set router d71e624d-d858-442b-b878-577be49edd03 gateway port host: dv-cinder-789564-2-iscsi {{(pid=99028) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 18:03:00.361509 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-2bf8f981-ec69-4ccd-8fc6-149985ec20ad req-77b2d102-b3a1-4ec8-9eab-235e80503e85 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] 10.222.0.125 "DELETE /v2.0/ports/0d0462ae-dc68-4a19-b6a6-bfdd10328c4c HTTP/1.1" status: 204  len: 173 time: 1.7430143
May 25 18:03:00.463079 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-9d12a341-ac92-41bb-ad4f-2b10b9bcc821 req-93700d72-8786-4833-a215-f96a5db6d501 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Synchronizing usage tracker for tenant:b4cdc54b260f4e79b87fdf4a43b12e16 on resource:port {{(pid=99027) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 18:03:00.588085 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-9d12a341-ac92-41bb-ad4f-2b10b9bcc821 req-93700d72-8786-4833-a215-f96a5db6d501 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Unset dirty status for tenant:b4cdc54b260f4e79b87fdf4a43b12e16 on resource:port {{(pid=99027) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 18:03:00.589282 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-9d12a341-ac92-41bb-ad4f-2b10b9bcc821 req-93700d72-8786-4833-a215-f96a5db6d501 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] 10.222.0.122 "GET /v2.0/ports?device_id=13642fad-7755-444a-9c6e-d179ce91d0f4 HTTP/1.1" status: 200  len: 210 time: 0.2196610
May 25 18:03:00.618594 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-5855aeb1-9131-46b3-9378-730cdedf09bc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcae6d9e5e0>, [{'id': 'd71e624d-d858-442b-b878-577be49edd03', 'name': 'tempest-AttachVolumeTestJSON-1986395052-router', 'tenant_id': 'b4cdc54b260f4e79b87fdf4a43b12e16', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.176'}], 'enable_snat': True}, 'gw_port_id': '9635c7b0-eb08-41ee-980e-3da56221f88d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:42:22Z', 'updated_at': '2021-05-25T17:42:34Z', 'revision_number': 4, 'project_id': 'b4cdc54b260f4e79b87fdf4a43b12e16', 'gw_port': {'id': '9635c7b0-eb08-41ee-980e-3da56221f88d', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:44:59', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd71e624d-d858-442b-b878-577be49edd03', 'device_owner': 'network:router_gateway', 'standard_attr_id': 80, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.176', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:42:23Z', 'updated_at': '2021-05-25T17:42:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi', '_interfaces': [{'id': 'd13f3233-9e09-41c7-8315-4eae735fe605', 'name': '', 'network_id': 'defaef08-c0f9-4608-b66d-b97e06e185bf', 'tenant_id': 'b4cdc54b260f4e79b87fdf4a43b12e16', 'mac_address': 'fa:16:3e:87:b7:74', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd71e624d-d858-442b-b878-577be49edd03', 'device_owner': 'network:router_interface', 'standard_attr_id': 106, 'fixed_ips': [{'subnet_id': '5be08358-9d04-4ee9-91ac-104e66e66e20', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:42:29Z', 'updated_at': '2021-05-25T17:42:46Z', 'revision_number': 5, 'project_id': 'b4cdc54b260f4e79b87fdf4a43b12e16', 'subnets': [{'id': '5be08358-9d04-4ee9-91ac-104e66e66e20', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-789564-2-iscsi', False) {} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 18:03:00.622664 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5855aeb1-9131-46b3-9378-730cdedf09bc None None] Checking router: d71e624d-d858-442b-b878-577be49edd03 for host: dv-cinder-789564-2-iscsi {{(pid=99028) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 25 18:03:00.631969 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5855aeb1-9131-46b3-9378-730cdedf09bc None None] Routers {'d71e624d-d858-442b-b878-577be49edd03'} bound to L3 agent in host dv-cinder-789564-2-iscsi {{(pid=99028) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 18:03:00.632579 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-5855aeb1-9131-46b3-9378-730cdedf09bc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcae6d9e5e0>, 'dv-cinder-789564-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-25T17:34:21Z,description=<?>,heartbeat_timestamp=2021-05-25T18:02:51Z,host='dv-cinder-789564-2-iscsi',id=eaeb6875-c4ed-43b6-8658-aa4e52324fdf,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T17:34:21Z,topic='l3_agent')) {'router_ids': ['d71e624d-d858-442b-b878-577be49edd03'], 'active': True} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 18:03:00.812706 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvr_db [None req-5855aeb1-9131-46b3-9378-730cdedf09bc None None] Set router d71e624d-d858-442b-b878-577be49edd03 gateway port host: dv-cinder-789564-2-iscsi {{(pid=99028) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 18:03:01.171792 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-5855aeb1-9131-46b3-9378-730cdedf09bc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcae6d9e5e0>, [{'id': 'd71e624d-d858-442b-b878-577be49edd03', 'name': 'tempest-AttachVolumeTestJSON-1986395052-router', 'tenant_id': 'b4cdc54b260f4e79b87fdf4a43b12e16', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.176'}], 'enable_snat': True}, 'gw_port_id': '9635c7b0-eb08-41ee-980e-3da56221f88d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:42:22Z', 'updated_at': '2021-05-25T17:42:34Z', 'revision_number': 4, 'project_id': 'b4cdc54b260f4e79b87fdf4a43b12e16', 'gw_port': {'id': '9635c7b0-eb08-41ee-980e-3da56221f88d', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:44:59', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd71e624d-d858-442b-b878-577be49edd03', 'device_owner': 'network:router_gateway', 'standard_attr_id': 80, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.176', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:42:23Z', 'updated_at': '2021-05-25T17:42:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi', '_interfaces': [{'id': 'd13f3233-9e09-41c7-8315-4eae735fe605', 'name': '', 'network_id': 'defaef08-c0f9-4608-b66d-b97e06e185bf', 'tenant_id': 'b4cdc54b260f4e79b87fdf4a43b12e16', 'mac_address': 'fa:16:3e:87:b7:74', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd71e624d-d858-442b-b878-577be49edd03', 'device_owner': 'network:router_interface', 'standard_attr_id': 106, 'fixed_ips': [{'subnet_id': '5be08358-9d04-4ee9-91ac-104e66e66e20', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:42:29Z', 'updated_at': '2021-05-25T17:42:46Z', 'revision_number': 5, 'project_id': 'b4cdc54b260f4e79b87fdf4a43b12e16', 'subnets': [{'id': '5be08358-9d04-4ee9-91ac-104e66e66e20', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-789564-2-iscsi', False) {} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 18:03:01.176434 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5855aeb1-9131-46b3-9378-730cdedf09bc None None] The sync data for ids ['d71e624d-d858-442b-b878-577be49edd03'] in dv-cinder-789564-2-iscsi is: [{'id': 'd71e624d-d858-442b-b878-577be49edd03', 'name': 'tempest-AttachVolumeTestJSON-1986395052-router', 'tenant_id': 'b4cdc54b260f4e79b87fdf4a43b12e16', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.176'}], 'enable_snat': True}, 'gw_port_id': '9635c7b0-eb08-41ee-980e-3da56221f88d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:42:22Z', 'updated_at': '2021-05-25T17:42:34Z', 'revision_number': 4, 'project_id': 'b4cdc54b260f4e79b87fdf4a43b12e16', 'gw_port': {'id': '9635c7b0-eb08-41ee-980e-3da56221f88d', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:44:59', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd71e624d-d858-442b-b878-577be49edd03', 'device_owner': 'network:router_gateway', 'standard_attr_id': 80, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.176', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:42:23Z', 'updated_at': '2021-05-25T17:42:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi', '_interfaces': [{'id': 'd13f3233-9e09-41c7-8315-4eae735fe605', 'name': '', 'network_id': 'defaef08-c0f9-4608-b66d-b97e06e185bf', 'tenant_id': 'b4cdc54b260f4e79b87fdf4a43b12e16', 'mac_address': 'fa:16:3e:87:b7:74', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd71e624d-d858-442b-b878-577be49edd03', 'device_owner': 'network:router_interface', 'standard_attr_id': 106, 'fixed_ips': [{'subnet_id': '5be08358-9d04-4ee9-91ac-104e66e66e20', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:42:29Z', 'updated_at': '2021-05-25T17:42:46Z', 'revision_number': 5, 'project_id': 'b4cdc54b260f4e79b87fdf4a43b12e16', 'subnets': [{'id': '5be08358-9d04-4ee9-91ac-104e66e66e20', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=99028) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 25 18:03:01.405346 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9ac88ecc-ed7a-4276-87f4-2f70fb4c3637 None None] New status for floating IP 4f3dd01e-d02b-4d74-a3a3-2b672f5cc2e4: DOWN {{(pid=99029) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 25 18:03:01.841368 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 51102) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 18:03:01.908836 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-937fbfbc-7fd8-43dd-98a6-165fb5e3bea1 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify callbacks [] for security_group, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:01.936378 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-937fbfbc-7fd8-43dd-98a6-165fb5e3bea1 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify callbacks [] for security_group, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:01.956036 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Device 0d0462ae-dc68-4a19-b6a6-bfdd10328c4c no longer exists at agent hyperv_hv-cinder-78956 {{(pid=99028) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 18:03:01.990505 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.plugin [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] No Port match for: 0d0462ae-dc68-4a19-b6a6-bfdd10328c4c {{(pid=99028) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 25 18:03:01.990858 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Device 0d0462ae-dc68-4a19-b6a6-bfdd10328c4c not bound to the agent host hv-cinder-78956 {{(pid=99028) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 25 18:03:02.143331 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-937fbfbc-7fd8-43dd-98a6-165fb5e3bea1 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:02.149103 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-670b7157-d104-42cf-a680-7e261e653452 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:03:02.164037 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-937fbfbc-7fd8-43dd-98a6-165fb5e3bea1 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=beb878a4-0349-4b8d-8e49-88c1a35c8216,revision_number=None']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:03:02.166581 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-937fbfbc-7fd8-43dd-98a6-165fb5e3bea1 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:03:02.404807 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-937fbfbc-7fd8-43dd-98a6-165fb5e3bea1 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify callbacks [] for security_group, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:02.406046 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-937fbfbc-7fd8-43dd-98a6-165fb5e3bea1 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] 10.222.0.122 "DELETE /v2.0/security-groups/beb878a4-0349-4b8d-8e49-88c1a35c8216 HTTP/1.1" status: 204  len: 168 time: 0.5636995
May 25 18:03:02.409246 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 51106) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 18:03:02.431094 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.api.v2.resource [None req-f4fb3219-9a3d-4255-95ae-30c7c3d0cb6a tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] show failed (client error): The resource could not be found.
May 25 18:03:02.431094 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-f4fb3219-9a3d-4255-95ae-30c7c3d0cb6a tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] 10.222.0.122 "GET /v2.0/security-groups/beb878a4-0349-4b8d-8e49-88c1a35c8216 HTTP/1.1" status: 404  len: 347 time: 0.0157778
May 25 18:03:02.433104 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 51110) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 18:03:02.752300 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.plugin [None req-6f5dca94-edbf-4ab8-9551-e87642f097f6 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Deleting port 471500a8-ede1-465b-89b9-3afa55aa0e36 {{(pid=99027) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 18:03:02.752635 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-6f5dca94-edbf-4ab8-9551-e87642f097f6 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781841220419'] for port, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:02.876597 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-6f5dca94-edbf-4ab8-9551-e87642f097f6 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-418810'] for port, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:02.877295 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-6f5dca94-edbf-4ab8-9551-e87642f097f6 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:03.000432 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.plugin [None req-6f5dca94-edbf-4ab8-9551-e87642f097f6 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Calling delete_port for 471500a8-ede1-465b-89b9-3afa55aa0e36 owned by network:floatingip {{(pid=99027) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 18:03:03.291550 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-6f5dca94-edbf-4ab8-9551-e87642f097f6 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781841222566', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781840788188', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15468986'] for port, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:03.295479 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-242e741d-a250-4f57-a3ea-057f13c71969 tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:03:03.339337 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f5dca94-edbf-4ab8-9551-e87642f097f6 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Pushing event deleted for resources: {'Port': ['ID=471500a8-ede1-465b-89b9-3afa55aa0e36,revision_number=None']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:03:03.342511 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-6f5dca94-edbf-4ab8-9551-e87642f097f6 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:03:03.431950 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-6f5dca94-edbf-4ab8-9551-e87642f097f6 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify callbacks [] for floatingip, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:03.600628 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-6f5dca94-edbf-4ab8-9551-e87642f097f6 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-239387'] for floatingip, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:03.601778 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-6f5dca94-edbf-4ab8-9551-e87642f097f6 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] 10.222.0.122 "DELETE /v2.0/floatingips/4f3dd01e-d02b-4d74-a3a3-2b672f5cc2e4 HTTP/1.1" status: 204  len: 168 time: 1.1677287
May 25 18:03:07.051491 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 51134) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 18:03:07.688769 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-c1ce38cc-5eb8-4dad-b914-04776214de98 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-420907'] for router_interface, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:08.204731 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.plugin [None req-c1ce38cc-5eb8-4dad-b914-04776214de98 admin admin] Deleting port d13f3233-9e09-41c7-8315-4eae735fe605 {{(pid=99027) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 18:03:08.205467 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-c1ce38cc-5eb8-4dad-b914-04776214de98 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781841220419'] for port, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:08.323944 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.db [None req-c1ce38cc-5eb8-4dad-b914-04776214de98 admin admin] For port d13f3233-9e09-41c7-8315-4eae735fe605, host dv-cinder-789564-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=d13f3233-9e09-41c7-8315-4eae735fe605,segment=NetworkSegment(9ffd894c-b357-4c03-93af-a222f8984466),segment_id=9ffd894c-b357-4c03-93af-a222f8984466)] {{(pid=99027) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 18:03:08.324292 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-c1ce38cc-5eb8-4dad-b914-04776214de98 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-418810'] for port, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:08.449692 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.plugin [None req-c1ce38cc-5eb8-4dad-b914-04776214de98 admin admin] Calling delete_port for d13f3233-9e09-41c7-8315-4eae735fe605 owned by network:router_interface {{(pid=99027) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 18:03:08.720203 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-c1ce38cc-5eb8-4dad-b914-04776214de98 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781841222566', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781840788188', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15468986'] for port, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:08.724730 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-4042612e-03a0-46d3-85ac-bdb052b06f36 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:03:08.774418 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1ce38cc-5eb8-4dad-b914-04776214de98 admin admin] Pushing event deleted for resources: {'Port': ['ID=d13f3233-9e09-41c7-8315-4eae735fe605,revision_number=None']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:03:08.777129 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-c1ce38cc-5eb8-4dad-b914-04776214de98 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:03:09.051933 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-c1ce38cc-5eb8-4dad-b914-04776214de98 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-551393', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-420795'] for router_interface, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:09.411039 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c1ce38cc-5eb8-4dad-b914-04776214de98 admin admin] Router d71e624d-d858-442b-b878-577be49edd03 has already been hosted by L3 agent eaeb6875-c4ed-43b6-8658-aa4e52324fdf {{(pid=99027) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 25 18:03:09.697367 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c1ce38cc-5eb8-4dad-b914-04776214de98 admin admin] Notify agent at l3_agent.dv-cinder-789564-2-iscsi the message routers_updated {{(pid=99027) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 25 18:03:09.705914 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f122634f-3384-431b-a489-8745f1bf0f7c None None] Sync routers for ids ['d71e624d-d858-442b-b878-577be49edd03'] in dv-cinder-789564-2-iscsi {{(pid=99028) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 25 18:03:09.709283 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-c1ce38cc-5eb8-4dad-b914-04776214de98 admin admin] 10.222.0.122 "PUT /v2.0/routers/d71e624d-d858-442b-b878-577be49edd03/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.6563561
May 25 18:03:09.711785 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 51140) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 18:03:09.715728 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f122634f-3384-431b-a489-8745f1bf0f7c None None] Routers {'d71e624d-d858-442b-b878-577be49edd03'} bound to L3 agent in host dv-cinder-789564-2-iscsi {{(pid=99028) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 18:03:09.716335 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-f122634f-3384-431b-a489-8745f1bf0f7c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcae595bd00>, 'dv-cinder-789564-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-25T17:34:21Z,description=<?>,heartbeat_timestamp=2021-05-25T18:02:51Z,host='dv-cinder-789564-2-iscsi',id=eaeb6875-c4ed-43b6-8658-aa4e52324fdf,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T17:34:21Z,topic='l3_agent')) {'router_ids': ['d71e624d-d858-442b-b878-577be49edd03'], 'active': True} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 18:03:09.890466 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-9aca03ca-2082-4ac8-a22a-321420ba360e admin admin] Notify callbacks [] for router, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:09.897735 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvr_db [None req-f122634f-3384-431b-a489-8745f1bf0f7c None None] Set router d71e624d-d858-442b-b878-577be49edd03 gateway port host: dv-cinder-789564-2-iscsi {{(pid=99028) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 18:03:10.073960 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-9aca03ca-2082-4ac8-a22a-321420ba360e admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:10.203978 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-f122634f-3384-431b-a489-8745f1bf0f7c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcae595bd00>, [{'id': 'd71e624d-d858-442b-b878-577be49edd03', 'name': 'tempest-AttachVolumeTestJSON-1986395052-router', 'tenant_id': 'b4cdc54b260f4e79b87fdf4a43b12e16', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.176'}], 'enable_snat': True}, 'gw_port_id': '9635c7b0-eb08-41ee-980e-3da56221f88d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:42:22Z', 'updated_at': '2021-05-25T18:03:08Z', 'revision_number': 5, 'project_id': 'b4cdc54b260f4e79b87fdf4a43b12e16', 'gw_port': {'id': '9635c7b0-eb08-41ee-980e-3da56221f88d', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:44:59', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd71e624d-d858-442b-b878-577be49edd03', 'device_owner': 'network:router_gateway', 'standard_attr_id': 80, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.176', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:42:23Z', 'updated_at': '2021-05-25T17:42:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi'}], 'dv-cinder-789564-2-iscsi', False) {} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 18:03:10.207884 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f122634f-3384-431b-a489-8745f1bf0f7c None None] Checking router: d71e624d-d858-442b-b878-577be49edd03 for host: dv-cinder-789564-2-iscsi {{(pid=99028) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 25 18:03:10.216249 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f122634f-3384-431b-a489-8745f1bf0f7c None None] Routers {'d71e624d-d858-442b-b878-577be49edd03'} bound to L3 agent in host dv-cinder-789564-2-iscsi {{(pid=99028) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 18:03:10.216855 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-f122634f-3384-431b-a489-8745f1bf0f7c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcae595bd00>, 'dv-cinder-789564-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-25T17:34:21Z,description=<?>,heartbeat_timestamp=2021-05-25T18:02:51Z,host='dv-cinder-789564-2-iscsi',id=eaeb6875-c4ed-43b6-8658-aa4e52324fdf,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T17:34:21Z,topic='l3_agent')) {'router_ids': ['d71e624d-d858-442b-b878-577be49edd03'], 'active': True} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 18:03:10.232985 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.plugin [None req-9aca03ca-2082-4ac8-a22a-321420ba360e admin admin] Deleting port 9635c7b0-eb08-41ee-980e-3da56221f88d {{(pid=99027) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 18:03:10.233356 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-9aca03ca-2082-4ac8-a22a-321420ba360e admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781841220419'] for port, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:10.360582 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.db [None req-9aca03ca-2082-4ac8-a22a-321420ba360e admin admin] For port 9635c7b0-eb08-41ee-980e-3da56221f88d, host dv-cinder-789564-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=9635c7b0-eb08-41ee-980e-3da56221f88d,segment=NetworkSegment(471771f9-c462-4865-800d-0d5029e9eb3e),segment_id=471771f9-c462-4865-800d-0d5029e9eb3e)] {{(pid=99027) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 18:03:10.360867 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-9aca03ca-2082-4ac8-a22a-321420ba360e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-418810'] for port, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:10.375321 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvr_db [None req-f122634f-3384-431b-a489-8745f1bf0f7c None None] Set router d71e624d-d858-442b-b878-577be49edd03 gateway port host: None {{(pid=99028) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 18:03:10.488426 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-f122634f-3384-431b-a489-8745f1bf0f7c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcae595bd00>, [{'id': 'd71e624d-d858-442b-b878-577be49edd03', 'name': 'tempest-AttachVolumeTestJSON-1986395052-router', 'tenant_id': 'b4cdc54b260f4e79b87fdf4a43b12e16', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:42:22Z', 'updated_at': '2021-05-25T18:03:10Z', 'revision_number': 6, 'project_id': 'b4cdc54b260f4e79b87fdf4a43b12e16', 'gw_port_host': None}], 'dv-cinder-789564-2-iscsi', False) {} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 18:03:10.490939 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.plugin [None req-9aca03ca-2082-4ac8-a22a-321420ba360e admin admin] Calling delete_port for 9635c7b0-eb08-41ee-980e-3da56221f88d owned by network:router_gateway {{(pid=99027) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 18:03:10.493313 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f122634f-3384-431b-a489-8745f1bf0f7c None None] The sync data for ids ['d71e624d-d858-442b-b878-577be49edd03'] in dv-cinder-789564-2-iscsi is: [{'id': 'd71e624d-d858-442b-b878-577be49edd03', 'name': 'tempest-AttachVolumeTestJSON-1986395052-router', 'tenant_id': 'b4cdc54b260f4e79b87fdf4a43b12e16', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:42:22Z', 'updated_at': '2021-05-25T18:03:10Z', 'revision_number': 6, 'project_id': 'b4cdc54b260f4e79b87fdf4a43b12e16', 'gw_port_host': None}] {{(pid=99028) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 25 18:03:10.793766 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-9aca03ca-2082-4ac8-a22a-321420ba360e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781841222566', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781840788188', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15468986'] for port, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:10.797740 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-68b3bb15-8e5c-45d3-b02b-f2bd04cb8d33 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:03:10.840799 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9aca03ca-2082-4ac8-a22a-321420ba360e admin admin] Pushing event deleted for resources: {'Port': ['ID=9635c7b0-eb08-41ee-980e-3da56221f88d,revision_number=None']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:03:10.843402 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-9aca03ca-2082-4ac8-a22a-321420ba360e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:03:10.943761 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-9aca03ca-2082-4ac8-a22a-321420ba360e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-419894'] for router_gateway, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:11.121447 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-9aca03ca-2082-4ac8-a22a-321420ba360e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-415163', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-6965'] for router, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:11.123534 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-9aca03ca-2082-4ac8-a22a-321420ba360e admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:11.324913 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-9aca03ca-2082-4ac8-a22a-321420ba360e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-414855'] for router, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:11.325475 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9aca03ca-2082-4ac8-a22a-321420ba360e admin admin] Fanout notify agent at l3_agent the message router_deleted on router d71e624d-d858-442b-b878-577be49edd03 {{(pid=99027) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
May 25 18:03:11.338935 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-9aca03ca-2082-4ac8-a22a-321420ba360e admin admin] Notify callbacks [] for router, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:11.353609 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-9aca03ca-2082-4ac8-a22a-321420ba360e admin admin] 10.222.0.122 "DELETE /v2.0/routers/d71e624d-d858-442b-b878-577be49edd03 HTTP/1.1" status: 204  len: 168 time: 1.6275065
May 25 18:03:11.353782 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 51144) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 18:03:11.407632 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.db_base_plugin_v2 [None req-a4b2fb3e-a1d2-45f1-8ec0-bae46b824603 admin admin] Deleting subnet 5be08358-9d04-4ee9-91ac-104e66e66e20 {{(pid=99026) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 25 18:03:11.411932 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-a4b2fb3e-a1d2-45f1-8ec0-bae46b824603 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:11.470209 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-a4b2fb3e-a1d2-45f1-8ec0-bae46b824603 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-14735050'] for subnet, precommit_delete_associations {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:11.554248 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-a4b2fb3e-a1d2-45f1-8ec0-bae46b824603 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1474503'] for subnet, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:11.797182 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device d13f3233-9e09-41c7-8315-4eae735fe605 no longer exists at agent ovs-agent-dv-cinder-789564-2-iscsi {{(pid=99028) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 18:03:11.831211 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.plugin [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] No Port match for: d13f3233-9e09-41c7-8315-4eae735fe605 {{(pid=99028) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 25 18:03:11.831564 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device d13f3233-9e09-41c7-8315-4eae735fe605 not bound to the agent host dv-cinder-789564-2-iscsi {{(pid=99028) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 25 18:03:11.831984 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device 9635c7b0-eb08-41ee-980e-3da56221f88d no longer exists at agent ovs-agent-dv-cinder-789564-2-iscsi {{(pid=99028) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 18:03:11.858522 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:11.869641 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.plugin [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] No Port match for: 9635c7b0-eb08-41ee-980e-3da56221f88d {{(pid=99028) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 25 18:03:11.869993 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device 9635c7b0-eb08-41ee-980e-3da56221f88d not bound to the agent host dv-cinder-789564-2-iscsi {{(pid=99028) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 25 18:03:11.925401 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-a4b2fb3e-a1d2-45f1-8ec0-bae46b824603 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1473138', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114466', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-15477963', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-14794250'] for subnet, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:11.929574 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:03:12.066421 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4b2fb3e-a1d2-45f1-8ec0-bae46b824603 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=5be08358-9d04-4ee9-91ac-104e66e66e20,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:03:12.073579 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-a4b2fb3e-a1d2-45f1-8ec0-bae46b824603 admin admin] Notify callbacks [] for subnet, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:12.079646 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-92b928e4-2182-437b-b9fd-34e46c4e1e96 None None] Network defaef08-c0f9-4608-b66d-b97e06e185bf requested from dv-cinder-789564-2-iscsi {{(pid=99028) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 18:03:12.083322 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4b2fb3e-a1d2-45f1-8ec0-bae46b824603 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:03:12.083700 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4b2fb3e-a1d2-45f1-8ec0-bae46b824603 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:03:12.084071 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4b2fb3e-a1d2-45f1-8ec0-bae46b824603 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:03:12.084434 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4b2fb3e-a1d2-45f1-8ec0-bae46b824603 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:03:12.084793 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4b2fb3e-a1d2-45f1-8ec0-bae46b824603 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:03:12.085184 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4b2fb3e-a1d2-45f1-8ec0-bae46b824603 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:03:12.085545 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4b2fb3e-a1d2-45f1-8ec0-bae46b824603 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:03:12.085903 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4b2fb3e-a1d2-45f1-8ec0-bae46b824603 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:03:12.086258 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4b2fb3e-a1d2-45f1-8ec0-bae46b824603 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:03:12.086608 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4b2fb3e-a1d2-45f1-8ec0-bae46b824603 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:03:12.086960 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4b2fb3e-a1d2-45f1-8ec0-bae46b824603 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:03:12.087309 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4b2fb3e-a1d2-45f1-8ec0-bae46b824603 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:03:12.090496 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-a4b2fb3e-a1d2-45f1-8ec0-bae46b824603 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.161s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:03:12.093669 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-a4b2fb3e-a1d2-45f1-8ec0-bae46b824603 admin admin] 10.222.0.122 "DELETE /v2.0/subnets/5be08358-9d04-4ee9-91ac-104e66e66e20 HTTP/1.1" status: 204  len: 168 time: 0.7481251
May 25 18:03:12.095231 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 51148) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 18:03:12.213803 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-03a5d74f-0107-4838-957d-cbc069fd9c81 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1492659'] for network, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:12.287370 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.plugin [None req-03a5d74f-0107-4838-957d-cbc069fd9c81 admin admin] Deleting port c581af52-ceeb-4e7f-aa17-780c5a994e5e {{(pid=99026) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 18:03:12.287708 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-03a5d74f-0107-4838-957d-cbc069fd9c81 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781841220419'] for port, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:12.320303 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-709aad51-ab4b-4807-b23d-1bb7bfd398ad None None] DHCP port deletion for defaef08-c0f9-4608-b66d-b97e06e185bf request from dv-cinder-789564-2-iscsi {{(pid=99028) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
May 25 18:03:12.389029 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.plugin [None req-709aad51-ab4b-4807-b23d-1bb7bfd398ad None None] Deleting port c581af52-ceeb-4e7f-aa17-780c5a994e5e {{(pid=99028) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 18:03:12.389435 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-709aad51-ab4b-4807-b23d-1bb7bfd398ad None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781841220419'] for port, before_delete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:12.395298 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.db [None req-03a5d74f-0107-4838-957d-cbc069fd9c81 admin admin] For port c581af52-ceeb-4e7f-aa17-780c5a994e5e, host dv-cinder-789564-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=c581af52-ceeb-4e7f-aa17-780c5a994e5e,segment=NetworkSegment(9ffd894c-b357-4c03-93af-a222f8984466),segment_id=9ffd894c-b357-4c03-93af-a222f8984466)] {{(pid=99026) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 18:03:12.395871 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-03a5d74f-0107-4838-957d-cbc069fd9c81 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-418810'] for port, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:12.487321 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-709aad51-ab4b-4807-b23d-1bb7bfd398ad None None] For port c581af52-ceeb-4e7f-aa17-780c5a994e5e, host dv-cinder-789564-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=c581af52-ceeb-4e7f-aa17-780c5a994e5e,segment=NetworkSegment(9ffd894c-b357-4c03-93af-a222f8984466),segment_id=9ffd894c-b357-4c03-93af-a222f8984466)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 18:03:12.487709 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-709aad51-ab4b-4807-b23d-1bb7bfd398ad None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-418810'] for port, precommit_delete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:12.521643 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.plugin [None req-03a5d74f-0107-4838-957d-cbc069fd9c81 admin admin] Calling delete_port for c581af52-ceeb-4e7f-aa17-780c5a994e5e owned by network:dhcp {{(pid=99026) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 18:03:12.654325 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.plugin [None req-709aad51-ab4b-4807-b23d-1bb7bfd398ad None None] Calling delete_port for c581af52-ceeb-4e7f-aa17-780c5a994e5e owned by network:dhcp {{(pid=99028) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 18:03:12.673549 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-03a5d74f-0107-4838-957d-cbc069fd9c81 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781841222566', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781840788188', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15476536'] for port, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:12.678433 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-85a95637-f68d-436d-888f-9b1b91c99771 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:03:12.699687 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-709aad51-ab4b-4807-b23d-1bb7bfd398ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781841222566', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781840788188'] for port, after_delete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:12.704908 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:03:12.722857 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03a5d74f-0107-4838-957d-cbc069fd9c81 admin admin] Pushing event deleted for resources: {'Port': ['ID=c581af52-ceeb-4e7f-aa17-780c5a994e5e,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:03:12.727899 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.l3_dvrscheduler_db [None req-03a5d74f-0107-4838-957d-cbc069fd9c81 admin admin] No DVR routers for this DVR port c581af52-ceeb-4e7f-aa17-780c5a994e5e on host dv-cinder-789564-2-iscsi {{(pid=99026) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 25 18:03:12.727899 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-03a5d74f-0107-4838-957d-cbc069fd9c81 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:03:12.751185 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-709aad51-ab4b-4807-b23d-1bb7bfd398ad None None] Pushing event deleted for resources: {'Port': ['ID=c581af52-ceeb-4e7f-aa17-780c5a994e5e,revision_number=None']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:03:12.757326 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvrscheduler_db [None req-709aad51-ab4b-4807-b23d-1bb7bfd398ad None None] No DVR routers for this DVR port c581af52-ceeb-4e7f-aa17-780c5a994e5e on host dv-cinder-789564-2-iscsi {{(pid=99028) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 25 18:03:12.768114 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-709aad51-ab4b-4807-b23d-1bb7bfd398ad None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:03:12.768114 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-709aad51-ab4b-4807-b23d-1bb7bfd398ad None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:03:12.768114 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-709aad51-ab4b-4807-b23d-1bb7bfd398ad None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:03:12.768114 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-709aad51-ab4b-4807-b23d-1bb7bfd398ad None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:03:12.768114 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-709aad51-ab4b-4807-b23d-1bb7bfd398ad None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:03:12.768114 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-709aad51-ab4b-4807-b23d-1bb7bfd398ad None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:03:12.768946 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-709aad51-ab4b-4807-b23d-1bb7bfd398ad None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:03:12.768946 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-709aad51-ab4b-4807-b23d-1bb7bfd398ad None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:03:12.768946 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-709aad51-ab4b-4807-b23d-1bb7bfd398ad None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:03:12.769294 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-709aad51-ab4b-4807-b23d-1bb7bfd398ad None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:03:12.769631 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-709aad51-ab4b-4807-b23d-1bb7bfd398ad None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:03:12.769943 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-709aad51-ab4b-4807-b23d-1bb7bfd398ad None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:03:12.773023 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-709aad51-ab4b-4807-b23d-1bb7bfd398ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.068s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:03:12.845875 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-03a5d74f-0107-4838-957d-cbc069fd9c81 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1470792', 'neutron.services.segments.db._delete_segments_for_network-8781841233116'] for network, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:12.858310 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.services.segments.db [None req-03a5d74f-0107-4838-957d-cbc069fd9c81 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fcae56b6bb0>,) {'filters': {'network_id': ['defaef08-c0f9-4608-b66d-b97e06e185bf']}} {{(pid=99026) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 18:03:12.870210 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.services.segments.db [None req-03a5d74f-0107-4838-957d-cbc069fd9c81 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fcae56b6bb0>, '9ffd894c-b357-4c03-93af-a222f8984466') {'for_net_delete': True} {{(pid=99026) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 18:03:12.870505 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.services.segments.db [None req-03a5d74f-0107-4838-957d-cbc069fd9c81 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fcae56b6bb0>, '9ffd894c-b357-4c03-93af-a222f8984466') {} {{(pid=99026) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 18:03:12.882284 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-03a5d74f-0107-4838-957d-cbc069fd9c81 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8781841242525', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-14735041'] for segment, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:12.898742 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-03a5d74f-0107-4838-957d-cbc069fd9c81 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1469168'] for segment, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:12.904741 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-03a5d74f-0107-4838-957d-cbc069fd9c81 admin admin] Releasing vlan 1316 on physical network physnet1 to pool {{(pid=99026) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 25 18:03:12.905163 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-03a5d74f-0107-4838-957d-cbc069fd9c81 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1469168', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-15476589'] for segment, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:12.918883 dv-cinder-789564-2-iscsi neutron-server[99026]: Traceback (most recent call last):
May 25 18:03:12.918883 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 25 18:03:12.918883 dv-cinder-789564-2-iscsi neutron-server[99026]:     timer()
May 25 18:03:12.918883 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 25 18:03:12.918883 dv-cinder-789564-2-iscsi neutron-server[99026]:     cb(*args, **kw)
May 25 18:03:12.918883 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 25 18:03:12.918883 dv-cinder-789564-2-iscsi neutron-server[99026]:     return func(*args, **kwargs)
May 25 18:03:12.918883 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 25 18:03:12.918883 dv-cinder-789564-2-iscsi neutron-server[99026]:     self._notify()
May 25 18:03:12.918883 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 25 18:03:12.918883 dv-cinder-789564-2-iscsi neutron-server[99026]:     self.callback(batched_events)
May 25 18:03:12.918883 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 25 18:03:12.918883 dv-cinder-789564-2-iscsi neutron-server[99026]:     event.method(event)
May 25 18:03:12.918883 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 25 18:03:12.918883 dv-cinder-789564-2-iscsi neutron-server[99026]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 25 18:03:12.918883 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 25 18:03:12.918883 dv-cinder-789564-2-iscsi neutron-server[99026]:     aggregate_uuid = self.p_client.list_aggregates(
May 25 18:03:12.918883 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 25 18:03:12.918883 dv-cinder-789564-2-iscsi neutron-server[99026]:     return f(self, *a, **k)
May 25 18:03:12.918883 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 25 18:03:12.918883 dv-cinder-789564-2-iscsi neutron-server[99026]:     return self._get(url).json()
May 25 18:03:12.918883 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 25 18:03:12.918883 dv-cinder-789564-2-iscsi neutron-server[99026]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 25 18:03:12.918883 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 25 18:03:12.918883 dv-cinder-789564-2-iscsi neutron-server[99026]:     return self.request(url, 'GET', **kwargs)
May 25 18:03:12.918883 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 25 18:03:12.918883 dv-cinder-789564-2-iscsi neutron-server[99026]:     base_url = self.get_endpoint(auth, allow=allow,
May 25 18:03:12.918883 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 25 18:03:12.918883 dv-cinder-789564-2-iscsi neutron-server[99026]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 25 18:03:12.918883 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 25 18:03:12.918883 dv-cinder-789564-2-iscsi neutron-server[99026]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 25 18:03:12.918883 dv-cinder-789564-2-iscsi neutron-server[99026]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 25 18:03:13.085178 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-03a5d74f-0107-4838-957d-cbc069fd9c81 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1470785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-459299', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551400', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-419883'] for network, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:13.089841 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-03a5d74f-0107-4838-957d-cbc069fd9c81 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for network, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:13.093652 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-b472e52d-0fa7-4fb7-9368-3e2bd40ed7fa admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:03:13.114585 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03a5d74f-0107-4838-957d-cbc069fd9c81 admin admin] Pushing event deleted for resources: {'Network': ['ID=defaef08-c0f9-4608-b66d-b97e06e185bf,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:03:13.116988 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-03a5d74f-0107-4838-957d-cbc069fd9c81 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.023s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:03:13.205861 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-03a5d74f-0107-4838-957d-cbc069fd9c81 admin admin] 10.222.0.122 "DELETE /v2.0/networks/defaef08-c0f9-4608-b66d-b97e06e185bf HTTP/1.1" status: 204  len: 168 time: 1.1095743
May 25 18:03:13.710051 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 51154) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 18:03:13.771079 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-9905ad06-63d6-40fb-b275-e19f938b4d2b admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=b4cdc54b260f4e79b87fdf4a43b12e16&name=default HTTP/1.1" status: 200  len: 2975 time: 0.0596585
May 25 18:03:13.773448 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 51158) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 18:03:13.798346 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device c581af52-ceeb-4e7f-aa17-780c5a994e5e no longer exists at agent ovs-agent-dv-cinder-789564-2-iscsi {{(pid=99028) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 18:03:13.835170 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.plugin [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] No Port match for: c581af52-ceeb-4e7f-aa17-780c5a994e5e {{(pid=99028) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 25 18:03:13.835533 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device c581af52-ceeb-4e7f-aa17-780c5a994e5e not bound to the agent host dv-cinder-789564-2-iscsi {{(pid=99028) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 25 18:03:13.840646 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-09b77486-66bc-49d4-84ca-bfe7c4b52c82 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:13.869139 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-09b77486-66bc-49d4-84ca-bfe7c4b52c82 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:14.039182 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-09b77486-66bc-49d4-84ca-bfe7c4b52c82 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:14.042856 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-300f7e32-738b-47d2-8659-7369ee1e9260 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:03:14.057243 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09b77486-66bc-49d4-84ca-bfe7c4b52c82 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d5f76a5d-1e9e-4434-8249-d13ef3e3fa1b,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:03:14.059673 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-09b77486-66bc-49d4-84ca-bfe7c4b52c82 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:03:14.066207 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-09b77486-66bc-49d4-84ca-bfe7c4b52c82 admin admin] Notify callbacks [] for security_group, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:14.067357 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-09b77486-66bc-49d4-84ca-bfe7c4b52c82 admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/d5f76a5d-1e9e-4434-8249-d13ef3e3fa1b HTTP/1.1" status: 204  len: 168 time: 0.2929237
May 25 18:03:18.170962 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-9e7a6fe5-a269-487c-b1dd-e512945cb2ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:20.684440 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-0a0beb50-180d-47a8-8696-7eac3e7203ae None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:20.890178 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:21.826952 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-7e261f94-b84f-443e-be49-3bc1ac903b55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:23.393185 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-6df2b2a7-a54e-4d57-9be3-033078b9d5b3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:25.606664 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 51268) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 18:03:25.724656 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-61cb84f7-c306-4328-ba64-66501002d26c admin admin] Notify callbacks [] for security_group, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:25.740471 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-61cb84f7-c306-4328-ba64-66501002d26c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 18:03:25.744286 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-61cb84f7-c306-4328-ba64-66501002d26c admin admin] Usage tracker for resource:security_group_rule and tenant:360dbaf635e14448a104cb635bb7f0d3 is out of sync, need to count used quota {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 18:03:25.747125 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-61cb84f7-c306-4328-ba64-66501002d26c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 18:03:25.754122 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-61cb84f7-c306-4328-ba64-66501002d26c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 18:03:25.836103 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-61cb84f7-c306-4328-ba64-66501002d26c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:25.941169 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-61cb84f7-c306-4328-ba64-66501002d26c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:25.948551 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-edfe0232-c1e1-4259-a4aa-55f9a7422fdc admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:03:25.990238 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-61cb84f7-c306-4328-ba64-66501002d26c admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=360dbaf635e14448a104cb635bb7f0d3&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3825004
May 25 18:03:25.991152 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61cb84f7-c306-4328-ba64-66501002d26c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e39facf0-49e8-4430-b10d-749496666621,revision_number=1']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:03:25.993031 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 51274) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 18:03:25.994402 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-61cb84f7-c306-4328-ba64-66501002d26c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:03:26.052161 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-6fc316a2-607f-4c9d-b5e6-78ad13a5ddb0 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:26.077716 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-6fc316a2-607f-4c9d-b5e6-78ad13a5ddb0 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:26.233704 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-6fc316a2-607f-4c9d-b5e6-78ad13a5ddb0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:26.238794 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-0151b995-aa53-4ce8-99e1-c5a081477013 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:03:26.254562 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6fc316a2-607f-4c9d-b5e6-78ad13a5ddb0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e39facf0-49e8-4430-b10d-749496666621,revision_number=None']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:03:26.257101 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-6fc316a2-607f-4c9d-b5e6-78ad13a5ddb0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:03:26.259382 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-6fc316a2-607f-4c9d-b5e6-78ad13a5ddb0 admin admin] Notify callbacks [] for security_group, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:26.260377 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-6fc316a2-607f-4c9d-b5e6-78ad13a5ddb0 admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/e39facf0-49e8-4430-b10d-749496666621 HTTP/1.1" status: 204  len: 168 time: 0.2663519
May 25 18:03:29.060703 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 51316) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 18:03:29.286396 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-c7439d45-8517-4817-92d4-002bffb25360 admin admin] Notify callbacks [] for security_group, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:29.301417 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-c7439d45-8517-4817-92d4-002bffb25360 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 18:03:29.305237 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-c7439d45-8517-4817-92d4-002bffb25360 admin admin] Usage tracker for resource:security_group_rule and tenant:db0f041619e04dbfb5dab76bb00e7ce2 is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 18:03:29.308080 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-c7439d45-8517-4817-92d4-002bffb25360 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 18:03:29.314464 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-c7439d45-8517-4817-92d4-002bffb25360 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 18:03:29.394218 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-c7439d45-8517-4817-92d4-002bffb25360 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:29.500110 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-c7439d45-8517-4817-92d4-002bffb25360 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:29.507206 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-df8e975e-f8f2-458a-b1b7-a0abcef1c08e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:03:29.548813 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-c7439d45-8517-4817-92d4-002bffb25360 admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=db0f041619e04dbfb5dab76bb00e7ce2&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4860950
May 25 18:03:29.549874 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7439d45-8517-4817-92d4-002bffb25360 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=550b2f5a-2600-429c-9e8d-01c896a56bf4,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:03:29.551493 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 51322) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 18:03:29.554678 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-c7439d45-8517-4817-92d4-002bffb25360 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:03:29.615953 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-0f2f5cb6-ec0d-44fc-b0d4-65014430a5be admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:29.642032 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-0f2f5cb6-ec0d-44fc-b0d4-65014430a5be admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:29.827046 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-0f2f5cb6-ec0d-44fc-b0d4-65014430a5be admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:29.830950 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-e2914d5e-7c68-4ea3-9903-718d8b4a7af9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:03:29.844567 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f2f5cb6-ec0d-44fc-b0d4-65014430a5be admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=550b2f5a-2600-429c-9e8d-01c896a56bf4,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:03:29.848414 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-0f2f5cb6-ec0d-44fc-b0d4-65014430a5be admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:03:29.853947 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-0f2f5cb6-ec0d-44fc-b0d4-65014430a5be admin admin] Notify callbacks [] for security_group, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:29.855076 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-0f2f5cb6-ec0d-44fc-b0d4-65014430a5be admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/550b2f5a-2600-429c-9e8d-01c896a56bf4 HTTP/1.1" status: 204  len: 168 time: 0.3024821
May 25 18:03:30.633487 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 51330) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 18:03:30.642668 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-25d2d928-ffe4-41a6-8210-77521e6547b7 admin admin] Notify callbacks [] for security_group, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:30.656833 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-25d2d928-ffe4-41a6-8210-77521e6547b7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 18:03:30.660758 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-25d2d928-ffe4-41a6-8210-77521e6547b7 admin admin] Usage tracker for resource:security_group_rule and tenant:0079bd3b91774f7194f87c8a932fa48e is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 18:03:30.663612 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-25d2d928-ffe4-41a6-8210-77521e6547b7 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 18:03:30.669892 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-25d2d928-ffe4-41a6-8210-77521e6547b7 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 18:03:30.755545 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-25d2d928-ffe4-41a6-8210-77521e6547b7 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:30.901283 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-25d2d928-ffe4-41a6-8210-77521e6547b7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:30.909014 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-7835678d-b17c-49e0-84bd-e5dd0ad46970 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:03:30.950681 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-25d2d928-ffe4-41a6-8210-77521e6547b7 admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=0079bd3b91774f7194f87c8a932fa48e&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3258808
May 25 18:03:30.951895 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25d2d928-ffe4-41a6-8210-77521e6547b7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=39729414-ee8e-4db2-b3b8-7eb3f2c5a0ac,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:03:30.953374 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 51334) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 18:03:30.955056 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-25d2d928-ffe4-41a6-8210-77521e6547b7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:03:31.013823 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-da7d86f4-937a-4175-a188-3b280bbcc360 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:31.040058 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-da7d86f4-937a-4175-a188-3b280bbcc360 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:31.186904 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-da7d86f4-937a-4175-a188-3b280bbcc360 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:31.190833 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-21eef6b4-2021-4352-aacf-114f26e64a0c tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:03:31.204911 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da7d86f4-937a-4175-a188-3b280bbcc360 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=39729414-ee8e-4db2-b3b8-7eb3f2c5a0ac,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:03:31.207780 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-da7d86f4-937a-4175-a188-3b280bbcc360 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:03:31.211941 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-da7d86f4-937a-4175-a188-3b280bbcc360 admin admin] Notify callbacks [] for security_group, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:31.213208 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-da7d86f4-937a-4175-a188-3b280bbcc360 admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/39729414-ee8e-4db2-b3b8-7eb3f2c5a0ac HTTP/1.1" status: 204  len: 168 time: 0.2581716
May 25 18:03:35.758938 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.agents_db [None req-14fae233-15dc-4576-836b-621c5f95b584 None None] Agent healthcheck: found 6 active agents {{(pid=99029) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 18:03:38.990241 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 51428) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 18:03:39.017037 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a52035e-42c1-42c2-9787-958013f3b168 req-f8cc51c7-5cad-4ee9-a8d0-e4a2f95cd0c6 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:03:39.018596 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-9a52035e-42c1-42c2-9787-958013f3b168 req-f8cc51c7-5cad-4ee9-a8d0-e4a2f95cd0c6 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.122 "GET /v2.0/ports?device_id=6f66d198-4e81-4b59-a5ed-d28bf9c046e3 HTTP/1.1" status: 200  len: 946 time: 0.0848689
May 25 18:03:39.066226 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-9a52035e-42c1-42c2-9787-958013f3b168 req-bcc9d1c2-b9e5-4a0c-a644-20f244432f7d tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.122 "GET /v2.0/security-groups?id=f96a2660-11f5-4f6d-a34a-0a5f0713b90d&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0419886
May 25 18:03:39.115033 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-a762f6fd-5cc4-4bb1-8b5c-4a3de84b1f2a admin admin] Notify callbacks [] for security_group, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:39.129601 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-a762f6fd-5cc4-4bb1-8b5c-4a3de84b1f2a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 18:03:39.133355 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-a762f6fd-5cc4-4bb1-8b5c-4a3de84b1f2a admin admin] Usage tracker for resource:security_group_rule and tenant:847ed7e4d5c046f9b2af8d2564bfc84e is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 18:03:39.136125 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-a762f6fd-5cc4-4bb1-8b5c-4a3de84b1f2a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 18:03:39.142392 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-a762f6fd-5cc4-4bb1-8b5c-4a3de84b1f2a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 18:03:39.222582 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-a762f6fd-5cc4-4bb1-8b5c-4a3de84b1f2a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:39.322373 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ceca441c-865b-4aa2-8f01-9272dde55997 req-a34f7c84-7263-42dc-9e6a-d1063a93e1cf tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:03:39.323811 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-ceca441c-865b-4aa2-8f01-9272dde55997 req-a34f7c84-7263-42dc-9e6a-d1063a93e1cf tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.125 "GET /v2.0/ports?device_id=6f66d198-4e81-4b59-a5ed-d28bf9c046e3 HTTP/1.1" status: 200  len: 946 time: 0.0862112
May 25 18:03:39.362810 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-a762f6fd-5cc4-4bb1-8b5c-4a3de84b1f2a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:39.380124 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-36c66d51-e4cb-4a57-911d-0ef3b7654c27 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:03:39.430185 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a762f6fd-5cc4-4bb1-8b5c-4a3de84b1f2a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b62a361f-a89f-4fbc-b0db-87ca2082ee05,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:03:39.433415 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-a762f6fd-5cc4-4bb1-8b5c-4a3de84b1f2a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:03:39.467782 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-a762f6fd-5cc4-4bb1-8b5c-4a3de84b1f2a admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=847ed7e4d5c046f9b2af8d2564bfc84e&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4764655
May 25 18:03:39.470824 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 51434) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 18:03:39.510725 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.plugin [req-ceca441c-865b-4aa2-8f01-9272dde55997 req-a2460724-37d3-46fe-8953-26f8ad4b0cf9 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Deleting port 940c93c6-ab4c-47b9-9b48-31aabb845ba8 {{(pid=99027) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 18:03:39.510964 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-ceca441c-865b-4aa2-8f01-9272dde55997 req-a2460724-37d3-46fe-8953-26f8ad4b0cf9 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781841220419'] for port, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:39.530574 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-073e996f-e432-49bb-80a4-211d3c5aaeda admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:39.561211 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-073e996f-e432-49bb-80a4-211d3c5aaeda admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:39.656191 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.db [req-ceca441c-865b-4aa2-8f01-9272dde55997 req-a2460724-37d3-46fe-8953-26f8ad4b0cf9 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] For port 940c93c6-ab4c-47b9-9b48-31aabb845ba8, host hv-cinder-78956, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=940c93c6-ab4c-47b9-9b48-31aabb845ba8,segment=NetworkSegment(e9a4953c-bd2f-4412-9030-8eb2cd20f5c5),segment_id=e9a4953c-bd2f-4412-9030-8eb2cd20f5c5)] {{(pid=99027) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 18:03:39.656576 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-ceca441c-865b-4aa2-8f01-9272dde55997 req-a2460724-37d3-46fe-8953-26f8ad4b0cf9 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-418810'] for port, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:39.746395 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-073e996f-e432-49bb-80a4-211d3c5aaeda admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:39.752643 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-f936b5bb-9fe3-44d3-b21a-339891173761 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:03:39.765759 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-073e996f-e432-49bb-80a4-211d3c5aaeda admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b62a361f-a89f-4fbc-b0db-87ca2082ee05,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:03:39.768355 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-073e996f-e432-49bb-80a4-211d3c5aaeda admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:03:39.769554 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-073e996f-e432-49bb-80a4-211d3c5aaeda admin admin] Notify callbacks [] for security_group, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:39.773404 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-073e996f-e432-49bb-80a4-211d3c5aaeda admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/b62a361f-a89f-4fbc-b0db-87ca2082ee05 HTTP/1.1" status: 204  len: 168 time: 0.3015587
May 25 18:03:39.961105 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-ceca441c-865b-4aa2-8f01-9272dde55997 req-a2460724-37d3-46fe-8953-26f8ad4b0cf9 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify callbacks [] for floatingip, precommit_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:39.961488 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-ceca441c-865b-4aa2-8f01-9272dde55997 req-a2460724-37d3-46fe-8953-26f8ad4b0cf9 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-419865'] for floatingip, after_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:39.961790 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.db.l3_db [req-ceca441c-865b-4aa2-8f01-9272dde55997 req-a2460724-37d3-46fe-8953-26f8ad4b0cf9 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Floating IP 9b152d50-4873-4dbd-83c3-834c259bfe6f disassociated. External IP: 172.27.3.115, port: 940c93c6-ab4c-47b9-9b48-31aabb845ba8.
May 25 18:03:39.962123 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.plugin [req-ceca441c-865b-4aa2-8f01-9272dde55997 req-a2460724-37d3-46fe-8953-26f8ad4b0cf9 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Calling delete_port for 940c93c6-ab4c-47b9-9b48-31aabb845ba8 owned by compute:nova {{(pid=99027) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 18:03:40.169195 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-ceca441c-865b-4aa2-8f01-9272dde55997 req-a2460724-37d3-46fe-8953-26f8ad4b0cf9 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781841222566', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781840788188', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15468986'] for port, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:40.175654 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-5bf5ab37-2d67-453a-97b0-e08debb74997 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:03:40.257236 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2460724-37d3-46fe-8953-26f8ad4b0cf9 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Pushing event deleted for resources: {'Port': ['ID=940c93c6-ab4c-47b9-9b48-31aabb845ba8,revision_number=None']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:03:40.266092 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-a2460724-37d3-46fe-8953-26f8ad4b0cf9 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:03:40.268390 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-90e94ec9-e8d4-475d-ba10-20dda6ff012b req-6aa30fb0-9e57-4dde-93af-f6f4a2567ec2 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.122 "GET /v2.0/ports?device_id=6f66d198-4e81-4b59-a5ed-d28bf9c046e3 HTTP/1.1" status: 200  len: 210 time: 0.0618687
May 25 18:03:40.459483 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.l3_agent_scheduler [req-ceca441c-865b-4aa2-8f01-9272dde55997 req-a2460724-37d3-46fe-8953-26f8ad4b0cf9 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Router 3ca50ec5-218d-44ad-8ffc-4318f54d7350 has already been hosted by L3 agent eaeb6875-c4ed-43b6-8658-aa4e52324fdf {{(pid=99027) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 25 18:03:40.550529 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 51444) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 18:03:40.568987 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-34dfcb79-a3e0-4fda-b1d0-f053fce59ced admin admin] Notify callbacks [] for security_group, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:40.583595 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-34dfcb79-a3e0-4fda-b1d0-f053fce59ced admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 18:03:40.587440 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-34dfcb79-a3e0-4fda-b1d0-f053fce59ced admin admin] Usage tracker for resource:security_group_rule and tenant:6f009cfcdc86472fa533a63fa4ba7636 is out of sync, need to count used quota {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 18:03:40.590277 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-34dfcb79-a3e0-4fda-b1d0-f053fce59ced admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 18:03:40.595990 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-34dfcb79-a3e0-4fda-b1d0-f053fce59ced admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 18:03:40.685457 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-34dfcb79-a3e0-4fda-b1d0-f053fce59ced admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:40.746604 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-ceca441c-865b-4aa2-8f01-9272dde55997 req-a2460724-37d3-46fe-8953-26f8ad4b0cf9 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify agent at l3_agent.dv-cinder-789564-2-iscsi the message routers_updated {{(pid=99027) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 25 18:03:40.756772 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f44e0191-048d-45a5-af35-5da833bebceb None None] Sync routers for ids ['3ca50ec5-218d-44ad-8ffc-4318f54d7350'] in dv-cinder-789564-2-iscsi {{(pid=99029) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 25 18:03:40.766486 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f44e0191-048d-45a5-af35-5da833bebceb None None] Routers {'3ca50ec5-218d-44ad-8ffc-4318f54d7350'} bound to L3 agent in host dv-cinder-789564-2-iscsi {{(pid=99029) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 18:03:40.767088 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_hamode_db [None req-f44e0191-048d-45a5-af35-5da833bebceb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcae71cdc70>, 'dv-cinder-789564-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-05-25T17:34:21Z,description=<?>,heartbeat_timestamp=2021-05-25T18:03:21Z,host='dv-cinder-789564-2-iscsi',id=eaeb6875-c4ed-43b6-8658-aa4e52324fdf,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T17:34:21Z,topic='l3_agent')) {'router_ids': ['3ca50ec5-218d-44ad-8ffc-4318f54d7350'], 'active': True} {{(pid=99029) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 18:03:40.832689 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.l3_dvrscheduler_db [req-ceca441c-865b-4aa2-8f01-9272dde55997 req-a2460724-37d3-46fe-8953-26f8ad4b0cf9 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] No DVR routers for this DVR port 940c93c6-ab4c-47b9-9b48-31aabb845ba8 on host hv-cinder-78956 {{(pid=99027) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 25 18:03:40.832689 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-ceca441c-865b-4aa2-8f01-9272dde55997 req-a2460724-37d3-46fe-8953-26f8ad4b0cf9 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-239387'] for port, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:40.832689 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6f66d198-4e81-4b59-a5ed-d28bf9c046e3', 'name': 'network-vif-deleted', 'tag': '940c93c6-ab4c-47b9-9b48-31aabb845ba8'}] {{(pid=99027) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 18:03:40.860594 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-34dfcb79-a3e0-4fda-b1d0-f053fce59ced admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:40.869299 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-29ed41b9-b67f-46fe-9982-5d305306799f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:03:40.872945 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6f66d198-4e81-4b59-a5ed-d28bf9c046e3', 'name': 'network-vif-deleted', 'tag': '940c93c6-ab4c-47b9-9b48-31aabb845ba8', 'status': 'completed', 'code': 200}
May 25 18:03:40.913308 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-34dfcb79-a3e0-4fda-b1d0-f053fce59ced admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=6f009cfcdc86472fa533a63fa4ba7636&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3615737
May 25 18:03:40.914352 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34dfcb79-a3e0-4fda-b1d0-f053fce59ced admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6d1ccc9f-451b-472e-afa3-811220325cef,revision_number=1']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:03:40.919336 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 51450) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 18:03:40.919503 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-34dfcb79-a3e0-4fda-b1d0-f053fce59ced admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:03:40.980024 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_dvr_db [None req-f44e0191-048d-45a5-af35-5da833bebceb None None] Set router 3ca50ec5-218d-44ad-8ffc-4318f54d7350 gateway port host: dv-cinder-789564-2-iscsi {{(pid=99029) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 18:03:40.980347 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-dc140de0-645c-405a-a61b-cbd2b332c5b7 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:41.007146 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-ceca441c-865b-4aa2-8f01-9272dde55997 req-a2460724-37d3-46fe-8953-26f8ad4b0cf9 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.125 "DELETE /v2.0/ports/940c93c6-ab4c-47b9-9b48-31aabb845ba8 HTTP/1.1" status: 204  len: 173 time: 1.6765139
May 25 18:03:41.010323 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-dc140de0-645c-405a-a61b-cbd2b332c5b7 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:41.210051 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-dc140de0-645c-405a-a61b-cbd2b332c5b7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:41.216236 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-51411427-e32c-4fa0-aa42-2757a72972e3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:03:41.234090 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc140de0-645c-405a-a61b-cbd2b332c5b7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6d1ccc9f-451b-472e-afa3-811220325cef,revision_number=None']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:03:41.234090 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-dc140de0-645c-405a-a61b-cbd2b332c5b7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:03:41.241549 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-dc140de0-645c-405a-a61b-cbd2b332c5b7 admin admin] Notify callbacks [] for security_group, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:41.242674 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-dc140de0-645c-405a-a61b-cbd2b332c5b7 admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/6d1ccc9f-451b-472e-afa3-811220325cef HTTP/1.1" status: 204  len: 168 time: 0.3256621
May 25 18:03:41.320124 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_hamode_db [None req-f44e0191-048d-45a5-af35-5da833bebceb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcae71cdc70>, [{'id': '3ca50ec5-218d-44ad-8ffc-4318f54d7350', 'name': 'tempest-AttachVolumeShelveTestJSON-2113890446-router', 'tenant_id': 'cf02997eda314aee8fb322add2fbb921', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.226'}], 'enable_snat': True}, 'gw_port_id': '1e97124a-073a-4947-a6f2-359fb12ffe5e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:43:31Z', 'updated_at': '2021-05-25T17:43:37Z', 'revision_number': 4, 'project_id': 'cf02997eda314aee8fb322add2fbb921', 'gw_port': {'id': '1e97124a-073a-4947-a6f2-359fb12ffe5e', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:c8:ed:c5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3ca50ec5-218d-44ad-8ffc-4318f54d7350', 'device_owner': 'network:router_gateway', 'standard_attr_id': 244, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.226', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:43:33Z', 'updated_at': '2021-05-25T17:43:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi', '_interfaces': [{'id': 'ada7bf8b-4ba6-4629-8693-a2574922e458', 'name': '', 'network_id': '45b850af-d423-458a-855a-d7f828a11fff', 'tenant_id': 'cf02997eda314aee8fb322add2fbb921', 'mac_address': 'fa:16:3e:59:34:b7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3ca50ec5-218d-44ad-8ffc-4318f54d7350', 'device_owner': 'network:router_interface', 'standard_attr_id': 255, 'fixed_ips': [{'subnet_id': '704d0a85-ee4f-4df2-90a3-a525dfe28461', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:43:37Z', 'updated_at': '2021-05-25T17:43:45Z', 'revision_number': 5, 'project_id': 'cf02997eda314aee8fb322add2fbb921', 'subnets': [{'id': '704d0a85-ee4f-4df2-90a3-a525dfe28461', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-789564-2-iscsi', False) {} {{(pid=99029) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 18:03:41.320124 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f44e0191-048d-45a5-af35-5da833bebceb None None] Checking router: 3ca50ec5-218d-44ad-8ffc-4318f54d7350 for host: dv-cinder-789564-2-iscsi {{(pid=99029) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 25 18:03:41.328686 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f44e0191-048d-45a5-af35-5da833bebceb None None] Routers {'3ca50ec5-218d-44ad-8ffc-4318f54d7350'} bound to L3 agent in host dv-cinder-789564-2-iscsi {{(pid=99029) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 18:03:41.329521 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_hamode_db [None req-f44e0191-048d-45a5-af35-5da833bebceb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcae71cdc70>, 'dv-cinder-789564-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-05-25T17:34:21Z,description=<?>,heartbeat_timestamp=2021-05-25T18:03:21Z,host='dv-cinder-789564-2-iscsi',id=eaeb6875-c4ed-43b6-8658-aa4e52324fdf,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T17:34:21Z,topic='l3_agent')) {'router_ids': ['3ca50ec5-218d-44ad-8ffc-4318f54d7350'], 'active': True} {{(pid=99029) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 18:03:41.448054 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-6b62f146-7258-4eaf-bcf5-2ffddd246293 req-327f573f-326e-4813-938c-d75fc066d349 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Synchronizing usage tracker for tenant:cf02997eda314aee8fb322add2fbb921 on resource:port {{(pid=99027) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 18:03:41.510795 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_dvr_db [None req-f44e0191-048d-45a5-af35-5da833bebceb None None] Set router 3ca50ec5-218d-44ad-8ffc-4318f54d7350 gateway port host: dv-cinder-789564-2-iscsi {{(pid=99029) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 18:03:41.563284 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-6b62f146-7258-4eaf-bcf5-2ffddd246293 req-327f573f-326e-4813-938c-d75fc066d349 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Unset dirty status for tenant:cf02997eda314aee8fb322add2fbb921 on resource:port {{(pid=99027) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 18:03:41.564479 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-6b62f146-7258-4eaf-bcf5-2ffddd246293 req-327f573f-326e-4813-938c-d75fc066d349 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.122 "GET /v2.0/ports?device_id=6f66d198-4e81-4b59-a5ed-d28bf9c046e3 HTTP/1.1" status: 200  len: 210 time: 0.1591949
May 25 18:03:41.757643 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:41.836018 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_hamode_db [None req-f44e0191-048d-45a5-af35-5da833bebceb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcae71cdc70>, [{'id': '3ca50ec5-218d-44ad-8ffc-4318f54d7350', 'name': 'tempest-AttachVolumeShelveTestJSON-2113890446-router', 'tenant_id': 'cf02997eda314aee8fb322add2fbb921', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.226'}], 'enable_snat': True}, 'gw_port_id': '1e97124a-073a-4947-a6f2-359fb12ffe5e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:43:31Z', 'updated_at': '2021-05-25T17:43:37Z', 'revision_number': 4, 'project_id': 'cf02997eda314aee8fb322add2fbb921', 'gw_port': {'id': '1e97124a-073a-4947-a6f2-359fb12ffe5e', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:c8:ed:c5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3ca50ec5-218d-44ad-8ffc-4318f54d7350', 'device_owner': 'network:router_gateway', 'standard_attr_id': 244, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.226', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:43:33Z', 'updated_at': '2021-05-25T17:43:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi', '_interfaces': [{'id': 'ada7bf8b-4ba6-4629-8693-a2574922e458', 'name': '', 'network_id': '45b850af-d423-458a-855a-d7f828a11fff', 'tenant_id': 'cf02997eda314aee8fb322add2fbb921', 'mac_address': 'fa:16:3e:59:34:b7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3ca50ec5-218d-44ad-8ffc-4318f54d7350', 'device_owner': 'network:router_interface', 'standard_attr_id': 255, 'fixed_ips': [{'subnet_id': '704d0a85-ee4f-4df2-90a3-a525dfe28461', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:43:37Z', 'updated_at': '2021-05-25T17:43:45Z', 'revision_number': 5, 'project_id': 'cf02997eda314aee8fb322add2fbb921', 'subnets': [{'id': '704d0a85-ee4f-4df2-90a3-a525dfe28461', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-789564-2-iscsi', False) {} {{(pid=99029) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 18:03:41.840002 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f44e0191-048d-45a5-af35-5da833bebceb None None] The sync data for ids ['3ca50ec5-218d-44ad-8ffc-4318f54d7350'] in dv-cinder-789564-2-iscsi is: [{'id': '3ca50ec5-218d-44ad-8ffc-4318f54d7350', 'name': 'tempest-AttachVolumeShelveTestJSON-2113890446-router', 'tenant_id': 'cf02997eda314aee8fb322add2fbb921', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.226'}], 'enable_snat': True}, 'gw_port_id': '1e97124a-073a-4947-a6f2-359fb12ffe5e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:43:31Z', 'updated_at': '2021-05-25T17:43:37Z', 'revision_number': 4, 'project_id': 'cf02997eda314aee8fb322add2fbb921', 'gw_port': {'id': '1e97124a-073a-4947-a6f2-359fb12ffe5e', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:c8:ed:c5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3ca50ec5-218d-44ad-8ffc-4318f54d7350', 'device_owner': 'network:router_gateway', 'standard_attr_id': 244, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.226', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:43:33Z', 'updated_at': '2021-05-25T17:43:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi', '_interfaces': [{'id': 'ada7bf8b-4ba6-4629-8693-a2574922e458', 'name': '', 'network_id': '45b850af-d423-458a-855a-d7f828a11fff', 'tenant_id': 'cf02997eda314aee8fb322add2fbb921', 'mac_address': 'fa:16:3e:59:34:b7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3ca50ec5-218d-44ad-8ffc-4318f54d7350', 'device_owner': 'network:router_interface', 'standard_attr_id': 255, 'fixed_ips': [{'subnet_id': '704d0a85-ee4f-4df2-90a3-a525dfe28461', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:43:37Z', 'updated_at': '2021-05-25T17:43:45Z', 'revision_number': 5, 'project_id': 'cf02997eda314aee8fb322add2fbb921', 'subnets': [{'id': '704d0a85-ee4f-4df2-90a3-a525dfe28461', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=99029) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 25 18:03:42.058618 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-841923ed-30ea-4e0b-abef-d4f7aed0bf43 None None] New status for floating IP 9b152d50-4873-4dbd-83c3-834c259bfe6f: DOWN {{(pid=99028) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 25 18:03:42.191266 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Device 940c93c6-ab4c-47b9-9b48-31aabb845ba8 no longer exists at agent hyperv_hv-cinder-78956 {{(pid=99028) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 18:03:42.239196 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.plugin [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] No Port match for: 940c93c6-ab4c-47b9-9b48-31aabb845ba8 {{(pid=99028) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 25 18:03:42.239556 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Device 940c93c6-ab4c-47b9-9b48-31aabb845ba8 not bound to the agent host hv-cinder-78956 {{(pid=99028) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 25 18:03:42.844415 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 51482) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 18:03:42.914005 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-088a7311-910d-4ade-9cb2-84131072cf3a tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify callbacks [] for security_group, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:42.943939 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-088a7311-910d-4ade-9cb2-84131072cf3a tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify callbacks [] for security_group, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:43.094445 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-088a7311-910d-4ade-9cb2-84131072cf3a tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:43.098321 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-25d2d928-ffe4-41a6-8210-77521e6547b7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:03:43.114461 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-088a7311-910d-4ade-9cb2-84131072cf3a tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=f96a2660-11f5-4f6d-a34a-0a5f0713b90d,revision_number=None']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:03:43.117049 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-088a7311-910d-4ade-9cb2-84131072cf3a tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:03:43.225320 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-088a7311-910d-4ade-9cb2-84131072cf3a tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify callbacks [] for security_group, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:43.226487 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-088a7311-910d-4ade-9cb2-84131072cf3a tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.122 "DELETE /v2.0/security-groups/f96a2660-11f5-4f6d-a34a-0a5f0713b90d HTTP/1.1" status: 204  len: 168 time: 0.3810718
May 25 18:03:43.229263 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 51492) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 18:03:43.246499 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.api.v2.resource [None req-efde2a70-89d2-4cc8-9cab-b4b38253e292 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] show failed (client error): The resource could not be found.
May 25 18:03:43.247579 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-efde2a70-89d2-4cc8-9cab-b4b38253e292 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.122 "GET /v2.0/security-groups/f96a2660-11f5-4f6d-a34a-0a5f0713b90d HTTP/1.1" status: 404  len: 347 time: 0.0173199
May 25 18:03:43.250351 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 51496) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 18:03:43.478885 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.plugin [None req-9e0dba06-859f-4796-801f-0a5f16285ce4 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Deleting port 788a6bdb-6047-40ec-b75e-842aa5ac303f {{(pid=99027) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 18:03:43.479230 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-9e0dba06-859f-4796-801f-0a5f16285ce4 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781841220419'] for port, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:43.601684 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-9e0dba06-859f-4796-801f-0a5f16285ce4 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-418810'] for port, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:43.602096 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-9e0dba06-859f-4796-801f-0a5f16285ce4 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:43.731452 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.plugin [None req-9e0dba06-859f-4796-801f-0a5f16285ce4 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Calling delete_port for 788a6bdb-6047-40ec-b75e-842aa5ac303f owned by network:floatingip {{(pid=99027) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 18:03:43.969686 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-9e0dba06-859f-4796-801f-0a5f16285ce4 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781841222566', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781840788188', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15468986'] for port, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:43.973332 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-c1ce38cc-5eb8-4dad-b914-04776214de98 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:03:44.021438 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e0dba06-859f-4796-801f-0a5f16285ce4 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Pushing event deleted for resources: {'Port': ['ID=788a6bdb-6047-40ec-b75e-842aa5ac303f,revision_number=None']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:03:44.024393 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-9e0dba06-859f-4796-801f-0a5f16285ce4 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:03:44.130067 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-9e0dba06-859f-4796-801f-0a5f16285ce4 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify callbacks [] for floatingip, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:44.305627 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-9e0dba06-859f-4796-801f-0a5f16285ce4 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-239387'] for floatingip, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:44.306770 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-9e0dba06-859f-4796-801f-0a5f16285ce4 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] 10.222.0.122 "DELETE /v2.0/floatingips/9b152d50-4873-4dbd-83c3-834c259bfe6f HTTP/1.1" status: 204  len: 168 time: 1.0555031
May 25 18:03:47.741769 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 51550) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 18:03:48.203109 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-170a68c1-9430-4e6e-b89f-56040b9cd9d4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:48.550798 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-a1d34dad-eb39-451e-acf3-e9ebc6b9bbe6 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-420907'] for router_interface, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:48.969220 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.plugin [None req-a1d34dad-eb39-451e-acf3-e9ebc6b9bbe6 admin admin] Deleting port ada7bf8b-4ba6-4629-8693-a2574922e458 {{(pid=99026) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 18:03:48.970622 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-a1d34dad-eb39-451e-acf3-e9ebc6b9bbe6 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781841220419'] for port, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:49.092709 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.db [None req-a1d34dad-eb39-451e-acf3-e9ebc6b9bbe6 admin admin] For port ada7bf8b-4ba6-4629-8693-a2574922e458, host dv-cinder-789564-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=ada7bf8b-4ba6-4629-8693-a2574922e458,segment=NetworkSegment(e9a4953c-bd2f-4412-9030-8eb2cd20f5c5),segment_id=e9a4953c-bd2f-4412-9030-8eb2cd20f5c5)] {{(pid=99026) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 18:03:49.092968 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-a1d34dad-eb39-451e-acf3-e9ebc6b9bbe6 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-418810'] for port, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:49.216232 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.plugin [None req-a1d34dad-eb39-451e-acf3-e9ebc6b9bbe6 admin admin] Calling delete_port for ada7bf8b-4ba6-4629-8693-a2574922e458 owned by network:router_interface {{(pid=99026) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 18:03:49.533778 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-a1d34dad-eb39-451e-acf3-e9ebc6b9bbe6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781841222566', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781840788188', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15476536'] for port, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:49.537725 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-188dee88-fd48-4a36-95fa-8b8ad5243051 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:03:49.583147 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1d34dad-eb39-451e-acf3-e9ebc6b9bbe6 admin admin] Pushing event deleted for resources: {'Port': ['ID=ada7bf8b-4ba6-4629-8693-a2574922e458,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:03:49.618466 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-a1d34dad-eb39-451e-acf3-e9ebc6b9bbe6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:03:49.978481 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-a1d34dad-eb39-451e-acf3-e9ebc6b9bbe6 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-551393', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-420795'] for router_interface, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:50.369477 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a1d34dad-eb39-451e-acf3-e9ebc6b9bbe6 admin admin] Router 3ca50ec5-218d-44ad-8ffc-4318f54d7350 has already been hosted by L3 agent eaeb6875-c4ed-43b6-8658-aa4e52324fdf {{(pid=99026) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 25 18:03:50.555094 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a1d34dad-eb39-451e-acf3-e9ebc6b9bbe6 admin admin] Notify agent at l3_agent.dv-cinder-789564-2-iscsi the message routers_updated {{(pid=99026) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 25 18:03:50.563632 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ac5c4f73-bb47-4ccd-819d-8bae176cff90 None None] Sync routers for ids ['3ca50ec5-218d-44ad-8ffc-4318f54d7350'] in dv-cinder-789564-2-iscsi {{(pid=99029) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 25 18:03:50.573575 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ac5c4f73-bb47-4ccd-819d-8bae176cff90 None None] Routers {'3ca50ec5-218d-44ad-8ffc-4318f54d7350'} bound to L3 agent in host dv-cinder-789564-2-iscsi {{(pid=99029) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 18:03:50.574238 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_hamode_db [None req-ac5c4f73-bb47-4ccd-819d-8bae176cff90 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcae6dc3d30>, 'dv-cinder-789564-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-05-25T17:34:21Z,description=<?>,heartbeat_timestamp=2021-05-25T18:03:21Z,host='dv-cinder-789564-2-iscsi',id=eaeb6875-c4ed-43b6-8658-aa4e52324fdf,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T17:34:21Z,topic='l3_agent')) {'router_ids': ['3ca50ec5-218d-44ad-8ffc-4318f54d7350'], 'active': True} {{(pid=99029) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 18:03:50.580318 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-a1d34dad-eb39-451e-acf3-e9ebc6b9bbe6 admin admin] 10.222.0.122 "PUT /v2.0/routers/3ca50ec5-218d-44ad-8ffc-4318f54d7350/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.8352365
May 25 18:03:50.580618 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 51578) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 18:03:50.705186 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-f5ee6fe5-fbb3-4106-9699-bc0a64921900 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:50.764929 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_dvr_db [None req-ac5c4f73-bb47-4ccd-819d-8bae176cff90 None None] Set router 3ca50ec5-218d-44ad-8ffc-4318f54d7350 gateway port host: dv-cinder-789564-2-iscsi {{(pid=99029) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 18:03:50.767201 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-40c4cba4-0c7d-457f-916e-ab00a41b0d5a admin admin] Notify callbacks [] for router, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:50.894374 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:50.947733 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-40c4cba4-0c7d-457f-916e-ab00a41b0d5a admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:51.066725 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 51584) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 18:03:51.082468 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_hamode_db [None req-ac5c4f73-bb47-4ccd-819d-8bae176cff90 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcae6dc3d30>, [{'id': '3ca50ec5-218d-44ad-8ffc-4318f54d7350', 'name': 'tempest-AttachVolumeShelveTestJSON-2113890446-router', 'tenant_id': 'cf02997eda314aee8fb322add2fbb921', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.226'}], 'enable_snat': True}, 'gw_port_id': '1e97124a-073a-4947-a6f2-359fb12ffe5e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:43:31Z', 'updated_at': '2021-05-25T18:03:49Z', 'revision_number': 5, 'project_id': 'cf02997eda314aee8fb322add2fbb921', 'gw_port': {'id': '1e97124a-073a-4947-a6f2-359fb12ffe5e', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:c8:ed:c5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3ca50ec5-218d-44ad-8ffc-4318f54d7350', 'device_owner': 'network:router_gateway', 'standard_attr_id': 244, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.226', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:43:33Z', 'updated_at': '2021-05-25T17:43:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi'}], 'dv-cinder-789564-2-iscsi', False) {} {{(pid=99029) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 18:03:51.086050 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ac5c4f73-bb47-4ccd-819d-8bae176cff90 None None] Checking router: 3ca50ec5-218d-44ad-8ffc-4318f54d7350 for host: dv-cinder-789564-2-iscsi {{(pid=99029) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 25 18:03:51.094779 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ac5c4f73-bb47-4ccd-819d-8bae176cff90 None None] Routers {'3ca50ec5-218d-44ad-8ffc-4318f54d7350'} bound to L3 agent in host dv-cinder-789564-2-iscsi {{(pid=99029) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 18:03:51.095411 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_hamode_db [None req-ac5c4f73-bb47-4ccd-819d-8bae176cff90 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcae6dc3d30>, 'dv-cinder-789564-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-05-25T17:34:21Z,description=<?>,heartbeat_timestamp=2021-05-25T18:03:51Z,host='dv-cinder-789564-2-iscsi',id=eaeb6875-c4ed-43b6-8658-aa4e52324fdf,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T17:34:21Z,topic='l3_agent')) {'router_ids': ['3ca50ec5-218d-44ad-8ffc-4318f54d7350'], 'active': True} {{(pid=99029) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 18:03:51.116937 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.plugin [None req-40c4cba4-0c7d-457f-916e-ab00a41b0d5a admin admin] Deleting port 1e97124a-073a-4947-a6f2-359fb12ffe5e {{(pid=99026) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 18:03:51.117939 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-40c4cba4-0c7d-457f-916e-ab00a41b0d5a admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781841220419'] for port, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:51.198329 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-22f1bb3c-c820-4a06-b95e-db48ddedf93f admin admin] Notify callbacks [] for security_group, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:51.214942 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-22f1bb3c-c820-4a06-b95e-db48ddedf93f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 18:03:51.219909 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-22f1bb3c-c820-4a06-b95e-db48ddedf93f admin admin] Usage tracker for resource:security_group_rule and tenant:4f3f79d2fb03411a877bbc1f83437c2e is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 18:03:51.223571 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-22f1bb3c-c820-4a06-b95e-db48ddedf93f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 18:03:51.230991 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-22f1bb3c-c820-4a06-b95e-db48ddedf93f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 18:03:51.255737 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_dvr_db [None req-ac5c4f73-bb47-4ccd-819d-8bae176cff90 None None] Set router 3ca50ec5-218d-44ad-8ffc-4318f54d7350 gateway port host: None {{(pid=99029) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 18:03:51.335835 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-22f1bb3c-c820-4a06-b95e-db48ddedf93f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:51.364777 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_hamode_db [None req-ac5c4f73-bb47-4ccd-819d-8bae176cff90 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcae6dc3d30>, [{'id': '3ca50ec5-218d-44ad-8ffc-4318f54d7350', 'name': 'tempest-AttachVolumeShelveTestJSON-2113890446-router', 'tenant_id': 'cf02997eda314aee8fb322add2fbb921', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:43:31Z', 'updated_at': '2021-05-25T18:03:50Z', 'revision_number': 6, 'project_id': 'cf02997eda314aee8fb322add2fbb921', 'gw_port_host': None}], 'dv-cinder-789564-2-iscsi', False) {} {{(pid=99029) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 18:03:51.366624 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.db [None req-40c4cba4-0c7d-457f-916e-ab00a41b0d5a admin admin] For port 1e97124a-073a-4947-a6f2-359fb12ffe5e, host dv-cinder-789564-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=1e97124a-073a-4947-a6f2-359fb12ffe5e,segment=NetworkSegment(471771f9-c462-4865-800d-0d5029e9eb3e),segment_id=471771f9-c462-4865-800d-0d5029e9eb3e)] {{(pid=99026) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 18:03:51.366976 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-40c4cba4-0c7d-457f-916e-ab00a41b0d5a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-418810'] for port, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:51.369093 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ac5c4f73-bb47-4ccd-819d-8bae176cff90 None None] The sync data for ids ['3ca50ec5-218d-44ad-8ffc-4318f54d7350'] in dv-cinder-789564-2-iscsi is: [{'id': '3ca50ec5-218d-44ad-8ffc-4318f54d7350', 'name': 'tempest-AttachVolumeShelveTestJSON-2113890446-router', 'tenant_id': 'cf02997eda314aee8fb322add2fbb921', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:43:31Z', 'updated_at': '2021-05-25T18:03:50Z', 'revision_number': 6, 'project_id': 'cf02997eda314aee8fb322add2fbb921', 'gw_port_host': None}] {{(pid=99029) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 25 18:03:51.425817 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-22f1bb3c-c820-4a06-b95e-db48ddedf93f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:51.434976 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-dc140de0-645c-405a-a61b-cbd2b332c5b7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:03:51.475750 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-22f1bb3c-c820-4a06-b95e-db48ddedf93f admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=4f3f79d2fb03411a877bbc1f83437c2e&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4076059
May 25 18:03:51.477387 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22f1bb3c-c820-4a06-b95e-db48ddedf93f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=59be94f6-5c10-4469-a17f-a8b870319b0f,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:03:51.479879 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 51590) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 18:03:51.483014 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-22f1bb3c-c820-4a06-b95e-db48ddedf93f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:03:51.494220 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.plugin [None req-40c4cba4-0c7d-457f-916e-ab00a41b0d5a admin admin] Calling delete_port for 1e97124a-073a-4947-a6f2-359fb12ffe5e owned by network:router_gateway {{(pid=99026) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 18:03:51.539506 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-80f12776-b8ee-46c2-b0b7-380ff58e6632 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:51.566471 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-80f12776-b8ee-46c2-b0b7-380ff58e6632 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:51.780796 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device ada7bf8b-4ba6-4629-8693-a2574922e458 no longer exists at agent ovs-agent-dv-cinder-789564-2-iscsi {{(pid=99028) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 18:03:51.802514 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-40c4cba4-0c7d-457f-916e-ab00a41b0d5a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781841222566', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781840788188', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15476536'] for port, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:51.806352 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:03:51.816758 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.plugin [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] No Port match for: ada7bf8b-4ba6-4629-8693-a2574922e458 {{(pid=99028) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 25 18:03:51.818869 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device ada7bf8b-4ba6-4629-8693-a2574922e458 not bound to the agent host dv-cinder-789564-2-iscsi {{(pid=99028) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 25 18:03:51.852805 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40c4cba4-0c7d-457f-916e-ab00a41b0d5a admin admin] Pushing event deleted for resources: {'Port': ['ID=1e97124a-073a-4947-a6f2-359fb12ffe5e,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:03:51.853854 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-7e261f94-b84f-443e-be49-3bc1ac903b55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:51.854022 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-80f12776-b8ee-46c2-b0b7-380ff58e6632 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:51.855417 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-40c4cba4-0c7d-457f-916e-ab00a41b0d5a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:03:51.858328 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-381e122d-dc7d-4e08-9b8c-64ce16f857f8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:03:51.870246 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80f12776-b8ee-46c2-b0b7-380ff58e6632 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=59be94f6-5c10-4469-a17f-a8b870319b0f,revision_number=None']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:03:51.876137 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-80f12776-b8ee-46c2-b0b7-380ff58e6632 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:03:51.877792 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-80f12776-b8ee-46c2-b0b7-380ff58e6632 admin admin] Notify callbacks [] for security_group, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:51.880093 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-80f12776-b8ee-46c2-b0b7-380ff58e6632 admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/59be94f6-5c10-4469-a17f-a8b870319b0f HTTP/1.1" status: 204  len: 168 time: 0.3983502
May 25 18:03:51.950874 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-40c4cba4-0c7d-457f-916e-ab00a41b0d5a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-419894'] for router_gateway, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:52.130876 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-40c4cba4-0c7d-457f-916e-ab00a41b0d5a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-415163', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-6965'] for router, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:52.133241 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-40c4cba4-0c7d-457f-916e-ab00a41b0d5a admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:52.259940 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-40c4cba4-0c7d-457f-916e-ab00a41b0d5a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-414855'] for router, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:52.260624 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-40c4cba4-0c7d-457f-916e-ab00a41b0d5a admin admin] Fanout notify agent at l3_agent the message router_deleted on router 3ca50ec5-218d-44ad-8ffc-4318f54d7350 {{(pid=99026) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
May 25 18:03:52.278928 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-40c4cba4-0c7d-457f-916e-ab00a41b0d5a admin admin] Notify callbacks [] for router, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:52.278928 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-40c4cba4-0c7d-457f-916e-ab00a41b0d5a admin admin] 10.222.0.122 "DELETE /v2.0/routers/3ca50ec5-218d-44ad-8ffc-4318f54d7350 HTTP/1.1" status: 204  len: 168 time: 1.6935995
May 25 18:03:52.278928 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 51598) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 18:03:52.350805 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.db_base_plugin_v2 [None req-6d7b686e-5b75-43f9-b5e1-29d6ae30ac27 admin admin] Deleting subnet 704d0a85-ee4f-4df2-90a3-a525dfe28461 {{(pid=99026) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 25 18:03:52.354139 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-6d7b686e-5b75-43f9-b5e1-29d6ae30ac27 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:52.405924 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-6d7b686e-5b75-43f9-b5e1-29d6ae30ac27 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-14735050'] for subnet, precommit_delete_associations {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:52.485309 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-6d7b686e-5b75-43f9-b5e1-29d6ae30ac27 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1474503'] for subnet, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:52.897300 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 51602) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 18:03:52.910717 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-6d7b686e-5b75-43f9-b5e1-29d6ae30ac27 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1473138', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114466', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-15477963', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-14794250'] for subnet, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:52.915794 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-50524372-3b0b-4c96-ada3-73f96edaa1e7 admin admin] Notify callbacks [] for security_group, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:52.916032 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:03:52.930579 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-50524372-3b0b-4c96-ada3-73f96edaa1e7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 18:03:52.934492 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-50524372-3b0b-4c96-ada3-73f96edaa1e7 admin admin] Usage tracker for resource:security_group_rule and tenant:ee93a28307fd418ba02ca9fc44923eca is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 18:03:52.937390 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-50524372-3b0b-4c96-ada3-73f96edaa1e7 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 18:03:52.943117 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-50524372-3b0b-4c96-ada3-73f96edaa1e7 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 18:03:52.951842 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d7b686e-5b75-43f9-b5e1-29d6ae30ac27 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=704d0a85-ee4f-4df2-90a3-a525dfe28461,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:03:52.954389 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-6d7b686e-5b75-43f9-b5e1-29d6ae30ac27 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:03:52.957587 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-6d7b686e-5b75-43f9-b5e1-29d6ae30ac27 admin admin] Notify callbacks [] for subnet, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:52.963830 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fac40424-7847-43bb-953e-464163cdb2fc None None] Network 45b850af-d423-458a-855a-d7f828a11fff requested from dv-cinder-789564-2-iscsi {{(pid=99028) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 18:03:52.966809 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-6d7b686e-5b75-43f9-b5e1-29d6ae30ac27 admin admin] 10.222.0.122 "DELETE /v2.0/subnets/704d0a85-ee4f-4df2-90a3-a525dfe28461 HTTP/1.1" status: 204  len: 168 time: 0.6847806
May 25 18:03:52.968051 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 51606) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 18:03:53.036826 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-50524372-3b0b-4c96-ada3-73f96edaa1e7 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:53.079761 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-2ec6c74c-8617-4aa2-b516-63e696764a7d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1492659'] for network, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:53.117594 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-50524372-3b0b-4c96-ada3-73f96edaa1e7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:53.127309 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-453db126-49ad-42a8-a7e0-cd70ff2f10c1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:03:53.164269 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.plugin [None req-2ec6c74c-8617-4aa2-b516-63e696764a7d admin admin] Deleting port 20819f61-2e9b-4003-9d9f-151a9e6d2fd4 {{(pid=99026) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 18:03:53.164848 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-2ec6c74c-8617-4aa2-b516-63e696764a7d admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781841220419'] for port, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:53.171603 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-50524372-3b0b-4c96-ada3-73f96edaa1e7 admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=ee93a28307fd418ba02ca9fc44923eca&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2729514
May 25 18:03:53.173209 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50524372-3b0b-4c96-ada3-73f96edaa1e7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=23060a6a-05db-458d-8bd2-1680a4db331d,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:03:53.175933 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 51610) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 18:03:53.178358 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-50524372-3b0b-4c96-ada3-73f96edaa1e7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:03:53.243625 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b33f7a69-33fc-4edc-9304-c207f074d731 None None] DHCP port deletion for 45b850af-d423-458a-855a-d7f828a11fff request from dv-cinder-789564-2-iscsi {{(pid=99028) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
May 25 18:03:53.257258 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-688b9153-8248-4279-8d06-d21a11d39ae2 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:53.280604 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.db [None req-2ec6c74c-8617-4aa2-b516-63e696764a7d admin admin] For port 20819f61-2e9b-4003-9d9f-151a9e6d2fd4, host dv-cinder-789564-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=20819f61-2e9b-4003-9d9f-151a9e6d2fd4,segment=NetworkSegment(e9a4953c-bd2f-4412-9030-8eb2cd20f5c5),segment_id=e9a4953c-bd2f-4412-9030-8eb2cd20f5c5)] {{(pid=99026) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 18:03:53.281144 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-2ec6c74c-8617-4aa2-b516-63e696764a7d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-418810'] for port, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:53.284450 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-688b9153-8248-4279-8d06-d21a11d39ae2 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:53.331894 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.plugin [None req-b33f7a69-33fc-4edc-9304-c207f074d731 None None] Deleting port 20819f61-2e9b-4003-9d9f-151a9e6d2fd4 {{(pid=99028) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 18:03:53.332276 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-b33f7a69-33fc-4edc-9304-c207f074d731 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781841220419'] for port, before_delete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:53.411164 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-6df2b2a7-a54e-4d57-9be3-033078b9d5b3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:53.438075 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-b33f7a69-33fc-4edc-9304-c207f074d731 None None] For port 20819f61-2e9b-4003-9d9f-151a9e6d2fd4, host dv-cinder-789564-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=20819f61-2e9b-4003-9d9f-151a9e6d2fd4,segment=NetworkSegment(e9a4953c-bd2f-4412-9030-8eb2cd20f5c5),segment_id=e9a4953c-bd2f-4412-9030-8eb2cd20f5c5)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 18:03:53.438467 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-b33f7a69-33fc-4edc-9304-c207f074d731 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-418810'] for port, precommit_delete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:53.442362 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-688b9153-8248-4279-8d06-d21a11d39ae2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:53.447308 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-b8d369ed-3620-4e00-a886-678b94487eab admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:03:53.460654 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-688b9153-8248-4279-8d06-d21a11d39ae2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=23060a6a-05db-458d-8bd2-1680a4db331d,revision_number=None']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:03:53.463548 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-688b9153-8248-4279-8d06-d21a11d39ae2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:03:53.465635 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-688b9153-8248-4279-8d06-d21a11d39ae2 admin admin] Notify callbacks [] for security_group, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:53.469761 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-688b9153-8248-4279-8d06-d21a11d39ae2 admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/23060a6a-05db-458d-8bd2-1680a4db331d HTTP/1.1" status: 204  len: 168 time: 0.2929478
May 25 18:03:53.513379 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.plugin [None req-2ec6c74c-8617-4aa2-b516-63e696764a7d admin admin] Calling delete_port for 20819f61-2e9b-4003-9d9f-151a9e6d2fd4 owned by network:dhcp {{(pid=99026) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 18:03:53.582330 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.plugin [None req-b33f7a69-33fc-4edc-9304-c207f074d731 None None] Calling delete_port for 20819f61-2e9b-4003-9d9f-151a9e6d2fd4 owned by network:dhcp {{(pid=99028) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 18:03:53.739818 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-2ec6c74c-8617-4aa2-b516-63e696764a7d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781841222566', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781840788188', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15476536'] for port, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:53.744923 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-25cb6cf7-9991-4e18-94bc-e4a706422f6b service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:03:53.748126 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-b33f7a69-33fc-4edc-9304-c207f074d731 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781841222566', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781840788188'] for port, after_delete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:53.752048 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:03:53.791429 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ec6c74c-8617-4aa2-b516-63e696764a7d admin admin] Pushing event deleted for resources: {'Port': ['ID=20819f61-2e9b-4003-9d9f-151a9e6d2fd4,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:03:53.793795 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2ec6c74c-8617-4aa2-b516-63e696764a7d admin admin] No DVR routers for this DVR port 20819f61-2e9b-4003-9d9f-151a9e6d2fd4 on host dv-cinder-789564-2-iscsi {{(pid=99026) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 25 18:03:53.795530 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-2ec6c74c-8617-4aa2-b516-63e696764a7d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:03:53.800886 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b33f7a69-33fc-4edc-9304-c207f074d731 None None] Pushing event deleted for resources: {'Port': ['ID=20819f61-2e9b-4003-9d9f-151a9e6d2fd4,revision_number=None']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:03:53.803070 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b33f7a69-33fc-4edc-9304-c207f074d731 None None] No DVR routers for this DVR port 20819f61-2e9b-4003-9d9f-151a9e6d2fd4 on host dv-cinder-789564-2-iscsi {{(pid=99028) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 25 18:03:53.804936 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-b33f7a69-33fc-4edc-9304-c207f074d731 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:03:53.847189 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device 20819f61-2e9b-4003-9d9f-151a9e6d2fd4 no longer exists at agent ovs-agent-dv-cinder-789564-2-iscsi {{(pid=99028) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 18:03:53.887462 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.plugin [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] No Port match for: 20819f61-2e9b-4003-9d9f-151a9e6d2fd4 {{(pid=99028) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 25 18:03:53.887805 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device 20819f61-2e9b-4003-9d9f-151a9e6d2fd4 not bound to the agent host dv-cinder-789564-2-iscsi {{(pid=99028) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 25 18:03:53.888220 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device 1e97124a-073a-4947-a6f2-359fb12ffe5e no longer exists at agent ovs-agent-dv-cinder-789564-2-iscsi {{(pid=99028) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 18:03:53.926892 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-2ec6c74c-8617-4aa2-b516-63e696764a7d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1470792', 'neutron.services.segments.db._delete_segments_for_network-8781841233116'] for network, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:53.948860 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.services.segments.db [None req-2ec6c74c-8617-4aa2-b516-63e696764a7d admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fcae698d8e0>,) {'filters': {'network_id': ['45b850af-d423-458a-855a-d7f828a11fff']}} {{(pid=99026) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 18:03:53.960409 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.plugin [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] No Port match for: 1e97124a-073a-4947-a6f2-359fb12ffe5e {{(pid=99028) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 25 18:03:53.961337 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device 1e97124a-073a-4947-a6f2-359fb12ffe5e not bound to the agent host dv-cinder-789564-2-iscsi {{(pid=99028) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 25 18:03:53.964118 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.services.segments.db [None req-2ec6c74c-8617-4aa2-b516-63e696764a7d admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fcae698d8e0>, 'e9a4953c-bd2f-4412-9030-8eb2cd20f5c5') {'for_net_delete': True} {{(pid=99026) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 18:03:53.964928 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.services.segments.db [None req-2ec6c74c-8617-4aa2-b516-63e696764a7d admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fcae698d8e0>, 'e9a4953c-bd2f-4412-9030-8eb2cd20f5c5') {} {{(pid=99026) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 18:03:53.978930 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-2ec6c74c-8617-4aa2-b516-63e696764a7d admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8781841242525', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-14735041'] for segment, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:53.995900 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-2ec6c74c-8617-4aa2-b516-63e696764a7d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1469168'] for segment, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:54.002414 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-2ec6c74c-8617-4aa2-b516-63e696764a7d admin admin] Releasing vlan 1318 on physical network physnet1 to pool {{(pid=99026) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 25 18:03:54.002793 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-2ec6c74c-8617-4aa2-b516-63e696764a7d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1469168', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-15476589'] for segment, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:54.015852 dv-cinder-789564-2-iscsi neutron-server[99026]: Traceback (most recent call last):
May 25 18:03:54.015852 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 25 18:03:54.015852 dv-cinder-789564-2-iscsi neutron-server[99026]:     timer()
May 25 18:03:54.015852 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 25 18:03:54.015852 dv-cinder-789564-2-iscsi neutron-server[99026]:     cb(*args, **kw)
May 25 18:03:54.015852 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 25 18:03:54.015852 dv-cinder-789564-2-iscsi neutron-server[99026]:     return func(*args, **kwargs)
May 25 18:03:54.015852 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 25 18:03:54.015852 dv-cinder-789564-2-iscsi neutron-server[99026]:     self._notify()
May 25 18:03:54.015852 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 25 18:03:54.015852 dv-cinder-789564-2-iscsi neutron-server[99026]:     self.callback(batched_events)
May 25 18:03:54.015852 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 25 18:03:54.015852 dv-cinder-789564-2-iscsi neutron-server[99026]:     event.method(event)
May 25 18:03:54.015852 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 25 18:03:54.015852 dv-cinder-789564-2-iscsi neutron-server[99026]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 25 18:03:54.015852 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 25 18:03:54.015852 dv-cinder-789564-2-iscsi neutron-server[99026]:     aggregate_uuid = self.p_client.list_aggregates(
May 25 18:03:54.015852 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 25 18:03:54.015852 dv-cinder-789564-2-iscsi neutron-server[99026]:     return f(self, *a, **k)
May 25 18:03:54.015852 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 25 18:03:54.015852 dv-cinder-789564-2-iscsi neutron-server[99026]:     return self._get(url).json()
May 25 18:03:54.015852 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 25 18:03:54.015852 dv-cinder-789564-2-iscsi neutron-server[99026]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 25 18:03:54.015852 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 25 18:03:54.015852 dv-cinder-789564-2-iscsi neutron-server[99026]:     return self.request(url, 'GET', **kwargs)
May 25 18:03:54.015852 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 25 18:03:54.015852 dv-cinder-789564-2-iscsi neutron-server[99026]:     base_url = self.get_endpoint(auth, allow=allow,
May 25 18:03:54.015852 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 25 18:03:54.015852 dv-cinder-789564-2-iscsi neutron-server[99026]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 25 18:03:54.015852 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 25 18:03:54.015852 dv-cinder-789564-2-iscsi neutron-server[99026]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 25 18:03:54.015852 dv-cinder-789564-2-iscsi neutron-server[99026]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 25 18:03:54.202460 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-2ec6c74c-8617-4aa2-b516-63e696764a7d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1470785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-459299', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551400', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-419883'] for network, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:54.206751 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-631cae27-696a-46e3-99df-a545a194da5d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:03:54.224677 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-2ec6c74c-8617-4aa2-b516-63e696764a7d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for network, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:54.235888 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ec6c74c-8617-4aa2-b516-63e696764a7d admin admin] Pushing event deleted for resources: {'Network': ['ID=45b850af-d423-458a-855a-d7f828a11fff,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:03:54.239083 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-2ec6c74c-8617-4aa2-b516-63e696764a7d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.033s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:03:54.322949 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-2ec6c74c-8617-4aa2-b516-63e696764a7d admin admin] 10.222.0.122 "DELETE /v2.0/networks/45b850af-d423-458a-855a-d7f828a11fff HTTP/1.1" status: 204  len: 168 time: 1.3537564
May 25 18:03:54.930509 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 51638) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 18:03:54.980182 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-937d362d-ec86-4bbf-9ab8-ecf45dfe7456 admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=cf02997eda314aee8fb322add2fbb921&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0482705
May 25 18:03:54.982606 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 51642) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 18:03:55.041912 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-2dc00121-12a8-4dfd-89b1-68f4c1496b45 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:55.068403 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-2dc00121-12a8-4dfd-89b1-68f4c1496b45 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:55.254201 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-2dc00121-12a8-4dfd-89b1-68f4c1496b45 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:55.259552 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-50524372-3b0b-4c96-ada3-73f96edaa1e7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:03:55.368560 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2dc00121-12a8-4dfd-89b1-68f4c1496b45 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=84d269c7-a51d-465e-86b0-06805e6e0c89,revision_number=None']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:03:55.374013 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-2dc00121-12a8-4dfd-89b1-68f4c1496b45 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.115s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:03:55.378431 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-2dc00121-12a8-4dfd-89b1-68f4c1496b45 admin admin] Notify callbacks [] for security_group, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:03:55.379889 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-2dc00121-12a8-4dfd-89b1-68f4c1496b45 admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/84d269c7-a51d-465e-86b0-06805e6e0c89 HTTP/1.1" status: 204  len: 168 time: 0.3960216
May 25 18:04:00.562702 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 51732) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 18:04:00.686548 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-1e4abada-8b29-471d-82b3-4694ddee1db7 admin admin] Notify callbacks [] for security_group, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:00.700509 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-1e4abada-8b29-471d-82b3-4694ddee1db7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 18:04:00.704290 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-1e4abada-8b29-471d-82b3-4694ddee1db7 admin admin] Usage tracker for resource:security_group_rule and tenant:8a7bd558e86a4e2293c1b1218bdc68af is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 18:04:00.714638 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-1e4abada-8b29-471d-82b3-4694ddee1db7 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 18:04:00.714638 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-1e4abada-8b29-471d-82b3-4694ddee1db7 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 18:04:00.808342 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-1e4abada-8b29-471d-82b3-4694ddee1db7 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:00.887953 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-1e4abada-8b29-471d-82b3-4694ddee1db7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:00.894768 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-e6f4e897-3d60-4a0a-b6f0-c79a838deaf6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:04:00.936506 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-1e4abada-8b29-471d-82b3-4694ddee1db7 admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=8a7bd558e86a4e2293c1b1218bdc68af&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3726470
May 25 18:04:00.937593 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e4abada-8b29-471d-82b3-4694ddee1db7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=77c9a094-ad17-42f0-94a2-637afda4933c,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:04:00.939335 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 51738) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 18:04:00.945319 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e4abada-8b29-471d-82b3-4694ddee1db7 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:04:00.951702 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e4abada-8b29-471d-82b3-4694ddee1db7 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:04:00.951702 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e4abada-8b29-471d-82b3-4694ddee1db7 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:04:00.951702 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e4abada-8b29-471d-82b3-4694ddee1db7 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:04:00.951702 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e4abada-8b29-471d-82b3-4694ddee1db7 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:04:00.951702 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e4abada-8b29-471d-82b3-4694ddee1db7 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:04:00.951702 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e4abada-8b29-471d-82b3-4694ddee1db7 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:04:00.951702 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e4abada-8b29-471d-82b3-4694ddee1db7 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:04:00.951702 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e4abada-8b29-471d-82b3-4694ddee1db7 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:04:00.951702 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e4abada-8b29-471d-82b3-4694ddee1db7 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:04:00.951702 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e4abada-8b29-471d-82b3-4694ddee1db7 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:04:00.951702 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1e4abada-8b29-471d-82b3-4694ddee1db7 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:04:00.954018 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-1e4abada-8b29-471d-82b3-4694ddee1db7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.059s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:04:00.998570 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-f7f36f50-3146-4fa1-b7fe-e4d2698d44e6 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:01.024727 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-f7f36f50-3146-4fa1-b7fe-e4d2698d44e6 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:01.247731 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-f7f36f50-3146-4fa1-b7fe-e4d2698d44e6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:01.251913 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-61cb84f7-c306-4328-ba64-66501002d26c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:04:01.263604 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7f36f50-3146-4fa1-b7fe-e4d2698d44e6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=77c9a094-ad17-42f0-94a2-637afda4933c,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:04:01.267478 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-f7f36f50-3146-4fa1-b7fe-e4d2698d44e6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:04:01.270746 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-f7f36f50-3146-4fa1-b7fe-e4d2698d44e6 admin admin] Notify callbacks [] for security_group, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:01.271862 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-f7f36f50-3146-4fa1-b7fe-e4d2698d44e6 admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/77c9a094-ad17-42f0-94a2-637afda4933c HTTP/1.1" status: 204  len: 168 time: 0.3315380
May 25 18:04:02.062499 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 51750) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 18:04:02.080501 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-db33eb55-c388-4966-a41e-e8c0f4e8958c admin admin] Notify callbacks [] for security_group, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:02.095365 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-db33eb55-c388-4966-a41e-e8c0f4e8958c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 18:04:02.102456 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-db33eb55-c388-4966-a41e-e8c0f4e8958c admin admin] Usage tracker for resource:security_group_rule and tenant:2c6de466f94546879f297cb8a8856892 is out of sync, need to count used quota {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 18:04:02.102456 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-db33eb55-c388-4966-a41e-e8c0f4e8958c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 18:04:02.108651 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-db33eb55-c388-4966-a41e-e8c0f4e8958c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 18:04:02.195592 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-db33eb55-c388-4966-a41e-e8c0f4e8958c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:02.350899 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-db33eb55-c388-4966-a41e-e8c0f4e8958c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:02.359576 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-5e5acf79-6380-4c55-856d-2753d3444b5f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:04:02.406566 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db33eb55-c388-4966-a41e-e8c0f4e8958c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7f761033-18f2-43ea-ada2-90cdda68211c,revision_number=1']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:04:02.413730 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-db33eb55-c388-4966-a41e-e8c0f4e8958c admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=2c6de466f94546879f297cb8a8856892&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3475208
May 25 18:04:02.413730 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-db33eb55-c388-4966-a41e-e8c0f4e8958c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:04:02.414260 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 51758) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 18:04:02.487219 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-ccb4e78b-ba09-4b12-8807-b6133b38b896 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:02.527315 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-ccb4e78b-ba09-4b12-8807-b6133b38b896 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:02.733662 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-ccb4e78b-ba09-4b12-8807-b6133b38b896 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:02.737574 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-ff443d1f-f9e4-466f-8e4d-4321404c42b8 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:04:02.762292 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ccb4e78b-ba09-4b12-8807-b6133b38b896 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7f761033-18f2-43ea-ada2-90cdda68211c,revision_number=None']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:04:02.766763 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-ccb4e78b-ba09-4b12-8807-b6133b38b896 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:04:02.773199 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-ccb4e78b-ba09-4b12-8807-b6133b38b896 admin admin] Notify callbacks [] for security_group, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:02.778970 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-ccb4e78b-ba09-4b12-8807-b6133b38b896 admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/7f761033-18f2-43ea-ada2-90cdda68211c HTTP/1.1" status: 204  len: 168 time: 0.3589725
May 25 18:04:04.022573 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 51806) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 18:04:04.131464 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.v2.base [None req-ff069c1b-79a8-45d6-9f18-a8ecc9ec9d08 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-1605877289-network', 'tenant_id': '7f01d1004d594d59b86b0f13610a009d'}} {{(pid=99027) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 18:04:04.136916 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-ff069c1b-79a8-45d6-9f18-a8ecc9ec9d08 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 18:04:04.140940 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-ff069c1b-79a8-45d6-9f18-a8ecc9ec9d08 admin admin] Usage tracker for resource:network and tenant:7f01d1004d594d59b86b0f13610a009d is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 18:04:04.143791 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-ff069c1b-79a8-45d6-9f18-a8ecc9ec9d08 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 18:04:04.150072 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-ff069c1b-79a8-45d6-9f18-a8ecc9ec9d08 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 18:04:04.321838 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ff069c1b-79a8-45d6-9f18-a8ecc9ec9d08 admin admin] Made reservation on behalf of 7f01d1004d594d59b86b0f13610a009d for: {'network': 1} {{(pid=99027) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 18:04:04.324665 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-ff069c1b-79a8-45d6-9f18-a8ecc9ec9d08 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-1465344'] for network, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:04.337804 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-ff069c1b-79a8-45d6-9f18-a8ecc9ec9d08 admin admin] Notify callbacks [] for security_group, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:04.353507 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-ff069c1b-79a8-45d6-9f18-a8ecc9ec9d08 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 18:04:04.357732 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-ff069c1b-79a8-45d6-9f18-a8ecc9ec9d08 admin admin] Usage tracker for resource:security_group_rule and tenant:7f01d1004d594d59b86b0f13610a009d is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 18:04:04.362363 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-ff069c1b-79a8-45d6-9f18-a8ecc9ec9d08 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 18:04:04.370767 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-ff069c1b-79a8-45d6-9f18-a8ecc9ec9d08 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 18:04:04.467855 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-ff069c1b-79a8-45d6-9f18-a8ecc9ec9d08 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:04.561552 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-ff069c1b-79a8-45d6-9f18-a8ecc9ec9d08 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:04.564581 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-1e4abada-8b29-471d-82b3-4694ddee1db7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:04:04.594989 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ff069c1b-79a8-45d6-9f18-a8ecc9ec9d08 admin admin] vlan segment allocate from pool success with {'vlan_id': 1347, 'physical_network': 'physnet1'}  {{(pid=99027) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 25 18:04:04.600125 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff069c1b-79a8-45d6-9f18-a8ecc9ec9d08 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b4513a21-d3e8-4c1a-aeb6-0f0a81d9b6fc,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:04:04.603767 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-ff069c1b-79a8-45d6-9f18-a8ecc9ec9d08 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.039s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:04:04.607407 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-ff069c1b-79a8-45d6-9f18-a8ecc9ec9d08 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1469168'] for segment, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:04.607751 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.db.segments_db [None req-ff069c1b-79a8-45d6-9f18-a8ecc9ec9d08 admin admin] Added segment 93782525-dc52-4ed6-9f23-535aff326ca7 of type vlan for network 090fd7f3-a18b-4f87-8a99-3b44b4246940
May 25 18:04:04.634755 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-ff069c1b-79a8-45d6-9f18-a8ecc9ec9d08 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8781840806997'] for network, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:04.756425 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-ff069c1b-79a8-45d6-9f18-a8ecc9ec9d08 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-459299', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551400'] for network, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:04.757805 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ff069c1b-79a8-45d6-9f18-a8ecc9ec9d08 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:04:04.758381 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-ff069c1b-79a8-45d6-9f18-a8ecc9ec9d08 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for network, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:04.765679 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-6bf7aba1-c884-454f-a9e1-e813683b2277 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:04:04.867215 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff069c1b-79a8-45d6-9f18-a8ecc9ec9d08 admin admin] Pushing event updated for resources: {'Network': ['ID=090fd7f3-a18b-4f87-8a99-3b44b4246940,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:04:04.870630 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-ff069c1b-79a8-45d6-9f18-a8ecc9ec9d08 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.104s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:04:04.878483 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Network 090fd7f3-a18b-4f87-8a99-3b44b4246940 details requested by agent ovs-agent-dv-cinder-789564-2-iscsi with host dv-cinder-789564-2-iscsi {{(pid=99028) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 25 18:04:04.939662 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-ff069c1b-79a8-45d6-9f18-a8ecc9ec9d08 admin admin] 10.222.0.122 "POST /v2.0/networks HTTP/1.1" status: 201  len: 883 time: 0.9159503
May 25 18:04:04.942471 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 51816) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 18:04:04.948097 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.v2.base [None req-ac9d17d2-6e0a-46fd-b964-be64501bea1f admin admin] Request body: {'subnet': {'network_id': '090fd7f3-a18b-4f87-8a99-3b44b4246940', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-1605877289-subnet', 'tenant_id': '7f01d1004d594d59b86b0f13610a009d', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=99027) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 18:04:04.952909 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-ac9d17d2-6e0a-46fd-b964-be64501bea1f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 18:04:04.956682 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-ac9d17d2-6e0a-46fd-b964-be64501bea1f admin admin] Usage tracker for resource:subnet and tenant:7f01d1004d594d59b86b0f13610a009d is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 18:04:04.959629 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-ac9d17d2-6e0a-46fd-b964-be64501bea1f admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 18:04:04.965583 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-ac9d17d2-6e0a-46fd-b964-be64501bea1f admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 18:04:05.047525 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ac9d17d2-6e0a-46fd-b964-be64501bea1f admin admin] Made reservation on behalf of 7f01d1004d594d59b86b0f13610a009d for: {'subnet': 1} {{(pid=99027) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 18:04:05.049983 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-ac9d17d2-6e0a-46fd-b964-be64501bea1f admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-14778112'] for subnet, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:05.539255 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-ac9d17d2-6e0a-46fd-b964-be64501bea1f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114466', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-15467018', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-14778134'] for subnet, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:05.544838 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:04:05.617369 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac9d17d2-6e0a-46fd-b964-be64501bea1f admin admin] Pushing event updated for resources: {'Subnet': ['ID=47a0e259-7f9c-4368-a9d5-a6a33d57bda6,revision_number=0']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:04:05.623596 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-ac9d17d2-6e0a-46fd-b964-be64501bea1f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:04:05.628606 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ac9d17d2-6e0a-46fd-b964-be64501bea1f admin admin] Checking segment: {'id': '93782525-dc52-4ed6-9f23-535aff326ca7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1347, 'network_id': '090fd7f3-a18b-4f87-8a99-3b44b4246940'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=99027) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 18:04:05.629006 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ac9d17d2-6e0a-46fd-b964-be64501bea1f admin admin] Network hostable DHCP agents. Network: 090fd7f3-a18b-4f87-8a99-3b44b4246940, hostable agents: ['c8b0a350-254b-4562-874b-120ecdef0e25'], hosted agents: [] {{(pid=99027) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 25 18:04:05.716021 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ac9d17d2-6e0a-46fd-b964-be64501bea1f admin admin] Network 090fd7f3-a18b-4f87-8a99-3b44b4246940 is scheduled to be hosted by DHCP agent c8b0a350-254b-4562-874b-120ecdef0e25 with binding_index 1 {{(pid=99027) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 25 18:04:05.831141 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.base_scheduler [None req-ac9d17d2-6e0a-46fd-b964-be64501bea1f admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-789564-2-iscsi, 090fd7f3-a18b-4f87-8a99-3b44b4246940) {{(pid=99027) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 18:04:05.843075 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ac9d17d2-6e0a-46fd-b964-be64501bea1f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:04:05.843965 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-ac9d17d2-6e0a-46fd-b964-be64501bea1f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for subnet, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:05.848530 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-960691ee-65d1-46a8-b192-da6c3519b926 None None] Network 090fd7f3-a18b-4f87-8a99-3b44b4246940 requested from dv-cinder-789564-2-iscsi {{(pid=99028) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 18:04:05.979313 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-ac9d17d2-6e0a-46fd-b964-be64501bea1f admin admin] 10.222.0.122 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 846 time: 1.0357089
May 25 18:04:06.049437 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4a61f398-d545-477a-ad2e-5ce123dce32f None None] Network 090fd7f3-a18b-4f87-8a99-3b44b4246940 requested from dv-cinder-789564-2-iscsi {{(pid=99028) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 18:04:08.600969 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-129934c5-f9bd-4990-98bb-9b1662247c1a req-c1ad0c3d-d109-4efa-93ea-397820cbb9c7 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:04:08.602466 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-129934c5-f9bd-4990-98bb-9b1662247c1a req-c1ad0c3d-d109-4efa-93ea-397820cbb9c7 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] 10.222.0.122 "GET /v2.0/networks?id=090fd7f3-a18b-4f87-8a99-3b44b4246940 HTTP/1.1" status: 200  len: 809 time: 0.1500669
May 25 18:04:08.617376 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-129934c5-f9bd-4990-98bb-9b1662247c1a req-dff8cd00-9bb4-4406-b419-05529284a721 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] 10.222.0.122 "GET /v2.0/quotas/7f01d1004d594d59b86b0f13610a009d HTTP/1.1" status: 200  len: 375 time: 0.0092158
May 25 18:04:08.665831 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-129934c5-f9bd-4990-98bb-9b1662247c1a req-55bae360-fb61-4b23-8af6-b1caf95a6a23 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] 10.222.0.122 "GET /v2.0/ports?tenant_id=7f01d1004d594d59b86b0f13610a009d&fields=id HTTP/1.1" status: 200  len: 210 time: 0.0432568
May 25 18:04:08.726664 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [req-129934c5-f9bd-4990-98bb-9b1662247c1a req-78b3fc03-1b3b-4ae6-876e-45e936260b70 service neutron] http://10.222.0.122:9696/v2.0/extensions returned with HTTP 200 {{(pid=99026) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 25 18:04:08.727683 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-129934c5-f9bd-4990-98bb-9b1662247c1a req-78b3fc03-1b3b-4ae6-876e-45e936260b70 service neutron] 10.222.0.122 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.0539837
May 25 18:04:08.869619 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-129934c5-f9bd-4990-98bb-9b1662247c1a req-de741ade-5337-400d-8406-9b3fc0659afb service neutron] 10.222.0.122 "GET /v2.0/networks/090fd7f3-a18b-4f87-8a99-3b44b4246940?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1352525
May 25 18:04:09.004497 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-129934c5-f9bd-4990-98bb-9b1662247c1a req-0b10879d-750a-4a01-ad20-9d428a33bb96 service neutron] 10.222.0.122 "GET /v2.0/networks/090fd7f3-a18b-4f87-8a99-3b44b4246940?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1287196
May 25 18:04:09.269005 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-8cd82959-6a32-491a-a51d-61dd8a9d2dba req-f34c868b-17a5-4abb-8bbc-1fdd0e71edc3 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] 10.222.0.122 "GET /v2.0/ports?device_id=8c472131-131d-4daf-baff-83e7a9861794 HTTP/1.1" status: 200  len: 210 time: 0.0448954
May 25 18:04:10.364968 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-3dc54111-185e-48e5-acb7-fedc42d31930 req-7ef93723-0a2d-498b-8c4c-1e9123f57a04 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] 10.222.0.122 "GET /v2.0/ports?device_id=8c472131-131d-4daf-baff-83e7a9861794 HTTP/1.1" status: 200  len: 210 time: 0.0429688
May 25 18:04:11.520460 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-27ac36ed-f7eb-48e4-b598-b19fab8af215 req-6585ca05-5eb1-4d88-9105-e812e827fa48 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] 10.222.0.122 "GET /v2.0/ports?device_id=8c472131-131d-4daf-baff-83e7a9861794 HTTP/1.1" status: 200  len: 210 time: 0.0486543
May 25 18:04:11.784543 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:12.455114 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-129934c5-f9bd-4990-98bb-9b1662247c1a req-28e1ef4a-fa79-4d2d-9604-f00184cd18c1 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:04:12.455909 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-129934c5-f9bd-4990-98bb-9b1662247c1a req-28e1ef4a-fa79-4d2d-9604-f00184cd18c1 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] Synchronizing usage tracker for tenant:7f01d1004d594d59b86b0f13610a009d on resource:network {{(pid=99027) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 18:04:12.607350 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-129934c5-f9bd-4990-98bb-9b1662247c1a req-28e1ef4a-fa79-4d2d-9604-f00184cd18c1 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] Unset dirty status for tenant:7f01d1004d594d59b86b0f13610a009d on resource:network {{(pid=99027) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 18:04:12.608748 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-129934c5-f9bd-4990-98bb-9b1662247c1a req-28e1ef4a-fa79-4d2d-9604-f00184cd18c1 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] 10.222.0.125 "GET /v2.0/networks?id=090fd7f3-a18b-4f87-8a99-3b44b4246940 HTTP/1.1" status: 200  len: 809 time: 0.3090715
May 25 18:04:12.633113 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.v2.base [req-129934c5-f9bd-4990-98bb-9b1662247c1a req-42862b33-c2cd-4d9c-a49d-a5655f3b7925 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] Request body: {'port': {'device_id': '8c472131-131d-4daf-baff-83e7a9861794', 'network_id': '090fd7f3-a18b-4f87-8a99-3b44b4246940', 'admin_state_up': True, 'tenant_id': '7f01d1004d594d59b86b0f13610a009d'}} {{(pid=99027) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 18:04:12.680241 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-759c268f-328b-411c-bc82-d86b928bef2e req-dcf4b37f-a9f3-4883-8dc9-5c8fd592b120 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] 10.222.0.122 "GET /v2.0/ports?device_id=8c472131-131d-4daf-baff-83e7a9861794 HTTP/1.1" status: 200  len: 210 time: 0.0515995
May 25 18:04:12.757906 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.agents_db [None req-14fae233-15dc-4576-836b-621c5f95b584 None None] Agent healthcheck: found 6 active agents {{(pid=99029) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 18:04:12.774301 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [req-129934c5-f9bd-4990-98bb-9b1662247c1a req-42862b33-c2cd-4d9c-a49d-a5655f3b7925 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 18:04:12.779363 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-129934c5-f9bd-4990-98bb-9b1662247c1a req-42862b33-c2cd-4d9c-a49d-a5655f3b7925 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] Usage tracker for resource:port and tenant:7f01d1004d594d59b86b0f13610a009d is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 18:04:12.785917 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-129934c5-f9bd-4990-98bb-9b1662247c1a req-42862b33-c2cd-4d9c-a49d-a5655f3b7925 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] Quota usage for port was recalculated. Used quota:0. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 18:04:12.788217 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [req-129934c5-f9bd-4990-98bb-9b1662247c1a req-42862b33-c2cd-4d9c-a49d-a5655f3b7925 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 18:04:12.898806 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-129934c5-f9bd-4990-98bb-9b1662247c1a req-42862b33-c2cd-4d9c-a49d-a5655f3b7925 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] Made reservation on behalf of 7f01d1004d594d59b86b0f13610a009d for: {'port': 1} {{(pid=99027) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 18:04:12.902913 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-129934c5-f9bd-4990-98bb-9b1662247c1a req-42862b33-c2cd-4d9c-a49d-a5655f3b7925 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:13.093245 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.db_base_plugin_common [req-129934c5-f9bd-4990-98bb-9b1662247c1a req-42862b33-c2cd-4d9c-a49d-a5655f3b7925 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] Allocated IP 172.20.0.9 (090fd7f3-a18b-4f87-8a99-3b44b4246940/47a0e259-7f9c-4368-a9d5-a6a33d57bda6/08d27ba8-482e-45a7-a5a0-7fd8eaa7aaa8) {{(pid=99027) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 18:04:13.397668 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-129934c5-f9bd-4990-98bb-9b1662247c1a req-42862b33-c2cd-4d9c-a49d-a5655f3b7925 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] Notify callbacks [] for port, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:13.533659 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-129934c5-f9bd-4990-98bb-9b1662247c1a req-42862b33-c2cd-4d9c-a49d-a5655f3b7925 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781840788179', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15468986'] for port, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:13.539148 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-9aca03ca-2082-4ac8-a22a-321420ba360e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:04:13.604044 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-129934c5-f9bd-4990-98bb-9b1662247c1a req-42862b33-c2cd-4d9c-a49d-a5655f3b7925 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] Network 090fd7f3-a18b-4f87-8a99-3b44b4246940 is already hosted by enough agents. {{(pid=99027) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 18:04:13.606856 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.base_scheduler [req-129934c5-f9bd-4990-98bb-9b1662247c1a req-42862b33-c2cd-4d9c-a49d-a5655f3b7925 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] Resources bound (agent type, host, resource id):  {{(pid=99027) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 18:04:13.610737 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.l3_dvrscheduler_db [req-129934c5-f9bd-4990-98bb-9b1662247c1a req-42862b33-c2cd-4d9c-a49d-a5655f3b7925 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] Received port after_create {{(pid=99027) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 18:04:13.648433 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42862b33-c2cd-4d9c-a49d-a5655f3b7925 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] Pushing event updated for resources: {'Port': ['ID=08d27ba8-482e-45a7-a5a0-7fd8eaa7aaa8,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:04:13.653318 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-42862b33-c2cd-4d9c-a49d-a5655f3b7925 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.114s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:04:13.679924 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-129934c5-f9bd-4990-98bb-9b1662247c1a req-42862b33-c2cd-4d9c-a49d-a5655f3b7925 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:04:13.680517 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-129934c5-f9bd-4990-98bb-9b1662247c1a req-42862b33-c2cd-4d9c-a49d-a5655f3b7925 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-239387'] for port, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:13.853277 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-129934c5-f9bd-4990-98bb-9b1662247c1a req-42862b33-c2cd-4d9c-a49d-a5655f3b7925 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] 10.222.0.125 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.2240670
May 25 18:04:13.871357 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.v2.base [req-129934c5-f9bd-4990-98bb-9b1662247c1a req-97a8478b-4ae4-4a15-95d0-0d7354531ba4 service neutron] Request body: {'port': {'device_id': '8c472131-131d-4daf-baff-83e7a9861794', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78956'}} {{(pid=99027) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 18:04:14.005075 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7991635-033c-4b8d-9a68-b6dbdbeb966f req-500b472b-ada0-4d39-945d-4534ffd2d650 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:04:14.005834 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-f7991635-033c-4b8d-9a68-b6dbdbeb966f req-500b472b-ada0-4d39-945d-4534ffd2d650 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] Synchronizing usage tracker for tenant:7f01d1004d594d59b86b0f13610a009d on resource:port {{(pid=99027) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 18:04:14.016669 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-129934c5-f9bd-4990-98bb-9b1662247c1a req-97a8478b-4ae4-4a15-95d0-0d7354531ba4 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:14.158130 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-f7991635-033c-4b8d-9a68-b6dbdbeb966f req-500b472b-ada0-4d39-945d-4534ffd2d650 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] Unset dirty status for tenant:7f01d1004d594d59b86b0f13610a009d on resource:port {{(pid=99027) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 18:04:14.159204 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-f7991635-033c-4b8d-9a68-b6dbdbeb966f req-500b472b-ada0-4d39-945d-4534ffd2d650 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] 10.222.0.122 "GET /v2.0/ports?device_id=8c472131-131d-4daf-baff-83e7a9861794 HTTP/1.1" status: 200  len: 931 time: 0.3429465
May 25 18:04:14.287804 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-f7991635-033c-4b8d-9a68-b6dbdbeb966f req-1e89f1d9-7963-40d4-a043-e72539ee8a1d tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] Synchronizing usage tracker for tenant:7f01d1004d594d59b86b0f13610a009d on resource:security_group {{(pid=99027) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 18:04:14.424638 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.notifiers.nova [req-129934c5-f9bd-4990-98bb-9b1662247c1a req-97a8478b-4ae4-4a15-95d0-0d7354531ba4 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 08d27ba8-482e-45a7-a5a0-7fd8eaa7aaa8 {{(pid=99027) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 25 18:04:14.431027 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-f7991635-033c-4b8d-9a68-b6dbdbeb966f req-1e89f1d9-7963-40d4-a043-e72539ee8a1d tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] Unset dirty status for tenant:7f01d1004d594d59b86b0f13610a009d on resource:security_group {{(pid=99027) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 18:04:14.432713 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-f7991635-033c-4b8d-9a68-b6dbdbeb966f req-1e89f1d9-7963-40d4-a043-e72539ee8a1d tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] 10.222.0.122 "GET /v2.0/security-groups?id=b4513a21-d3e8-4c1a-aeb6-0f0a81d9b6fc&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2671418
May 25 18:04:14.434346 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-129934c5-f9bd-4990-98bb-9b1662247c1a req-97a8478b-4ae4-4a15-95d0-0d7354531ba4 service neutron] Notify callbacks [] for port, precommit_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:14.453700 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.provisioning_blocks [req-129934c5-f9bd-4990-98bb-9b1662247c1a req-97a8478b-4ae4-4a15-95d0-0d7354531ba4 service neutron] Transition to ACTIVE for port object 08d27ba8-482e-45a7-a5a0-7fd8eaa7aaa8 will not be triggered until provisioned by entity L2. {{(pid=99027) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 18:04:14.566793 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-129934c5-f9bd-4990-98bb-9b1662247c1a req-97a8478b-4ae4-4a15-95d0-0d7354531ba4 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15468979'] for port, after_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:14.571568 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-5bf5ab37-2d67-453a-97b0-e08debb74997 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:04:14.722615 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97a8478b-4ae4-4a15-95d0-0d7354531ba4 service neutron] Pushing event updated for resources: {'Port': ['ID=08d27ba8-482e-45a7-a5a0-7fd8eaa7aaa8,revision_number=2']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:04:14.748363 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-97a8478b-4ae4-4a15-95d0-0d7354531ba4 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.154s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:04:14.806088 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.managers [req-129934c5-f9bd-4990-98bb-9b1662247c1a req-97a8478b-4ae4-4a15-95d0-0d7354531ba4 service neutron] Attempting to bind port 08d27ba8-482e-45a7-a5a0-7fd8eaa7aaa8 on host hv-cinder-78956 for vnic_type normal with profile  {{(pid=99027) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 18:04:14.822807 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.managers [req-129934c5-f9bd-4990-98bb-9b1662247c1a req-97a8478b-4ae4-4a15-95d0-0d7354531ba4 service neutron] Attempting to bind port 08d27ba8-482e-45a7-a5a0-7fd8eaa7aaa8 by drivers openvswitch,hyperv on host hv-cinder-78956 at level 0 using segments [{'id': '93782525-dc52-4ed6-9f23-535aff326ca7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1347, 'network_id': '090fd7f3-a18b-4f87-8a99-3b44b4246940'}] {{(pid=99027) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 18:04:14.822807 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-129934c5-f9bd-4990-98bb-9b1662247c1a req-97a8478b-4ae4-4a15-95d0-0d7354531ba4 service neutron] Attempting to bind port 08d27ba8-482e-45a7-a5a0-7fd8eaa7aaa8 on network 090fd7f3-a18b-4f87-8a99-3b44b4246940 {{(pid=99027) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 18:04:14.822807 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-129934c5-f9bd-4990-98bb-9b1662247c1a req-97a8478b-4ae4-4a15-95d0-0d7354531ba4 service neutron] Port 08d27ba8-482e-45a7-a5a0-7fd8eaa7aaa8 on network 090fd7f3-a18b-4f87-8a99-3b44b4246940 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78956 {{(pid=99027) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 25 18:04:14.822807 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-129934c5-f9bd-4990-98bb-9b1662247c1a req-97a8478b-4ae4-4a15-95d0-0d7354531ba4 service neutron] Attempting to bind port 08d27ba8-482e-45a7-a5a0-7fd8eaa7aaa8 on network 090fd7f3-a18b-4f87-8a99-3b44b4246940 {{(pid=99027) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 18:04:14.822807 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-129934c5-f9bd-4990-98bb-9b1662247c1a req-97a8478b-4ae4-4a15-95d0-0d7354531ba4 service neutron] Checking agent: {'id': '4d02a528-6a0e-4977-985f-4bcff1ca6cb7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78956', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 17, 40, 41), 'started_at': datetime.datetime(2021, 5, 25, 17, 40, 41), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 18, 4, 12), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=99027) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 18:04:14.822807 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-129934c5-f9bd-4990-98bb-9b1662247c1a req-97a8478b-4ae4-4a15-95d0-0d7354531ba4 service neutron] Checking segment: {'id': '93782525-dc52-4ed6-9f23-535aff326ca7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1347, 'network_id': '090fd7f3-a18b-4f87-8a99-3b44b4246940'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=99027) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 18:04:14.822807 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-129934c5-f9bd-4990-98bb-9b1662247c1a req-97a8478b-4ae4-4a15-95d0-0d7354531ba4 service neutron] Bound using segment: {'id': '93782525-dc52-4ed6-9f23-535aff326ca7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1347, 'network_id': '090fd7f3-a18b-4f87-8a99-3b44b4246940'} {{(pid=99027) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 18:04:14.822807 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.managers [req-129934c5-f9bd-4990-98bb-9b1662247c1a req-97a8478b-4ae4-4a15-95d0-0d7354531ba4 service neutron] Bound port: 08d27ba8-482e-45a7-a5a0-7fd8eaa7aaa8, host: hv-cinder-78956, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '93782525-dc52-4ed6-9f23-535aff326ca7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1347, 'network_id': '090fd7f3-a18b-4f87-8a99-3b44b4246940'}}] {{(pid=99027) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 18:04:14.822807 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-129934c5-f9bd-4990-98bb-9b1662247c1a req-97a8478b-4ae4-4a15-95d0-0d7354531ba4 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:14.916663 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.db [req-129934c5-f9bd-4990-98bb-9b1662247c1a req-97a8478b-4ae4-4a15-95d0-0d7354531ba4 service neutron] For port 08d27ba8-482e-45a7-a5a0-7fd8eaa7aaa8, host hv-cinder-78956, cleared binding levels {{(pid=99027) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 18:04:14.919744 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.db [req-129934c5-f9bd-4990-98bb-9b1662247c1a req-97a8478b-4ae4-4a15-95d0-0d7354531ba4 service neutron] For port 08d27ba8-482e-45a7-a5a0-7fd8eaa7aaa8, host hv-cinder-78956, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=08d27ba8-482e-45a7-a5a0-7fd8eaa7aaa8,segment=NetworkSegment(93782525-dc52-4ed6-9f23-535aff326ca7),segment_id=93782525-dc52-4ed6-9f23-535aff326ca7)] {{(pid=99027) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 18:04:15.121740 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-129934c5-f9bd-4990-98bb-9b1662247c1a req-97a8478b-4ae4-4a15-95d0-0d7354531ba4 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15468979'] for port, after_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:15.125608 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-38600a04-fa8b-4001-b06f-cdfb1faafd11 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:04:15.178466 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-129934c5-f9bd-4990-98bb-9b1662247c1a req-97a8478b-4ae4-4a15-95d0-0d7354531ba4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:04:15.179070 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-129934c5-f9bd-4990-98bb-9b1662247c1a req-97a8478b-4ae4-4a15-95d0-0d7354531ba4 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-239387'] for port, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:15.180434 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-129934c5-f9bd-4990-98bb-9b1662247c1a req-97a8478b-4ae4-4a15-95d0-0d7354531ba4 service neutron] 10.222.0.125 "PUT /v2.0/ports/08d27ba8-482e-45a7-a5a0-7fd8eaa7aaa8 HTTP/1.1" status: 200  len: 1093 time: 1.3161151
May 25 18:04:15.183878 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '8c472131-131d-4daf-baff-83e7a9861794', 'tag': '08d27ba8-482e-45a7-a5a0-7fd8eaa7aaa8'}] {{(pid=99027) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 18:04:15.208707 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97a8478b-4ae4-4a15-95d0-0d7354531ba4 service neutron] Pushing event updated for resources: {'Port': ['ID=08d27ba8-482e-45a7-a5a0-7fd8eaa7aaa8,revision_number=3']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:04:15.211798 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-97a8478b-4ae4-4a15-95d0-0d7354531ba4 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:04:15.232062 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '8c472131-131d-4daf-baff-83e7a9861794', 'tag': '08d27ba8-482e-45a7-a5a0-7fd8eaa7aaa8', 'status': 'completed', 'code': 200}
May 25 18:04:15.327395 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71dea7cb-22f0-4d94-bee5-f9fb3fae0dc4 req-955e6539-335d-41e8-ae44-ba5fbf19183c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:04:15.328898 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-71dea7cb-22f0-4d94-bee5-f9fb3fae0dc4 req-955e6539-335d-41e8-ae44-ba5fbf19183c service neutron] 10.222.0.125 "GET /v2.0/ports?tenant_id=7f01d1004d594d59b86b0f13610a009d&device_id=8c472131-131d-4daf-baff-83e7a9861794 HTTP/1.1" status: 200  len: 1096 time: 0.0748613
May 25 18:04:15.472404 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71dea7cb-22f0-4d94-bee5-f9fb3fae0dc4 req-67b96705-99f6-44c9-8e45-940b7fd2c2f7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:04:15.473939 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-71dea7cb-22f0-4d94-bee5-f9fb3fae0dc4 req-67b96705-99f6-44c9-8e45-940b7fd2c2f7 service neutron] 10.222.0.125 "GET /v2.0/networks?tenant_id=7f01d1004d594d59b86b0f13610a009d&shared=False HTTP/1.1" status: 200  len: 911 time: 0.1387761
May 25 18:04:15.669039 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71dea7cb-22f0-4d94-bee5-f9fb3fae0dc4 req-9affe841-8a30-4504-ba54-862ff216541c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:04:15.671917 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-71dea7cb-22f0-4d94-bee5-f9fb3fae0dc4 req-9affe841-8a30-4504-ba54-862ff216541c service neutron] 10.222.0.125 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 871 time: 0.1883814
May 25 18:04:15.686059 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31202748-7f8c-46fd-bd3c-ce2980a40149 req-d033cc1d-b02e-4411-85c5-2275b1646278 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:04:15.687758 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-31202748-7f8c-46fd-bd3c-ce2980a40149 req-d033cc1d-b02e-4411-85c5-2275b1646278 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] 10.222.0.122 "GET /v2.0/ports?device_id=8c472131-131d-4daf-baff-83e7a9861794 HTTP/1.1" status: 200  len: 943 time: 0.1347589
May 25 18:04:15.887562 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-31202748-7f8c-46fd-bd3c-ce2980a40149 req-d2e72233-d607-482b-9c52-604636c91d47 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] 10.222.0.122 "GET /v2.0/security-groups?id=b4513a21-d3e8-4c1a-aeb6-0f0a81d9b6fc&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1924427
May 25 18:04:15.911012 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-129934c5-f9bd-4990-98bb-9b1662247c1a req-65cb9c94-7f5d-4d56-a960-cdcaffca6e8f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:04:15.912531 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-129934c5-f9bd-4990-98bb-9b1662247c1a req-65cb9c94-7f5d-4d56-a960-cdcaffca6e8f service neutron] 10.222.0.125 "GET /v2.0/ports?tenant_id=7f01d1004d594d59b86b0f13610a009d&device_id=8c472131-131d-4daf-baff-83e7a9861794 HTTP/1.1" status: 200  len: 1096 time: 0.1963794
May 25 18:04:15.989175 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-129934c5-f9bd-4990-98bb-9b1662247c1a req-a7f3463b-877b-43de-88f7-1d7b92a69c42 service neutron] 10.222.0.125 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=08d27ba8-482e-45a7-a5a0-7fd8eaa7aaa8 HTTP/1.1" status: 200  len: 217 time: 0.0673661
May 25 18:04:16.050472 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-129934c5-f9bd-4990-98bb-9b1662247c1a req-cde4025c-b5a9-4df0-945b-3be69b31cc3e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:04:16.051981 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-129934c5-f9bd-4990-98bb-9b1662247c1a req-cde4025c-b5a9-4df0-945b-3be69b31cc3e service neutron] 10.222.0.125 "GET /v2.0/subnets?id=47a0e259-7f9c-4368-a9d5-a6a33d57bda6 HTTP/1.1" status: 200  len: 849 time: 0.0581481
May 25 18:04:16.101452 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-129934c5-f9bd-4990-98bb-9b1662247c1a req-bbe083d0-78bc-482c-9634-36a0b29f4f19 service neutron] 10.222.0.125 "GET /v2.0/ports?network_id=090fd7f3-a18b-4f87-8a99-3b44b4246940&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0412164
May 25 18:04:16.238546 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-129934c5-f9bd-4990-98bb-9b1662247c1a req-4105fa18-3d6a-450b-b205-6f1a85648dc6 service neutron] 10.222.0.125 "GET /v2.0/networks/090fd7f3-a18b-4f87-8a99-3b44b4246940?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1288140
May 25 18:04:16.374705 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-129934c5-f9bd-4990-98bb-9b1662247c1a req-06bd192c-145b-4ad3-81ff-0d3a6de5278d service neutron] 10.222.0.125 "GET /v2.0/networks/090fd7f3-a18b-4f87-8a99-3b44b4246940?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1279573
May 25 18:04:17.083853 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4925d19-e669-40d8-9104-1d6cded8068f req-290e1b0a-ee7d-4774-8218-046804379937 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:04:17.085413 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-d4925d19-e669-40d8-9104-1d6cded8068f req-290e1b0a-ee7d-4774-8218-046804379937 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] 10.222.0.122 "GET /v2.0/ports?device_id=8c472131-131d-4daf-baff-83e7a9861794 HTTP/1.1" status: 200  len: 943 time: 0.0845525
May 25 18:04:17.131464 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-d4925d19-e669-40d8-9104-1d6cded8068f req-1638efb1-f160-473f-a75f-a873bc193fb7 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] 10.222.0.122 "GET /v2.0/security-groups?id=b4513a21-d3e8-4c1a-aeb6-0f0a81d9b6fc&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0398297
May 25 18:04:18.184057 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-d99188d1-403f-443b-b68b-06014585c663 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:18.333414 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfdfd1ef-daf8-4aa2-9f0d-3f169afc726a req-0d81eb56-3ec3-4183-b279-3f9a2c169977 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:04:18.334805 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-dfdfd1ef-daf8-4aa2-9f0d-3f169afc726a req-0d81eb56-3ec3-4183-b279-3f9a2c169977 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] 10.222.0.122 "GET /v2.0/ports?device_id=8c472131-131d-4daf-baff-83e7a9861794 HTTP/1.1" status: 200  len: 943 time: 0.0916002
May 25 18:04:18.383712 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-dfdfd1ef-daf8-4aa2-9f0d-3f169afc726a req-d4cd9360-6c82-48b7-876f-c70ade57dae9 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] 10.222.0.122 "GET /v2.0/security-groups?id=b4513a21-d3e8-4c1a-aeb6-0f0a81d9b6fc&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0424736
May 25 18:04:19.574547 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-938d09bc-c6db-470e-aeb0-4ed2217249b5 req-be1e298a-7b74-4152-a60c-4efa9e9e0251 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:04:19.576051 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-938d09bc-c6db-470e-aeb0-4ed2217249b5 req-be1e298a-7b74-4152-a60c-4efa9e9e0251 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] 10.222.0.122 "GET /v2.0/ports?device_id=8c472131-131d-4daf-baff-83e7a9861794 HTTP/1.1" status: 200  len: 943 time: 0.0870295
May 25 18:04:19.623047 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-938d09bc-c6db-470e-aeb0-4ed2217249b5 req-d92c16bb-346a-411f-aeb0-2decbb639e53 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] 10.222.0.122 "GET /v2.0/security-groups?id=b4513a21-d3e8-4c1a-aeb6-0f0a81d9b6fc&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0410571
May 25 18:04:20.372039 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Device 08d27ba8-482e-45a7-a5a0-7fd8eaa7aaa8 details requested by agent hyperv_hv-cinder-78956 with host hv-cinder-78956 {{(pid=99028) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 25 18:04:20.521488 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] For port 08d27ba8-482e-45a7-a5a0-7fd8eaa7aaa8, host hv-cinder-78956, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=08d27ba8-482e-45a7-a5a0-7fd8eaa7aaa8,segment=NetworkSegment(93782525-dc52-4ed6-9f23-535aff326ca7),segment_id=93782525-dc52-4ed6-9f23-535aff326ca7)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 18:04:20.535178 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Returning: {'device': '08d27ba8-482e-45a7-a5a0-7fd8eaa7aaa8', 'network_id': '090fd7f3-a18b-4f87-8a99-3b44b4246940', 'port_id': '08d27ba8-482e-45a7-a5a0-7fd8eaa7aaa8', 'mac_address': 'fa:16:3e:3e:ac:e4', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1347, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '47a0e259-7f9c-4368-a9d5-a6a33d57bda6', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=99028) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 25 18:04:20.602974 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:20.620295 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.notifiers.nova [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 08d27ba8-482e-45a7-a5a0-7fd8eaa7aaa8 {{(pid=99028) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 25 18:04:20.636641 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] For port 08d27ba8-482e-45a7-a5a0-7fd8eaa7aaa8, host hv-cinder-78956, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=08d27ba8-482e-45a7-a5a0-7fd8eaa7aaa8,segment=NetworkSegment(93782525-dc52-4ed6-9f23-535aff326ca7),segment_id=93782525-dc52-4ed6-9f23-535aff326ca7)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 18:04:20.686568 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-25f817a8-1a0f-4ffc-8d06-7d5c42a58f18 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:20.778144 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:20.781431 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-89411d75-83e0-4e21-bf09-f28cebc71a4e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:04:20.819296 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51917168-0f2b-43c0-aaaf-24ac76746ba0 req-68a85daf-ff80-4956-a118-51112a02f35a tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:04:20.820836 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-51917168-0f2b-43c0-aaaf-24ac76746ba0 req-68a85daf-ff80-4956-a118-51112a02f35a tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] 10.222.0.122 "GET /v2.0/ports?device_id=8c472131-131d-4daf-baff-83e7a9861794 HTTP/1.1" status: 200  len: 944 time: 0.0869513
May 25 18:04:20.857669 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Pushing event updated for resources: {'Port': ['ID=08d27ba8-482e-45a7-a5a0-7fd8eaa7aaa8,revision_number=4']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:04:20.864809 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:04:20.865180 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:04:20.865517 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:04:20.865846 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:04:20.866170 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:04:20.866494 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:04:20.866815 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:04:20.867135 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:04:20.867455 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:04:20.867771 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:04:20.868175 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:04:20.868523 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:04:20.873240 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:04:20.874151 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-51917168-0f2b-43c0-aaaf-24ac76746ba0 req-54840dd7-1f78-4896-97a2-3df46379f241 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] 10.222.0.122 "GET /v2.0/security-groups?id=b4513a21-d3e8-4c1a-aeb6-0f0a81d9b6fc&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0470898
May 25 18:04:20.897914 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:21.047773 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 52010) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 18:04:21.107849 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] get_ports_and_sgs() called for port_ids ['08d27ba8-482e-45a7-a5a0-7fd8eaa7aaa8'] {{(pid=99028) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 25 18:04:21.168201 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-b2f71137-0a17-47a3-a751-67a66ebdc223 admin admin] Notify callbacks [] for security_group, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:21.185790 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-b2f71137-0a17-47a3-a751-67a66ebdc223 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 18:04:21.191926 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-b2f71137-0a17-47a3-a751-67a66ebdc223 admin admin] Usage tracker for resource:security_group_rule and tenant:bb04469f560c445280595ba567a9ea77 is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 18:04:21.196533 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-b2f71137-0a17-47a3-a751-67a66ebdc223 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 18:04:21.206035 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-b2f71137-0a17-47a3-a751-67a66ebdc223 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 18:04:21.316436 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-b2f71137-0a17-47a3-a751-67a66ebdc223 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:21.383964 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-b2f71137-0a17-47a3-a751-67a66ebdc223 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:21.392242 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-ccb4e78b-ba09-4b12-8807-b6133b38b896 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:04:21.434200 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-b2f71137-0a17-47a3-a751-67a66ebdc223 admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=bb04469f560c445280595ba567a9ea77&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3852623
May 25 18:04:21.436563 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2f71137-0a17-47a3-a751-67a66ebdc223 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1d722e29-b6fa-45a2-bbe4-7b7ccbf42e10,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:04:21.437508 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 52016) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 18:04:21.440515 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-b2f71137-0a17-47a3-a751-67a66ebdc223 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:04:21.499559 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-da7016b4-595a-4305-998f-e22f718d6f01 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:21.527540 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-da7016b4-595a-4305-998f-e22f718d6f01 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:21.681478 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-da7016b4-595a-4305-998f-e22f718d6f01 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:21.685303 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-68e70c68-a71a-4802-856b-306baa4fabe2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:04:21.702504 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da7016b4-595a-4305-998f-e22f718d6f01 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1d722e29-b6fa-45a2-bbe4-7b7ccbf42e10,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:04:21.718679 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da7016b4-595a-4305-998f-e22f718d6f01 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:04:21.719046 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da7016b4-595a-4305-998f-e22f718d6f01 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:04:21.719416 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da7016b4-595a-4305-998f-e22f718d6f01 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:04:21.719782 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da7016b4-595a-4305-998f-e22f718d6f01 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:04:21.720144 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da7016b4-595a-4305-998f-e22f718d6f01 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:04:21.720503 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da7016b4-595a-4305-998f-e22f718d6f01 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:04:21.720860 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da7016b4-595a-4305-998f-e22f718d6f01 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:04:21.721250 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da7016b4-595a-4305-998f-e22f718d6f01 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:04:21.721606 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da7016b4-595a-4305-998f-e22f718d6f01 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:04:21.722032 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da7016b4-595a-4305-998f-e22f718d6f01 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:04:21.722391 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da7016b4-595a-4305-998f-e22f718d6f01 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:04:21.722751 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da7016b4-595a-4305-998f-e22f718d6f01 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:04:21.726250 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-da7016b4-595a-4305-998f-e22f718d6f01 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.041s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:04:21.727478 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-da7016b4-595a-4305-998f-e22f718d6f01 admin admin] Notify callbacks [] for security_group, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:21.729440 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-da7016b4-595a-4305-998f-e22f718d6f01 admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/1d722e29-b6fa-45a2-bbe4-7b7ccbf42e10 HTTP/1.1" status: 204  len: 168 time: 0.2900069
May 25 18:04:21.789703 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-7e261f94-b84f-443e-be49-3bc1ac903b55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:22.063285 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78b8ddb1-0f85-4c81-b584-38ef4207795a req-09a22c43-c686-4ded-b512-5ccaab88f58b tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:04:22.064810 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-78b8ddb1-0f85-4c81-b584-38ef4207795a req-09a22c43-c686-4ded-b512-5ccaab88f58b tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] 10.222.0.122 "GET /v2.0/ports?device_id=8c472131-131d-4daf-baff-83e7a9861794 HTTP/1.1" status: 200  len: 944 time: 0.0841482
May 25 18:04:22.110353 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-78b8ddb1-0f85-4c81-b584-38ef4207795a req-322494c8-1a2c-4742-9989-6f5490b10273 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] 10.222.0.122 "GET /v2.0/security-groups?id=b4513a21-d3e8-4c1a-aeb6-0f0a81d9b6fc&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0397978
May 25 18:04:22.387614 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Device 08d27ba8-482e-45a7-a5a0-7fd8eaa7aaa8 up at agent hyperv_hv-cinder-78956 {{(pid=99028) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 18:04:22.512254 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 52026) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 18:04:22.530419 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-cab9bff7-63f3-4504-89f4-f93d0b75f9c4 admin admin] Notify callbacks [] for security_group, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:22.546031 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-cab9bff7-63f3-4504-89f4-f93d0b75f9c4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 18:04:22.549569 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Provisioning for port 08d27ba8-482e-45a7-a5a0-7fd8eaa7aaa8 completed by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 18:04:22.549872 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-cab9bff7-63f3-4504-89f4-f93d0b75f9c4 admin admin] Usage tracker for resource:security_group_rule and tenant:ecd2ba3ac4b842fabc85b4d0e0bbfaf4 is out of sync, need to count used quota {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 18:04:22.552984 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-cab9bff7-63f3-4504-89f4-f93d0b75f9c4 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 18:04:22.555504 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Provisioning complete for port 08d27ba8-482e-45a7-a5a0-7fd8eaa7aaa8 triggered by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 18:04:22.555885 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:22.565942 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-cab9bff7-63f3-4504-89f4-f93d0b75f9c4 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 18:04:22.642296 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-cab9bff7-63f3-4504-89f4-f93d0b75f9c4 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:22.678522 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:22.705941 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8c472131-131d-4daf-baff-83e7a9861794', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '08d27ba8-482e-45a7-a5a0-7fd8eaa7aaa8'}] {{(pid=99028) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 18:04:22.717319 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] For port 08d27ba8-482e-45a7-a5a0-7fd8eaa7aaa8, host hv-cinder-78956, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=08d27ba8-482e-45a7-a5a0-7fd8eaa7aaa8,segment=NetworkSegment(93782525-dc52-4ed6-9f23-535aff326ca7),segment_id=93782525-dc52-4ed6-9f23-535aff326ca7)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 18:04:22.721074 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-cab9bff7-63f3-4504-89f4-f93d0b75f9c4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:22.734777 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-4be2d66a-f2f0-4acd-8f64-9e58e0d537de admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:04:22.817958 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:22.820602 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:04:22.876648 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 52034) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 18:04:22.877317 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-cab9bff7-63f3-4504-89f4-f93d0b75f9c4 admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=ecd2ba3ac4b842fabc85b4d0e0bbfaf4&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3634210
May 25 18:04:22.878068 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cab9bff7-63f3-4504-89f4-f93d0b75f9c4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b6bcd53c-4971-494a-9ff8-865774fcd8d5,revision_number=1']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:04:22.881206 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-cab9bff7-63f3-4504-89f4-f93d0b75f9c4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.147s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:04:22.894606 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Pushing event updated for resources: {'Port': ['ID=08d27ba8-482e-45a7-a5a0-7fd8eaa7aaa8,revision_number=5']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:04:22.897633 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:04:22.957341 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-17717ac1-2a96-4340-a48e-d1f298104e8e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:22.958613 dv-cinder-789564-2-iscsi neutron-server[99028]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8c472131-131d-4daf-baff-83e7a9861794', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '08d27ba8-482e-45a7-a5a0-7fd8eaa7aaa8', 'code': 200}
May 25 18:04:22.993355 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-17717ac1-2a96-4340-a48e-d1f298104e8e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:23.120967 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-17717ac1-2a96-4340-a48e-d1f298104e8e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:23.125011 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-c7439d45-8517-4817-92d4-002bffb25360 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:04:23.139670 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17717ac1-2a96-4340-a48e-d1f298104e8e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b6bcd53c-4971-494a-9ff8-865774fcd8d5,revision_number=None']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:04:23.143513 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-17717ac1-2a96-4340-a48e-d1f298104e8e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:04:23.149202 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-17717ac1-2a96-4340-a48e-d1f298104e8e admin admin] Notify callbacks [] for security_group, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:23.150960 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-17717ac1-2a96-4340-a48e-d1f298104e8e admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/b6bcd53c-4971-494a-9ff8-865774fcd8d5 HTTP/1.1" status: 204  len: 168 time: 0.2720006
May 25 18:04:23.313676 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f602f87-bffd-4aa0-83d9-c74250931e56 req-b2a0b29d-8abe-4fba-8cb7-467770ba9917 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:04:23.315212 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-8f602f87-bffd-4aa0-83d9-c74250931e56 req-b2a0b29d-8abe-4fba-8cb7-467770ba9917 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] 10.222.0.122 "GET /v2.0/ports?device_id=8c472131-131d-4daf-baff-83e7a9861794 HTTP/1.1" status: 200  len: 945 time: 0.0890796
May 25 18:04:23.317627 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90924574-a011-4b4c-9480-f371378be6ec req-88edb959-f40b-4fdc-be35-fde34d288850 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:04:23.319247 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-90924574-a011-4b4c-9480-f371378be6ec req-88edb959-f40b-4fdc-be35-fde34d288850 service neutron] 10.222.0.125 "GET /v2.0/ports?device_id=8c472131-131d-4daf-baff-83e7a9861794 HTTP/1.1" status: 200  len: 1098 time: 0.0816903
May 25 18:04:23.361523 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-90924574-a011-4b4c-9480-f371378be6ec req-e45d9bda-854b-4e38-b3bc-b61477c5af93 service neutron] 10.222.0.125 "GET /v2.0/security-groups?id=b4513a21-d3e8-4c1a-aeb6-0f0a81d9b6fc&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0343914
May 25 18:04:23.366049 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-8f602f87-bffd-4aa0-83d9-c74250931e56 req-cae7d02f-9167-4944-9dcd-9577a8a1f2e2 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] 10.222.0.122 "GET /v2.0/security-groups?id=b4513a21-d3e8-4c1a-aeb6-0f0a81d9b6fc&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0447779
May 25 18:04:23.389223 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-6df2b2a7-a54e-4d57-9be3-033078b9d5b3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:24.584265 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6e48fef-a850-412d-a3fe-2a0c15ed38af req-e139236b-738b-46d3-ac99-f2b30b66878b tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:04:24.584265 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-a6e48fef-a850-412d-a3fe-2a0c15ed38af req-e139236b-738b-46d3-ac99-f2b30b66878b tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] 10.222.0.122 "GET /v2.0/ports?device_id=8c472131-131d-4daf-baff-83e7a9861794 HTTP/1.1" status: 200  len: 945 time: 0.0898919
May 25 18:04:24.610777 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-a6e48fef-a850-412d-a3fe-2a0c15ed38af req-9bbae684-c122-487a-8704-83aaa46b15e2 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] 10.222.0.122 "GET /v2.0/security-groups?id=b4513a21-d3e8-4c1a-aeb6-0f0a81d9b6fc&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0401201
May 25 18:04:26.542265 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-430e08eb-f81a-457a-9685-44c6da97f3cd req-63044dbc-fd4a-45d4-a44e-ed721494b146 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:04:26.543694 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-430e08eb-f81a-457a-9685-44c6da97f3cd req-63044dbc-fd4a-45d4-a44e-ed721494b146 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] 10.222.0.122 "GET /v2.0/ports?device_id=8c472131-131d-4daf-baff-83e7a9861794 HTTP/1.1" status: 200  len: 945 time: 0.0841727
May 25 18:04:26.613415 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-430e08eb-f81a-457a-9685-44c6da97f3cd req-c4d27ade-be56-4f73-b62d-d8cde5f9d1e2 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] 10.222.0.122 "GET /v2.0/security-groups?id=b4513a21-d3e8-4c1a-aeb6-0f0a81d9b6fc&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0638683
May 25 18:04:26.694921 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 52122) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 18:04:26.816830 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-c351be31-18cd-4a10-bb95-b1807fb607a6 admin admin] Notify callbacks [] for security_group, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:26.831738 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-c351be31-18cd-4a10-bb95-b1807fb607a6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 18:04:26.835469 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-c351be31-18cd-4a10-bb95-b1807fb607a6 admin admin] Usage tracker for resource:security_group_rule and tenant:118e010b369c44abbbe16fb8f71b2c18 is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 18:04:26.839084 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-c351be31-18cd-4a10-bb95-b1807fb607a6 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 18:04:26.844724 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-c351be31-18cd-4a10-bb95-b1807fb607a6 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 18:04:26.927662 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-c351be31-18cd-4a10-bb95-b1807fb607a6 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:26.988785 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-c351be31-18cd-4a10-bb95-b1807fb607a6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:26.996694 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-088a7311-910d-4ade-9cb2-84131072cf3a tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:04:27.036264 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c351be31-18cd-4a10-bb95-b1807fb607a6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a2d9db10-8b97-4f53-83d7-5fc8f492f589,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:04:27.040726 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-c351be31-18cd-4a10-bb95-b1807fb607a6 admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=118e010b369c44abbbe16fb8f71b2c18&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3446128
May 25 18:04:27.042277 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-c351be31-18cd-4a10-bb95-b1807fb607a6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:04:27.045268 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 52128) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 18:04:27.105964 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-4a5ec28f-243d-4b08-acf2-5d3c25a7fd4f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:27.132336 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-4a5ec28f-243d-4b08-acf2-5d3c25a7fd4f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:27.258187 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-4a5ec28f-243d-4b08-acf2-5d3c25a7fd4f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:27.262969 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-70d62fe6-c08b-4330-aa2c-9c2e3e545227 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:04:27.277369 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a5ec28f-243d-4b08-acf2-5d3c25a7fd4f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a2d9db10-8b97-4f53-83d7-5fc8f492f589,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:04:27.281470 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-4a5ec28f-243d-4b08-acf2-5d3c25a7fd4f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:04:27.287590 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-4a5ec28f-243d-4b08-acf2-5d3c25a7fd4f admin admin] Notify callbacks [] for security_group, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:27.292065 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-4a5ec28f-243d-4b08-acf2-5d3c25a7fd4f admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/a2d9db10-8b97-4f53-83d7-5fc8f492f589 HTTP/1.1" status: 204  len: 168 time: 0.2426651
May 25 18:04:27.576020 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfbff698-b0bf-4356-a934-e3aaceab9f23 req-cf819f4a-dc36-4cb7-8c21-3dc40462a685 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:04:27.577555 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-dfbff698-b0bf-4356-a934-e3aaceab9f23 req-cf819f4a-dc36-4cb7-8c21-3dc40462a685 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] 10.222.0.125 "GET /v2.0/ports?device_id=8c472131-131d-4daf-baff-83e7a9861794 HTTP/1.1" status: 200  len: 945 time: 0.0873947
May 25 18:04:27.719990 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.plugin [req-dfbff698-b0bf-4356-a934-e3aaceab9f23 req-835986b7-4801-41d1-b2bf-e9f9805d4531 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] Deleting port 08d27ba8-482e-45a7-a5a0-7fd8eaa7aaa8 {{(pid=99027) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 18:04:27.720328 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-dfbff698-b0bf-4356-a934-e3aaceab9f23 req-835986b7-4801-41d1-b2bf-e9f9805d4531 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781841220419'] for port, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:27.827576 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c9cc19b-a880-48ec-a26c-6cf7581b0a62 req-adc96c1c-59f4-4f3c-afc2-08b5e718f19a tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:04:27.829125 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-0c9cc19b-a880-48ec-a26c-6cf7581b0a62 req-adc96c1c-59f4-4f3c-afc2-08b5e718f19a tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] 10.222.0.122 "GET /v2.0/ports?device_id=8c472131-131d-4daf-baff-83e7a9861794 HTTP/1.1" status: 200  len: 945 time: 0.0936573
May 25 18:04:27.864788 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.db [req-dfbff698-b0bf-4356-a934-e3aaceab9f23 req-835986b7-4801-41d1-b2bf-e9f9805d4531 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] For port 08d27ba8-482e-45a7-a5a0-7fd8eaa7aaa8, host hv-cinder-78956, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=08d27ba8-482e-45a7-a5a0-7fd8eaa7aaa8,segment=NetworkSegment(93782525-dc52-4ed6-9f23-535aff326ca7),segment_id=93782525-dc52-4ed6-9f23-535aff326ca7)] {{(pid=99027) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 18:04:27.865177 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-dfbff698-b0bf-4356-a934-e3aaceab9f23 req-835986b7-4801-41d1-b2bf-e9f9805d4531 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-418810'] for port, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:27.878986 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-0c9cc19b-a880-48ec-a26c-6cf7581b0a62 req-c3390d39-5dd4-4f57-9938-dca4a4da0b91 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] 10.222.0.122 "GET /v2.0/security-groups?id=b4513a21-d3e8-4c1a-aeb6-0f0a81d9b6fc&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0437257
May 25 18:04:28.005695 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.plugin [req-dfbff698-b0bf-4356-a934-e3aaceab9f23 req-835986b7-4801-41d1-b2bf-e9f9805d4531 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] Calling delete_port for 08d27ba8-482e-45a7-a5a0-7fd8eaa7aaa8 owned by compute:nova {{(pid=99027) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 18:04:28.007339 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 52138) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 18:04:28.028132 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-d5699fb7-183b-4d92-a9f6-7ca797f406bc admin admin] Notify callbacks [] for security_group, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:28.043310 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-d5699fb7-183b-4d92-a9f6-7ca797f406bc admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 18:04:28.047127 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-d5699fb7-183b-4d92-a9f6-7ca797f406bc admin admin] Usage tracker for resource:security_group_rule and tenant:0315e88ee2344228b0d2812ff51b6570 is out of sync, need to count used quota {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 18:04:28.050020 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-d5699fb7-183b-4d92-a9f6-7ca797f406bc admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 18:04:28.055909 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-d5699fb7-183b-4d92-a9f6-7ca797f406bc admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 18:04:28.200661 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-dfbff698-b0bf-4356-a934-e3aaceab9f23 req-835986b7-4801-41d1-b2bf-e9f9805d4531 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781841222566', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781840788188', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15468986'] for port, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:28.206520 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-08215083-6821-43e8-be87-76ad726cf736 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:04:28.258112 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-835986b7-4801-41d1-b2bf-e9f9805d4531 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] Pushing event deleted for resources: {'Port': ['ID=08d27ba8-482e-45a7-a5a0-7fd8eaa7aaa8,revision_number=None']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:04:28.262944 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-835986b7-4801-41d1-b2bf-e9f9805d4531 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.057s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:04:28.297187 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-d5699fb7-183b-4d92-a9f6-7ca797f406bc admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:28.339194 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] get_ports_and_sgs() called for port_ids ['08d27ba8-482e-45a7-a5a0-7fd8eaa7aaa8'] {{(pid=99028) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 25 18:04:28.377717 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-d5699fb7-183b-4d92-a9f6-7ca797f406bc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:28.388505 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-09b77486-66bc-49d4-84ca-bfe7c4b52c82 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:04:28.441466 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-d5699fb7-183b-4d92-a9f6-7ca797f406bc admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=0315e88ee2344228b0d2812ff51b6570&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4329591
May 25 18:04:28.442496 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5699fb7-183b-4d92-a9f6-7ca797f406bc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2facf12d-afd0-4123-a722-c4190ac05232,revision_number=1']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:04:28.445757 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-d5699fb7-183b-4d92-a9f6-7ca797f406bc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.057s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:04:28.447234 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 52142) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 18:04:28.468454 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.l3_dvrscheduler_db [req-dfbff698-b0bf-4356-a934-e3aaceab9f23 req-835986b7-4801-41d1-b2bf-e9f9805d4531 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] No DVR routers for this DVR port 08d27ba8-482e-45a7-a5a0-7fd8eaa7aaa8 on host hv-cinder-78956 {{(pid=99027) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 25 18:04:28.472337 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-dfbff698-b0bf-4356-a934-e3aaceab9f23 req-835986b7-4801-41d1-b2bf-e9f9805d4531 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-239387'] for port, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:28.475395 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8c472131-131d-4daf-baff-83e7a9861794', 'name': 'network-vif-deleted', 'tag': '08d27ba8-482e-45a7-a5a0-7fd8eaa7aaa8'}] {{(pid=99027) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 18:04:28.526503 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8c472131-131d-4daf-baff-83e7a9861794', 'name': 'network-vif-deleted', 'tag': '08d27ba8-482e-45a7-a5a0-7fd8eaa7aaa8', 'status': 'completed', 'code': 200}
May 25 18:04:28.531498 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-1860162e-3351-4a52-99c3-a170d6c5f324 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:28.565375 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-1860162e-3351-4a52-99c3-a170d6c5f324 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:28.578179 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-dfbff698-b0bf-4356-a934-e3aaceab9f23 req-835986b7-4801-41d1-b2bf-e9f9805d4531 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] 10.222.0.125 "DELETE /v2.0/ports/08d27ba8-482e-45a7-a5a0-7fd8eaa7aaa8 HTTP/1.1" status: 204  len: 173 time: 0.9935517
May 25 18:04:28.777975 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-1860162e-3351-4a52-99c3-a170d6c5f324 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:28.783033 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-e0d2aa39-4a80-48ca-bc5e-972f16a11a61 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:04:28.799141 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1860162e-3351-4a52-99c3-a170d6c5f324 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2facf12d-afd0-4123-a722-c4190ac05232,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:04:28.801520 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-1860162e-3351-4a52-99c3-a170d6c5f324 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:04:28.806381 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-1860162e-3351-4a52-99c3-a170d6c5f324 admin admin] Notify callbacks [] for security_group, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:28.808964 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-1860162e-3351-4a52-99c3-a170d6c5f324 admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/2facf12d-afd0-4123-a722-c4190ac05232 HTTP/1.1" status: 204  len: 168 time: 0.3603516
May 25 18:04:29.083349 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-5b6234ed-4559-480d-b10e-efcf0cf1020b req-65f4b1c2-adec-4cf2-8c3a-ee3842dd5fc8 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] 10.222.0.122 "GET /v2.0/ports?device_id=8c472131-131d-4daf-baff-83e7a9861794 HTTP/1.1" status: 200  len: 210 time: 0.0535834
May 25 18:04:30.418452 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Device 08d27ba8-482e-45a7-a5a0-7fd8eaa7aaa8 no longer exists at agent hyperv_hv-cinder-78956 {{(pid=99028) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 18:04:30.452287 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.plugin [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] No Port match for: 08d27ba8-482e-45a7-a5a0-7fd8eaa7aaa8 {{(pid=99028) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 25 18:04:30.452644 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Device 08d27ba8-482e-45a7-a5a0-7fd8eaa7aaa8 not bound to the agent host hv-cinder-78956 {{(pid=99028) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 25 18:04:30.510624 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e06d6af4-7256-413d-9e43-ebc49b0dd346 req-9b33ba6d-9268-4400-8d50-597e31ff84a4 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:04:30.512105 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-e06d6af4-7256-413d-9e43-ebc49b0dd346 req-9b33ba6d-9268-4400-8d50-597e31ff84a4 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] 10.222.0.122 "GET /v2.0/networks?id=090fd7f3-a18b-4f87-8a99-3b44b4246940 HTTP/1.1" status: 200  len: 809 time: 0.1500525
May 25 18:04:30.527178 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-e06d6af4-7256-413d-9e43-ebc49b0dd346 req-7d104497-03de-4a87-98a9-e01af17e4c1f tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] 10.222.0.122 "GET /v2.0/quotas/7f01d1004d594d59b86b0f13610a009d HTTP/1.1" status: 200  len: 375 time: 0.0096376
May 25 18:04:30.578975 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-e06d6af4-7256-413d-9e43-ebc49b0dd346 req-8aad6af1-75af-4b74-94e0-7beb95413d61 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] 10.222.0.122 "GET /v2.0/ports?tenant_id=7f01d1004d594d59b86b0f13610a009d&fields=id HTTP/1.1" status: 200  len: 210 time: 0.0466657
May 25 18:04:30.712962 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-e06d6af4-7256-413d-9e43-ebc49b0dd346 req-9ac1cc9e-039a-4ea9-b573-ba38824573b0 service neutron] 10.222.0.122 "GET /v2.0/networks/090fd7f3-a18b-4f87-8a99-3b44b4246940?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1270728
May 25 18:04:30.848373 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-e06d6af4-7256-413d-9e43-ebc49b0dd346 req-1d04288f-712b-4726-bea5-591beaa87301 service neutron] 10.222.0.122 "GET /v2.0/networks/090fd7f3-a18b-4f87-8a99-3b44b4246940?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1295335
May 25 18:04:31.134316 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-230fc003-7796-4dab-abc9-be4d7adcfb01 req-bf75ec1e-d291-4ff6-9539-56409a3d5c13 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] Synchronizing usage tracker for tenant:7f01d1004d594d59b86b0f13610a009d on resource:port {{(pid=99027) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 18:04:31.194284 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-230fc003-7796-4dab-abc9-be4d7adcfb01 req-bf75ec1e-d291-4ff6-9539-56409a3d5c13 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] Unset dirty status for tenant:7f01d1004d594d59b86b0f13610a009d on resource:port {{(pid=99027) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 18:04:31.195487 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-230fc003-7796-4dab-abc9-be4d7adcfb01 req-bf75ec1e-d291-4ff6-9539-56409a3d5c13 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] 10.222.0.122 "GET /v2.0/ports?device_id=c0b23942-c764-49f0-8d10-7bc43ea87762 HTTP/1.1" status: 200  len: 210 time: 0.1229115
May 25 18:04:32.349825 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-ae4dfd38-2064-442e-a1b0-c953dc1c1a47 req-aa0540f0-3940-4a38-b262-e7e49ea1cf2e tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] 10.222.0.122 "GET /v2.0/ports?device_id=c0b23942-c764-49f0-8d10-7bc43ea87762 HTTP/1.1" status: 200  len: 210 time: 0.0438819
May 25 18:04:33.212057 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e06d6af4-7256-413d-9e43-ebc49b0dd346 req-825212fb-c29d-4d10-a3e4-b2b7f569fc6b tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:04:33.213505 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-e06d6af4-7256-413d-9e43-ebc49b0dd346 req-825212fb-c29d-4d10-a3e4-b2b7f569fc6b tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] 10.222.0.125 "GET /v2.0/networks?id=090fd7f3-a18b-4f87-8a99-3b44b4246940 HTTP/1.1" status: 200  len: 809 time: 0.1511219
May 25 18:04:33.227618 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.v2.base [req-e06d6af4-7256-413d-9e43-ebc49b0dd346 req-9538cbbe-95db-4281-96b8-73cbe06b3f51 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] Request body: {'port': {'device_id': 'c0b23942-c764-49f0-8d10-7bc43ea87762', 'network_id': '090fd7f3-a18b-4f87-8a99-3b44b4246940', 'admin_state_up': True, 'tenant_id': '7f01d1004d594d59b86b0f13610a009d'}} {{(pid=99027) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 18:04:33.362861 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [req-e06d6af4-7256-413d-9e43-ebc49b0dd346 req-9538cbbe-95db-4281-96b8-73cbe06b3f51 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 18:04:33.373011 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [req-e06d6af4-7256-413d-9e43-ebc49b0dd346 req-9538cbbe-95db-4281-96b8-73cbe06b3f51 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 18:04:33.487276 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-e06d6af4-7256-413d-9e43-ebc49b0dd346 req-9538cbbe-95db-4281-96b8-73cbe06b3f51 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] Made reservation on behalf of 7f01d1004d594d59b86b0f13610a009d for: {'port': 1} {{(pid=99027) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 18:04:33.490525 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-e06d6af4-7256-413d-9e43-ebc49b0dd346 req-9538cbbe-95db-4281-96b8-73cbe06b3f51 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:33.514937 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-f5f715d0-6051-4e27-a30b-05b75555f085 req-eba0774f-2ee6-4db9-837b-e1416c936c20 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] 10.222.0.122 "GET /v2.0/ports?device_id=c0b23942-c764-49f0-8d10-7bc43ea87762 HTTP/1.1" status: 200  len: 210 time: 0.0591187
May 25 18:04:33.670318 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.db_base_plugin_common [req-e06d6af4-7256-413d-9e43-ebc49b0dd346 req-9538cbbe-95db-4281-96b8-73cbe06b3f51 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] Allocated IP 172.20.0.10 (090fd7f3-a18b-4f87-8a99-3b44b4246940/47a0e259-7f9c-4368-a9d5-a6a33d57bda6/dbe9952b-6e6c-4570-9afe-61d4e93fd243) {{(pid=99027) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 18:04:33.872930 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-e06d6af4-7256-413d-9e43-ebc49b0dd346 req-9538cbbe-95db-4281-96b8-73cbe06b3f51 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] Notify callbacks [] for port, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:34.028665 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-e06d6af4-7256-413d-9e43-ebc49b0dd346 req-9538cbbe-95db-4281-96b8-73cbe06b3f51 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781840788179', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15468986'] for port, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:34.034354 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-9e0dba06-859f-4796-801f-0a5f16285ce4 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:04:34.103435 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-e06d6af4-7256-413d-9e43-ebc49b0dd346 req-9538cbbe-95db-4281-96b8-73cbe06b3f51 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] Network 090fd7f3-a18b-4f87-8a99-3b44b4246940 is already hosted by enough agents. {{(pid=99027) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 18:04:34.106428 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.base_scheduler [req-e06d6af4-7256-413d-9e43-ebc49b0dd346 req-9538cbbe-95db-4281-96b8-73cbe06b3f51 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] Resources bound (agent type, host, resource id):  {{(pid=99027) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 18:04:34.108896 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.l3_dvrscheduler_db [req-e06d6af4-7256-413d-9e43-ebc49b0dd346 req-9538cbbe-95db-4281-96b8-73cbe06b3f51 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] Received port after_create {{(pid=99027) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 18:04:34.149614 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9538cbbe-95db-4281-96b8-73cbe06b3f51 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] Pushing event updated for resources: {'Port': ['ID=dbe9952b-6e6c-4570-9afe-61d4e93fd243,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:04:34.152339 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-9538cbbe-95db-4281-96b8-73cbe06b3f51 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.118s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:04:34.178577 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e06d6af4-7256-413d-9e43-ebc49b0dd346 req-9538cbbe-95db-4281-96b8-73cbe06b3f51 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:04:34.179168 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-e06d6af4-7256-413d-9e43-ebc49b0dd346 req-9538cbbe-95db-4281-96b8-73cbe06b3f51 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-239387'] for port, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:34.281188 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-e06d6af4-7256-413d-9e43-ebc49b0dd346 req-9538cbbe-95db-4281-96b8-73cbe06b3f51 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] 10.222.0.125 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 1.0569425
May 25 18:04:34.696917 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da6b6543-0461-47c1-addb-59161628ca0d req-86739026-e204-4c34-8414-1a015b5f8d03 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:04:34.698406 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-da6b6543-0461-47c1-addb-59161628ca0d req-86739026-e204-4c34-8414-1a015b5f8d03 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] 10.222.0.122 "GET /v2.0/ports?device_id=c0b23942-c764-49f0-8d10-7bc43ea87762 HTTP/1.1" status: 200  len: 932 time: 0.0799148
May 25 18:04:34.746531 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-da6b6543-0461-47c1-addb-59161628ca0d req-520aa683-d62a-49eb-87e1-d16bdc7d9afc tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] 10.222.0.122 "GET /v2.0/security-groups?id=b4513a21-d3e8-4c1a-aeb6-0f0a81d9b6fc&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0419471
May 25 18:04:35.178968 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.v2.base [req-e06d6af4-7256-413d-9e43-ebc49b0dd346 req-dbdd8d48-f052-49c7-8f1f-a9db2aded359 service neutron] Request body: {'port': {'device_id': 'c0b23942-c764-49f0-8d10-7bc43ea87762', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78956'}} {{(pid=99027) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 18:04:35.293387 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-e06d6af4-7256-413d-9e43-ebc49b0dd346 req-dbdd8d48-f052-49c7-8f1f-a9db2aded359 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:35.638007 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.notifiers.nova [req-e06d6af4-7256-413d-9e43-ebc49b0dd346 req-dbdd8d48-f052-49c7-8f1f-a9db2aded359 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id dbe9952b-6e6c-4570-9afe-61d4e93fd243 {{(pid=99027) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 25 18:04:35.648965 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-e06d6af4-7256-413d-9e43-ebc49b0dd346 req-dbdd8d48-f052-49c7-8f1f-a9db2aded359 service neutron] Notify callbacks [] for port, precommit_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:35.668017 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.provisioning_blocks [req-e06d6af4-7256-413d-9e43-ebc49b0dd346 req-dbdd8d48-f052-49c7-8f1f-a9db2aded359 service neutron] Transition to ACTIVE for port object dbe9952b-6e6c-4570-9afe-61d4e93fd243 will not be triggered until provisioned by entity L2. {{(pid=99027) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 18:04:35.771458 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-e06d6af4-7256-413d-9e43-ebc49b0dd346 req-dbdd8d48-f052-49c7-8f1f-a9db2aded359 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15468979'] for port, after_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:35.775505 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-e1dd23eb-a2fb-461a-85d8-3ccfbcc37457 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:04:36.054614 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dbdd8d48-f052-49c7-8f1f-a9db2aded359 service neutron] Pushing event updated for resources: {'Port': ['ID=dbe9952b-6e6c-4570-9afe-61d4e93fd243,revision_number=2']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:04:36.084198 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-dbdd8d48-f052-49c7-8f1f-a9db2aded359 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.309s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:04:36.175842 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.managers [req-e06d6af4-7256-413d-9e43-ebc49b0dd346 req-dbdd8d48-f052-49c7-8f1f-a9db2aded359 service neutron] Attempting to bind port dbe9952b-6e6c-4570-9afe-61d4e93fd243 on host hv-cinder-78956 for vnic_type normal with profile  {{(pid=99027) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 18:04:36.176098 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.managers [req-e06d6af4-7256-413d-9e43-ebc49b0dd346 req-dbdd8d48-f052-49c7-8f1f-a9db2aded359 service neutron] Attempting to bind port dbe9952b-6e6c-4570-9afe-61d4e93fd243 by drivers openvswitch,hyperv on host hv-cinder-78956 at level 0 using segments [{'id': '93782525-dc52-4ed6-9f23-535aff326ca7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1347, 'network_id': '090fd7f3-a18b-4f87-8a99-3b44b4246940'}] {{(pid=99027) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 18:04:36.176416 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e06d6af4-7256-413d-9e43-ebc49b0dd346 req-dbdd8d48-f052-49c7-8f1f-a9db2aded359 service neutron] Attempting to bind port dbe9952b-6e6c-4570-9afe-61d4e93fd243 on network 090fd7f3-a18b-4f87-8a99-3b44b4246940 {{(pid=99027) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 18:04:36.186897 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e65fb88-b7af-4166-aeba-3ab6450e2068 req-6ef9c6b3-4b46-43be-9c52-e811b44594e9 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:04:36.187621 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-9e65fb88-b7af-4166-aeba-3ab6450e2068 req-6ef9c6b3-4b46-43be-9c52-e811b44594e9 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] Synchronizing usage tracker for tenant:7f01d1004d594d59b86b0f13610a009d on resource:port {{(pid=99027) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 18:04:36.192176 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e06d6af4-7256-413d-9e43-ebc49b0dd346 req-dbdd8d48-f052-49c7-8f1f-a9db2aded359 service neutron] Port dbe9952b-6e6c-4570-9afe-61d4e93fd243 on network 090fd7f3-a18b-4f87-8a99-3b44b4246940 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78956 {{(pid=99027) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 25 18:04:36.200508 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e06d6af4-7256-413d-9e43-ebc49b0dd346 req-dbdd8d48-f052-49c7-8f1f-a9db2aded359 service neutron] Attempting to bind port dbe9952b-6e6c-4570-9afe-61d4e93fd243 on network 090fd7f3-a18b-4f87-8a99-3b44b4246940 {{(pid=99027) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 18:04:36.200735 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e06d6af4-7256-413d-9e43-ebc49b0dd346 req-dbdd8d48-f052-49c7-8f1f-a9db2aded359 service neutron] Checking agent: {'id': '4d02a528-6a0e-4977-985f-4bcff1ca6cb7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78956', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 17, 40, 41), 'started_at': datetime.datetime(2021, 5, 25, 17, 40, 41), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 18, 4, 12), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=99027) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 18:04:36.201062 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e06d6af4-7256-413d-9e43-ebc49b0dd346 req-dbdd8d48-f052-49c7-8f1f-a9db2aded359 service neutron] Checking segment: {'id': '93782525-dc52-4ed6-9f23-535aff326ca7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1347, 'network_id': '090fd7f3-a18b-4f87-8a99-3b44b4246940'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=99027) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 18:04:36.201457 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e06d6af4-7256-413d-9e43-ebc49b0dd346 req-dbdd8d48-f052-49c7-8f1f-a9db2aded359 service neutron] Bound using segment: {'id': '93782525-dc52-4ed6-9f23-535aff326ca7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1347, 'network_id': '090fd7f3-a18b-4f87-8a99-3b44b4246940'} {{(pid=99027) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 18:04:36.201872 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.managers [req-e06d6af4-7256-413d-9e43-ebc49b0dd346 req-dbdd8d48-f052-49c7-8f1f-a9db2aded359 service neutron] Bound port: dbe9952b-6e6c-4570-9afe-61d4e93fd243, host: hv-cinder-78956, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '93782525-dc52-4ed6-9f23-535aff326ca7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1347, 'network_id': '090fd7f3-a18b-4f87-8a99-3b44b4246940'}}] {{(pid=99027) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 18:04:36.202297 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-e06d6af4-7256-413d-9e43-ebc49b0dd346 req-dbdd8d48-f052-49c7-8f1f-a9db2aded359 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:36.293302 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-9e65fb88-b7af-4166-aeba-3ab6450e2068 req-6ef9c6b3-4b46-43be-9c52-e811b44594e9 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] Unset dirty status for tenant:7f01d1004d594d59b86b0f13610a009d on resource:port {{(pid=99027) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 18:04:36.294477 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-9e65fb88-b7af-4166-aeba-3ab6450e2068 req-6ef9c6b3-4b46-43be-9c52-e811b44594e9 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] 10.222.0.122 "GET /v2.0/ports?device_id=c0b23942-c764-49f0-8d10-7bc43ea87762 HTTP/1.1" status: 200  len: 944 time: 0.4176869
May 25 18:04:36.298245 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.db [req-e06d6af4-7256-413d-9e43-ebc49b0dd346 req-dbdd8d48-f052-49c7-8f1f-a9db2aded359 service neutron] For port dbe9952b-6e6c-4570-9afe-61d4e93fd243, host hv-cinder-78956, cleared binding levels {{(pid=99027) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 18:04:36.302296 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.db [req-e06d6af4-7256-413d-9e43-ebc49b0dd346 req-dbdd8d48-f052-49c7-8f1f-a9db2aded359 service neutron] For port dbe9952b-6e6c-4570-9afe-61d4e93fd243, host hv-cinder-78956, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=dbe9952b-6e6c-4570-9afe-61d4e93fd243,segment=NetworkSegment(93782525-dc52-4ed6-9f23-535aff326ca7),segment_id=93782525-dc52-4ed6-9f23-535aff326ca7)] {{(pid=99027) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 18:04:36.340774 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-9e65fb88-b7af-4166-aeba-3ab6450e2068 req-f5df8ec8-4956-4f28-bb41-7874902a112f tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] 10.222.0.122 "GET /v2.0/security-groups?id=b4513a21-d3e8-4c1a-aeb6-0f0a81d9b6fc&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0403118
May 25 18:04:36.389319 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-e06d6af4-7256-413d-9e43-ebc49b0dd346 req-dbdd8d48-f052-49c7-8f1f-a9db2aded359 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15468979'] for port, after_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:36.394201 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-9850a6ad-1568-4bcb-9bf1-c6750d231a46 tempest-TestShelveInstance-218771630 tempest-TestShelveInstance-218771630-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:04:36.450066 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e06d6af4-7256-413d-9e43-ebc49b0dd346 req-dbdd8d48-f052-49c7-8f1f-a9db2aded359 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:04:36.450670 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-e06d6af4-7256-413d-9e43-ebc49b0dd346 req-dbdd8d48-f052-49c7-8f1f-a9db2aded359 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-239387'] for port, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:36.452015 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-e06d6af4-7256-413d-9e43-ebc49b0dd346 req-dbdd8d48-f052-49c7-8f1f-a9db2aded359 service neutron] 10.222.0.125 "PUT /v2.0/ports/dbe9952b-6e6c-4570-9afe-61d4e93fd243 HTTP/1.1" status: 200  len: 1094 time: 1.2775030
May 25 18:04:36.455218 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c0b23942-c764-49f0-8d10-7bc43ea87762', 'tag': 'dbe9952b-6e6c-4570-9afe-61d4e93fd243'}] {{(pid=99027) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 18:04:36.479647 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dbdd8d48-f052-49c7-8f1f-a9db2aded359 service neutron] Pushing event updated for resources: {'Port': ['ID=dbe9952b-6e6c-4570-9afe-61d4e93fd243,revision_number=3']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:04:36.482811 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-dbdd8d48-f052-49c7-8f1f-a9db2aded359 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:04:36.500807 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'c0b23942-c764-49f0-8d10-7bc43ea87762', 'tag': 'dbe9952b-6e6c-4570-9afe-61d4e93fd243', 'status': 'completed', 'code': 200}
May 25 18:04:36.596117 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86431a91-dd78-4597-ba92-ec6d2fa1eb9a req-c8b9a4bf-ee51-477b-aee8-cf71753e56cd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:04:36.597614 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-86431a91-dd78-4597-ba92-ec6d2fa1eb9a req-c8b9a4bf-ee51-477b-aee8-cf71753e56cd service neutron] 10.222.0.125 "GET /v2.0/ports?tenant_id=7f01d1004d594d59b86b0f13610a009d&device_id=c0b23942-c764-49f0-8d10-7bc43ea87762 HTTP/1.1" status: 200  len: 1097 time: 0.0725157
May 25 18:04:36.749678 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86431a91-dd78-4597-ba92-ec6d2fa1eb9a req-ba7e8fc3-07c3-41a9-a50f-24b717f2ab0a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:04:36.751393 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-86431a91-dd78-4597-ba92-ec6d2fa1eb9a req-ba7e8fc3-07c3-41a9-a50f-24b717f2ab0a service neutron] 10.222.0.125 "GET /v2.0/networks?tenant_id=7f01d1004d594d59b86b0f13610a009d&shared=False HTTP/1.1" status: 200  len: 911 time: 0.1445358
May 25 18:04:36.894235 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86431a91-dd78-4597-ba92-ec6d2fa1eb9a req-968e9041-b0e7-420c-82fc-a7dc414c225a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:04:36.895719 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-86431a91-dd78-4597-ba92-ec6d2fa1eb9a req-968e9041-b0e7-420c-82fc-a7dc414c225a service neutron] 10.222.0.125 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 871 time: 0.1367025
May 25 18:04:37.012783 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e06d6af4-7256-413d-9e43-ebc49b0dd346 req-cf585b1d-d5d1-4805-8b64-9e4db07d3175 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:04:37.014203 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-e06d6af4-7256-413d-9e43-ebc49b0dd346 req-cf585b1d-d5d1-4805-8b64-9e4db07d3175 service neutron] 10.222.0.125 "GET /v2.0/ports?tenant_id=7f01d1004d594d59b86b0f13610a009d&device_id=c0b23942-c764-49f0-8d10-7bc43ea87762 HTTP/1.1" status: 200  len: 1097 time: 0.0763903
May 25 18:04:37.084119 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-e06d6af4-7256-413d-9e43-ebc49b0dd346 req-e56ccd8a-852d-4a36-84ce-2c121943a846 service neutron] 10.222.0.125 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=dbe9952b-6e6c-4570-9afe-61d4e93fd243 HTTP/1.1" status: 200  len: 217 time: 0.0622213
May 25 18:04:37.152137 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e06d6af4-7256-413d-9e43-ebc49b0dd346 req-5181c121-584c-43aa-9b89-89fae5639b48 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:04:37.153597 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-e06d6af4-7256-413d-9e43-ebc49b0dd346 req-5181c121-584c-43aa-9b89-89fae5639b48 service neutron] 10.222.0.125 "GET /v2.0/subnets?id=47a0e259-7f9c-4368-a9d5-a6a33d57bda6 HTTP/1.1" status: 200  len: 849 time: 0.0623207
May 25 18:04:37.218593 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-e06d6af4-7256-413d-9e43-ebc49b0dd346 req-6b6b46d4-657f-4e56-8ef0-ac172956c4a2 service neutron] 10.222.0.125 "GET /v2.0/ports?network_id=090fd7f3-a18b-4f87-8a99-3b44b4246940&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0571041
May 25 18:04:37.355085 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-e06d6af4-7256-413d-9e43-ebc49b0dd346 req-ff1bb098-d120-47db-b395-586763dfffdd service neutron] 10.222.0.125 "GET /v2.0/networks/090fd7f3-a18b-4f87-8a99-3b44b4246940?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1270087
May 25 18:04:37.550553 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-e06d6af4-7256-413d-9e43-ebc49b0dd346 req-08a59bab-ca2e-4bf1-bdec-63d924f1b277 service neutron] 10.222.0.125 "GET /v2.0/networks/090fd7f3-a18b-4f87-8a99-3b44b4246940?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1873145
May 25 18:04:37.572726 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87bc5330-6309-4337-b1a2-762ca024c288 req-b7a26fe4-b1b0-460b-a2da-595df644c6ee tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:04:37.574259 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-87bc5330-6309-4337-b1a2-762ca024c288 req-b7a26fe4-b1b0-460b-a2da-595df644c6ee tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] 10.222.0.122 "GET /v2.0/ports?device_id=c0b23942-c764-49f0-8d10-7bc43ea87762 HTTP/1.1" status: 200  len: 944 time: 0.1217883
May 25 18:04:37.622308 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-87bc5330-6309-4337-b1a2-762ca024c288 req-a781fa2d-ba1c-4aaa-8a1e-bf66d218e5d3 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] 10.222.0.122 "GET /v2.0/security-groups?id=b4513a21-d3e8-4c1a-aeb6-0f0a81d9b6fc&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0424643
May 25 18:04:38.805844 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01ebeb50-cd84-43b4-a174-e4ad955ba430 req-4404b853-fdb1-453b-a626-fb5892e279d6 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:04:38.807205 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-01ebeb50-cd84-43b4-a174-e4ad955ba430 req-4404b853-fdb1-453b-a626-fb5892e279d6 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] 10.222.0.122 "GET /v2.0/ports?device_id=c0b23942-c764-49f0-8d10-7bc43ea87762 HTTP/1.1" status: 200  len: 944 time: 0.0798726
May 25 18:04:38.850483 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-01ebeb50-cd84-43b4-a174-e4ad955ba430 req-fbbfa643-3e79-402d-8e2a-66f673868df9 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] 10.222.0.122 "GET /v2.0/security-groups?id=b4513a21-d3e8-4c1a-aeb6-0f0a81d9b6fc&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0375388
May 25 18:04:39.169858 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Device dbe9952b-6e6c-4570-9afe-61d4e93fd243 details requested by agent hyperv_hv-cinder-78956 with host hv-cinder-78956 {{(pid=99028) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 25 18:04:39.311302 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] For port dbe9952b-6e6c-4570-9afe-61d4e93fd243, host hv-cinder-78956, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=dbe9952b-6e6c-4570-9afe-61d4e93fd243,segment=NetworkSegment(93782525-dc52-4ed6-9f23-535aff326ca7),segment_id=93782525-dc52-4ed6-9f23-535aff326ca7)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 18:04:39.328106 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Returning: {'device': 'dbe9952b-6e6c-4570-9afe-61d4e93fd243', 'network_id': '090fd7f3-a18b-4f87-8a99-3b44b4246940', 'port_id': 'dbe9952b-6e6c-4570-9afe-61d4e93fd243', 'mac_address': 'fa:16:3e:13:5f:75', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1347, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '47a0e259-7f9c-4368-a9d5-a6a33d57bda6', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=99028) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 25 18:04:39.381843 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:39.399241 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.notifiers.nova [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id dbe9952b-6e6c-4570-9afe-61d4e93fd243 {{(pid=99028) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 25 18:04:39.414452 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] For port dbe9952b-6e6c-4570-9afe-61d4e93fd243, host hv-cinder-78956, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=dbe9952b-6e6c-4570-9afe-61d4e93fd243,segment=NetworkSegment(93782525-dc52-4ed6-9f23-535aff326ca7),segment_id=93782525-dc52-4ed6-9f23-535aff326ca7)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 18:04:39.491038 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:39.493697 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-59fd63d7-e8a8-4884-b762-b9a1f7fd1111 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:04:39.559526 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Pushing event updated for resources: {'Port': ['ID=dbe9952b-6e6c-4570-9afe-61d4e93fd243,revision_number=4']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:04:39.562622 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.069s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:04:39.747073 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] get_ports_and_sgs() called for port_ids ['dbe9952b-6e6c-4570-9afe-61d4e93fd243'] {{(pid=99028) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 25 18:04:40.037557 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ce8df5f-0333-4c47-9def-d335fde27a92 req-daccdde7-561f-4c25-91e6-7635bce57c58 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:04:40.039729 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-8ce8df5f-0333-4c47-9def-d335fde27a92 req-daccdde7-561f-4c25-91e6-7635bce57c58 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] 10.222.0.122 "GET /v2.0/ports?device_id=c0b23942-c764-49f0-8d10-7bc43ea87762 HTTP/1.1" status: 200  len: 945 time: 0.0833352
May 25 18:04:40.091616 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-8ce8df5f-0333-4c47-9def-d335fde27a92 req-d3ca8c75-3b68-4b6d-9d6d-261c69c5e391 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] 10.222.0.122 "GET /v2.0/security-groups?id=b4513a21-d3e8-4c1a-aeb6-0f0a81d9b6fc&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0459635
May 25 18:04:40.529737 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 52276) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 18:04:40.644881 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-f0b3e1fe-5d12-4aad-9212-4c63143abb0a admin admin] Notify callbacks [] for security_group, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:40.658782 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-f0b3e1fe-5d12-4aad-9212-4c63143abb0a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 18:04:40.662594 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-f0b3e1fe-5d12-4aad-9212-4c63143abb0a admin admin] Usage tracker for resource:security_group_rule and tenant:be14fe1dd1a149f3add7c528bbc5c3e9 is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 18:04:40.665491 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-f0b3e1fe-5d12-4aad-9212-4c63143abb0a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 18:04:40.671172 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-f0b3e1fe-5d12-4aad-9212-4c63143abb0a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 18:04:40.756236 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-f0b3e1fe-5d12-4aad-9212-4c63143abb0a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:40.793883 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-f0b3e1fe-5d12-4aad-9212-4c63143abb0a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:40.800869 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-eb4c9589-7466-4222-b508-1c440d9cf4c7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:04:40.839893 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0b3e1fe-5d12-4aad-9212-4c63143abb0a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=47ef8473-a415-4f05-9e41-c8cfa1e936b6,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:04:40.844076 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-f0b3e1fe-5d12-4aad-9212-4c63143abb0a admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=be14fe1dd1a149f3add7c528bbc5c3e9&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3133538
May 25 18:04:40.844929 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-f0b3e1fe-5d12-4aad-9212-4c63143abb0a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:04:40.846642 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 52282) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 18:04:40.904507 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-f6e41589-7f6e-4e70-913c-931c814371c5 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:40.929324 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-f6e41589-7f6e-4e70-913c-931c814371c5 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:41.056886 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-f6e41589-7f6e-4e70-913c-931c814371c5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:41.060503 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-17717ac1-2a96-4340-a48e-d1f298104e8e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:04:41.072308 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6e41589-7f6e-4e70-913c-931c814371c5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=47ef8473-a415-4f05-9e41-c8cfa1e936b6,revision_number=None']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:04:41.075779 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-f6e41589-7f6e-4e70-913c-931c814371c5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:04:41.080329 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-f6e41589-7f6e-4e70-913c-931c814371c5 admin admin] Notify callbacks [] for security_group, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:41.080329 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-f6e41589-7f6e-4e70-913c-931c814371c5 admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/47ef8473-a415-4f05-9e41-c8cfa1e936b6 HTTP/1.1" status: 204  len: 168 time: 0.2326136
May 25 18:04:41.184239 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Device dbe9952b-6e6c-4570-9afe-61d4e93fd243 up at agent hyperv_hv-cinder-78956 {{(pid=99028) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 18:04:41.295338 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3947e0e3-c2ff-4174-9477-c455a4fa8a4b req-4735fb2b-1c52-47bf-848f-25392296c491 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:04:41.296801 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-3947e0e3-c2ff-4174-9477-c455a4fa8a4b req-4735fb2b-1c52-47bf-848f-25392296c491 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] 10.222.0.122 "GET /v2.0/ports?device_id=c0b23942-c764-49f0-8d10-7bc43ea87762 HTTP/1.1" status: 200  len: 945 time: 0.0971642
May 25 18:04:41.343616 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-3947e0e3-c2ff-4174-9477-c455a4fa8a4b req-f3b31813-fe00-4a32-b8f8-9585d392ab44 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] 10.222.0.122 "GET /v2.0/security-groups?id=b4513a21-d3e8-4c1a-aeb6-0f0a81d9b6fc&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0408964
May 25 18:04:41.360562 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Provisioning for port dbe9952b-6e6c-4570-9afe-61d4e93fd243 completed by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 18:04:41.368494 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Provisioning complete for port dbe9952b-6e6c-4570-9afe-61d4e93fd243 triggered by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 18:04:41.368880 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:41.488630 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:41.517292 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c0b23942-c764-49f0-8d10-7bc43ea87762', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'dbe9952b-6e6c-4570-9afe-61d4e93fd243'}] {{(pid=99028) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 18:04:41.527771 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] For port dbe9952b-6e6c-4570-9afe-61d4e93fd243, host hv-cinder-78956, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=dbe9952b-6e6c-4570-9afe-61d4e93fd243,segment=NetworkSegment(93782525-dc52-4ed6-9f23-535aff326ca7),segment_id=93782525-dc52-4ed6-9f23-535aff326ca7)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 18:04:41.561758 dv-cinder-789564-2-iscsi neutron-server[99028]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c0b23942-c764-49f0-8d10-7bc43ea87762', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'dbe9952b-6e6c-4570-9afe-61d4e93fd243', 'code': 200}
May 25 18:04:41.611220 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:41.613772 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:04:41.691669 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Pushing event updated for resources: {'Port': ['ID=dbe9952b-6e6c-4570-9afe-61d4e93fd243,revision_number=5']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:04:41.694842 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:04:41.748223 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:42.054589 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05afa722-f49f-4519-9d0a-40e1303519de req-4e5d24d5-2df9-4d93-9a42-044fab2129ef service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:04:42.056024 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-05afa722-f49f-4519-9d0a-40e1303519de req-4e5d24d5-2df9-4d93-9a42-044fab2129ef service neutron] 10.222.0.125 "GET /v2.0/ports?device_id=c0b23942-c764-49f0-8d10-7bc43ea87762 HTTP/1.1" status: 200  len: 1099 time: 0.1690226
May 25 18:04:42.105644 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-05afa722-f49f-4519-9d0a-40e1303519de req-80256eca-219b-4e14-a227-a7c047c67970 service neutron] 10.222.0.125 "GET /v2.0/security-groups?id=b4513a21-d3e8-4c1a-aeb6-0f0a81d9b6fc&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0413404
May 25 18:04:42.528105 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73ef6b27-920c-4dbd-ad3b-22e2663831f2 req-dcd8868c-a9eb-424d-917a-816d88985b6c tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:04:42.529615 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-73ef6b27-920c-4dbd-ad3b-22e2663831f2 req-dcd8868c-a9eb-424d-917a-816d88985b6c tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] 10.222.0.122 "GET /v2.0/ports?device_id=c0b23942-c764-49f0-8d10-7bc43ea87762 HTTP/1.1" status: 200  len: 946 time: 0.0807343
May 25 18:04:42.575828 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-73ef6b27-920c-4dbd-ad3b-22e2663831f2 req-f7a44dc8-d594-41f3-b9e9-34001e5305de tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] 10.222.0.122 "GET /v2.0/security-groups?id=b4513a21-d3e8-4c1a-aeb6-0f0a81d9b6fc&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0403624
May 25 18:04:42.767865 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 52320) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 18:04:42.887143 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-f4a22f33-785a-43b4-8114-02cc83a6fec6 admin admin] Notify callbacks [] for security_group, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:42.901859 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-f4a22f33-785a-43b4-8114-02cc83a6fec6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 18:04:42.905602 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-f4a22f33-785a-43b4-8114-02cc83a6fec6 admin admin] Usage tracker for resource:security_group_rule and tenant:fb399dde73c34e0d806067f3aa4f059d is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 18:04:42.908346 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-f4a22f33-785a-43b4-8114-02cc83a6fec6 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 18:04:42.914674 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-f4a22f33-785a-43b4-8114-02cc83a6fec6 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 18:04:42.998792 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-f4a22f33-785a-43b4-8114-02cc83a6fec6 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:43.050648 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-f4a22f33-785a-43b4-8114-02cc83a6fec6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:43.058305 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-a1358841-2cc1-40e9-92a2-f065a104dac8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:04:43.102456 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-f4a22f33-785a-43b4-8114-02cc83a6fec6 admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=fb399dde73c34e0d806067f3aa4f059d&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3335278
May 25 18:04:43.103329 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4a22f33-785a-43b4-8114-02cc83a6fec6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ad6b44d7-e70a-4488-8766-de46b491179e,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:04:43.105224 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 52326) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 18:04:43.106504 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-f4a22f33-785a-43b4-8114-02cc83a6fec6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:04:43.166930 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-0e20fcc2-9acb-4f52-8233-796b8ffe471e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:43.191779 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-0e20fcc2-9acb-4f52-8233-796b8ffe471e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:43.325655 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-0e20fcc2-9acb-4f52-8233-796b8ffe471e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:43.329746 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-d5699fb7-183b-4d92-a9f6-7ca797f406bc admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:04:43.341227 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e20fcc2-9acb-4f52-8233-796b8ffe471e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ad6b44d7-e70a-4488-8766-de46b491179e,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:04:43.343639 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-0e20fcc2-9acb-4f52-8233-796b8ffe471e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.014s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:04:43.349673 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-0e20fcc2-9acb-4f52-8233-796b8ffe471e admin admin] Notify callbacks [] for security_group, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:43.350766 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-0e20fcc2-9acb-4f52-8233-796b8ffe471e admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/ad6b44d7-e70a-4488-8766-de46b491179e HTTP/1.1" status: 204  len: 168 time: 0.2445524
May 25 18:04:43.773337 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8650fd42-c0b0-4082-bfcb-a5cbba7f45fd req-e4910423-20bd-4ca1-901d-44635cc5d959 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:04:43.774820 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-8650fd42-c0b0-4082-bfcb-a5cbba7f45fd req-e4910423-20bd-4ca1-901d-44635cc5d959 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] 10.222.0.122 "GET /v2.0/ports?device_id=c0b23942-c764-49f0-8d10-7bc43ea87762 HTTP/1.1" status: 200  len: 946 time: 0.0846314
May 25 18:04:43.819793 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-8650fd42-c0b0-4082-bfcb-a5cbba7f45fd req-f57fc9f2-496d-4413-8727-405aa59a4e61 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] 10.222.0.122 "GET /v2.0/security-groups?id=b4513a21-d3e8-4c1a-aeb6-0f0a81d9b6fc&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0392973
May 25 18:04:45.592889 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc9197c2-53e1-4a76-8beb-cd8cda5f65b7 req-3ff5ee03-b1d6-45fe-89b7-c450b9cd8b91 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:04:45.594276 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-bc9197c2-53e1-4a76-8beb-cd8cda5f65b7 req-3ff5ee03-b1d6-45fe-89b7-c450b9cd8b91 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] 10.222.0.122 "GET /v2.0/ports?device_id=c0b23942-c764-49f0-8d10-7bc43ea87762 HTTP/1.1" status: 200  len: 946 time: 0.0845563
May 25 18:04:45.638408 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-bc9197c2-53e1-4a76-8beb-cd8cda5f65b7 req-10458111-bb35-4b3b-b7f2-c44e66d828b6 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] 10.222.0.122 "GET /v2.0/security-groups?id=b4513a21-d3e8-4c1a-aeb6-0f0a81d9b6fc&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0385063
May 25 18:04:46.604363 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdad590f-c07e-4117-adf9-98a56410c97d req-9d5ceaef-c19e-4ce1-8bef-5307b4f97c26 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:04:46.605791 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-fdad590f-c07e-4117-adf9-98a56410c97d req-9d5ceaef-c19e-4ce1-8bef-5307b4f97c26 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] 10.222.0.125 "GET /v2.0/ports?device_id=c0b23942-c764-49f0-8d10-7bc43ea87762 HTTP/1.1" status: 200  len: 946 time: 0.0800934
May 25 18:04:46.745131 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.plugin [req-fdad590f-c07e-4117-adf9-98a56410c97d req-2e3e403d-3d1d-4dfd-95b7-7a027d13c49d tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] Deleting port dbe9952b-6e6c-4570-9afe-61d4e93fd243 {{(pid=99027) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 18:04:46.745432 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-fdad590f-c07e-4117-adf9-98a56410c97d req-2e3e403d-3d1d-4dfd-95b7-7a027d13c49d tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781841220419'] for port, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:46.833436 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c294e0e-9a32-47ac-b7b8-41294e68494f req-df814812-b61c-4277-8b2a-5f0de30a056f tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:04:46.834911 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-4c294e0e-9a32-47ac-b7b8-41294e68494f req-df814812-b61c-4277-8b2a-5f0de30a056f tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] 10.222.0.122 "GET /v2.0/ports?device_id=c0b23942-c764-49f0-8d10-7bc43ea87762 HTTP/1.1" status: 200  len: 946 time: 0.0858588
May 25 18:04:46.880514 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.db [req-fdad590f-c07e-4117-adf9-98a56410c97d req-2e3e403d-3d1d-4dfd-95b7-7a027d13c49d tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] For port dbe9952b-6e6c-4570-9afe-61d4e93fd243, host hv-cinder-78956, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=dbe9952b-6e6c-4570-9afe-61d4e93fd243,segment=NetworkSegment(93782525-dc52-4ed6-9f23-535aff326ca7),segment_id=93782525-dc52-4ed6-9f23-535aff326ca7)] {{(pid=99027) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 18:04:46.880736 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-4c294e0e-9a32-47ac-b7b8-41294e68494f req-b10ea472-a7d7-434d-85a6-29152feee38a tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] 10.222.0.122 "GET /v2.0/security-groups?id=b4513a21-d3e8-4c1a-aeb6-0f0a81d9b6fc&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0389872
May 25 18:04:46.880945 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-fdad590f-c07e-4117-adf9-98a56410c97d req-2e3e403d-3d1d-4dfd-95b7-7a027d13c49d tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-418810'] for port, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:47.004818 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.plugin [req-fdad590f-c07e-4117-adf9-98a56410c97d req-2e3e403d-3d1d-4dfd-95b7-7a027d13c49d tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] Calling delete_port for dbe9952b-6e6c-4570-9afe-61d4e93fd243 owned by compute:nova {{(pid=99027) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 18:04:47.165437 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-fdad590f-c07e-4117-adf9-98a56410c97d req-2e3e403d-3d1d-4dfd-95b7-7a027d13c49d tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781841222566', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781840788188', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15468986'] for port, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:47.170865 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-77b2d102-b3a1-4ec8-9eab-235e80503e85 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:04:47.216554 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e3e403d-3d1d-4dfd-95b7-7a027d13c49d tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] Pushing event deleted for resources: {'Port': ['ID=dbe9952b-6e6c-4570-9afe-61d4e93fd243,revision_number=None']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:04:47.219458 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-2e3e403d-3d1d-4dfd-95b7-7a027d13c49d tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:04:47.299569 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.l3_dvrscheduler_db [req-fdad590f-c07e-4117-adf9-98a56410c97d req-2e3e403d-3d1d-4dfd-95b7-7a027d13c49d tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] No DVR routers for this DVR port dbe9952b-6e6c-4570-9afe-61d4e93fd243 on host hv-cinder-78956 {{(pid=99027) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 25 18:04:47.302036 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-fdad590f-c07e-4117-adf9-98a56410c97d req-2e3e403d-3d1d-4dfd-95b7-7a027d13c49d tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-239387'] for port, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:47.305302 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c0b23942-c764-49f0-8d10-7bc43ea87762', 'name': 'network-vif-deleted', 'tag': 'dbe9952b-6e6c-4570-9afe-61d4e93fd243'}] {{(pid=99027) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 18:04:47.349372 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c0b23942-c764-49f0-8d10-7bc43ea87762', 'name': 'network-vif-deleted', 'tag': 'dbe9952b-6e6c-4570-9afe-61d4e93fd243', 'status': 'completed', 'code': 200}
May 25 18:04:47.377477 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-fdad590f-c07e-4117-adf9-98a56410c97d req-2e3e403d-3d1d-4dfd-95b7-7a027d13c49d tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] 10.222.0.125 "DELETE /v2.0/ports/dbe9952b-6e6c-4570-9afe-61d4e93fd243 HTTP/1.1" status: 204  len: 173 time: 0.7679062
May 25 18:04:48.152765 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-723f428b-3f09-4407-b900-1d0c85200419 req-d5837916-299d-481d-bc04-e1a74357b06a tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] 10.222.0.122 "GET /v2.0/ports?device_id=c0b23942-c764-49f0-8d10-7bc43ea87762 HTTP/1.1" status: 200  len: 210 time: 0.1526005
May 25 18:04:48.154063 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-660baea5-45b7-4ce1-9125-fe310e6efb00 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:49.245501 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Device dbe9952b-6e6c-4570-9afe-61d4e93fd243 no longer exists at agent hyperv_hv-cinder-78956 {{(pid=99028) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 18:04:49.288097 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.plugin [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] No Port match for: dbe9952b-6e6c-4570-9afe-61d4e93fd243 {{(pid=99028) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 25 18:04:49.289037 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Device dbe9952b-6e6c-4570-9afe-61d4e93fd243 not bound to the agent host hv-cinder-78956 {{(pid=99028) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 25 18:04:49.756426 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.agents_db [None req-14fae233-15dc-4576-836b-621c5f95b584 None None] Agent healthcheck: found 6 active agents {{(pid=99029) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 18:04:50.667512 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4d830cfd-4e8e-49f5-b9b9-4aa63b9c9adf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:50.850405 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:51.781714 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-7e261f94-b84f-443e-be49-3bc1ac903b55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:04:53.358844 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-6df2b2a7-a54e-4d57-9be3-033078b9d5b3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:11.775201 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:14.992878 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 52582) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 18:05:15.051605 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.db_base_plugin_v2 [None req-0baddebb-fa6c-42a6-be10-9d7f4172a1ec admin admin] Deleting subnet 47a0e259-7f9c-4368-a9d5-a6a33d57bda6 {{(pid=99026) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 25 18:05:15.054573 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-0baddebb-fa6c-42a6-be10-9d7f4172a1ec admin admin] Notify callbacks [] for subnet, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:15.104653 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-0baddebb-fa6c-42a6-be10-9d7f4172a1ec admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-14735050'] for subnet, precommit_delete_associations {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:15.158367 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-0baddebb-fa6c-42a6-be10-9d7f4172a1ec admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1474503'] for subnet, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:15.478131 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-0baddebb-fa6c-42a6-be10-9d7f4172a1ec admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1473138', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114466', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-15477963', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-14794250'] for subnet, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:15.482050 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-31ba91b4-270a-4ff5-85fd-306cd0869807 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:05:15.517182 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0baddebb-fa6c-42a6-be10-9d7f4172a1ec admin admin] Pushing event deleted for resources: {'Subnet': ['ID=47a0e259-7f9c-4368-a9d5-a6a33d57bda6,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:05:15.519646 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-0baddebb-fa6c-42a6-be10-9d7f4172a1ec admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:05:15.523611 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-0baddebb-fa6c-42a6-be10-9d7f4172a1ec admin admin] Notify callbacks [] for subnet, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:15.531984 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-0baddebb-fa6c-42a6-be10-9d7f4172a1ec admin admin] 10.222.0.122 "DELETE /v2.0/subnets/47a0e259-7f9c-4368-a9d5-a6a33d57bda6 HTTP/1.1" status: 204  len: 168 time: 0.5379269
May 25 18:05:15.534491 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 52586) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 18:05:15.650446 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-e3fdf594-3508-4619-b4ca-274e4325f126 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1492659'] for network, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:15.772171 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-e3fdf594-3508-4619-b4ca-274e4325f126 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1470792', 'neutron.services.segments.db._delete_segments_for_network-8781841233116'] for network, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:15.784435 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.services.segments.db [None req-e3fdf594-3508-4619-b4ca-274e4325f126 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fcae6b38dc0>,) {'filters': {'network_id': ['090fd7f3-a18b-4f87-8a99-3b44b4246940']}} {{(pid=99027) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 18:05:15.796235 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.services.segments.db [None req-e3fdf594-3508-4619-b4ca-274e4325f126 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fcae6b38dc0>, '93782525-dc52-4ed6-9f23-535aff326ca7') {'for_net_delete': True} {{(pid=99027) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 18:05:15.796524 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.services.segments.db [None req-e3fdf594-3508-4619-b4ca-274e4325f126 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fcae6b38dc0>, '93782525-dc52-4ed6-9f23-535aff326ca7') {} {{(pid=99027) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 18:05:15.808185 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-e3fdf594-3508-4619-b4ca-274e4325f126 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8781841242525', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-15628874'] for segment, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:15.824184 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-e3fdf594-3508-4619-b4ca-274e4325f126 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1469168'] for segment, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:15.830068 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e3fdf594-3508-4619-b4ca-274e4325f126 admin admin] Releasing vlan 1347 on physical network physnet1 to pool {{(pid=99027) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 25 18:05:15.830438 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-e3fdf594-3508-4619-b4ca-274e4325f126 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1469168', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-15469039'] for segment, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:15.843113 dv-cinder-789564-2-iscsi neutron-server[99027]: Traceback (most recent call last):
May 25 18:05:15.843113 dv-cinder-789564-2-iscsi neutron-server[99027]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 25 18:05:15.843113 dv-cinder-789564-2-iscsi neutron-server[99027]:     timer()
May 25 18:05:15.843113 dv-cinder-789564-2-iscsi neutron-server[99027]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 25 18:05:15.843113 dv-cinder-789564-2-iscsi neutron-server[99027]:     cb(*args, **kw)
May 25 18:05:15.843113 dv-cinder-789564-2-iscsi neutron-server[99027]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 25 18:05:15.843113 dv-cinder-789564-2-iscsi neutron-server[99027]:     return func(*args, **kwargs)
May 25 18:05:15.843113 dv-cinder-789564-2-iscsi neutron-server[99027]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 25 18:05:15.843113 dv-cinder-789564-2-iscsi neutron-server[99027]:     self._notify()
May 25 18:05:15.843113 dv-cinder-789564-2-iscsi neutron-server[99027]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 25 18:05:15.843113 dv-cinder-789564-2-iscsi neutron-server[99027]:     self.callback(batched_events)
May 25 18:05:15.843113 dv-cinder-789564-2-iscsi neutron-server[99027]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 25 18:05:15.843113 dv-cinder-789564-2-iscsi neutron-server[99027]:     event.method(event)
May 25 18:05:15.843113 dv-cinder-789564-2-iscsi neutron-server[99027]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 25 18:05:15.843113 dv-cinder-789564-2-iscsi neutron-server[99027]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 25 18:05:15.843113 dv-cinder-789564-2-iscsi neutron-server[99027]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 25 18:05:15.843113 dv-cinder-789564-2-iscsi neutron-server[99027]:     aggregate_uuid = self.p_client.list_aggregates(
May 25 18:05:15.843113 dv-cinder-789564-2-iscsi neutron-server[99027]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 25 18:05:15.843113 dv-cinder-789564-2-iscsi neutron-server[99027]:     return f(self, *a, **k)
May 25 18:05:15.843113 dv-cinder-789564-2-iscsi neutron-server[99027]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 25 18:05:15.843113 dv-cinder-789564-2-iscsi neutron-server[99027]:     return self._get(url).json()
May 25 18:05:15.843113 dv-cinder-789564-2-iscsi neutron-server[99027]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 25 18:05:15.843113 dv-cinder-789564-2-iscsi neutron-server[99027]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 25 18:05:15.843113 dv-cinder-789564-2-iscsi neutron-server[99027]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 25 18:05:15.843113 dv-cinder-789564-2-iscsi neutron-server[99027]:     return self.request(url, 'GET', **kwargs)
May 25 18:05:15.843113 dv-cinder-789564-2-iscsi neutron-server[99027]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 25 18:05:15.843113 dv-cinder-789564-2-iscsi neutron-server[99027]:     base_url = self.get_endpoint(auth, allow=allow,
May 25 18:05:15.843113 dv-cinder-789564-2-iscsi neutron-server[99027]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 25 18:05:15.843113 dv-cinder-789564-2-iscsi neutron-server[99027]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 25 18:05:15.843113 dv-cinder-789564-2-iscsi neutron-server[99027]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 25 18:05:15.843113 dv-cinder-789564-2-iscsi neutron-server[99027]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 25 18:05:15.843113 dv-cinder-789564-2-iscsi neutron-server[99027]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 25 18:05:16.002991 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-e3fdf594-3508-4619-b4ca-274e4325f126 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1470785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-459299', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551400', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-419883'] for network, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:16.007290 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-29159b5c-3599-4493-b465-bbf36028fd93 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:05:16.020236 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-e3fdf594-3508-4619-b4ca-274e4325f126 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for network, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:16.030267 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3fdf594-3508-4619-b4ca-274e4325f126 admin admin] Pushing event deleted for resources: {'Network': ['ID=090fd7f3-a18b-4f87-8a99-3b44b4246940,revision_number=None']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:05:16.039910 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e3fdf594-3508-4619-b4ca-274e4325f126 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:05:16.040265 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e3fdf594-3508-4619-b4ca-274e4325f126 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:05:16.040624 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e3fdf594-3508-4619-b4ca-274e4325f126 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:05:16.040979 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e3fdf594-3508-4619-b4ca-274e4325f126 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:05:16.041359 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e3fdf594-3508-4619-b4ca-274e4325f126 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:05:16.041711 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e3fdf594-3508-4619-b4ca-274e4325f126 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:05:16.042060 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e3fdf594-3508-4619-b4ca-274e4325f126 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:05:16.042466 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e3fdf594-3508-4619-b4ca-274e4325f126 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:05:16.042789 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e3fdf594-3508-4619-b4ca-274e4325f126 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:05:16.043128 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e3fdf594-3508-4619-b4ca-274e4325f126 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:05:16.043466 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e3fdf594-3508-4619-b4ca-274e4325f126 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:05:16.043805 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e3fdf594-3508-4619-b4ca-274e4325f126 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:05:16.046831 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-e3fdf594-3508-4619-b4ca-274e4325f126 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:05:16.101765 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-e3fdf594-3508-4619-b4ca-274e4325f126 admin admin] 10.222.0.122 "DELETE /v2.0/networks/090fd7f3-a18b-4f87-8a99-3b44b4246940 HTTP/1.1" status: 204  len: 168 time: 0.5662637
May 25 18:05:16.537399 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 52592) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 18:05:16.590658 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-ed8dfc6a-774d-44dd-af7c-ffb9a2e310ad admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=7f01d1004d594d59b86b0f13610a009d&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0513232
May 25 18:05:16.593550 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 52596) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 18:05:16.651447 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-46255549-2b5e-49e3-9dac-6efc0ebaaae0 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:16.680994 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-46255549-2b5e-49e3-9dac-6efc0ebaaae0 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:16.912053 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-46255549-2b5e-49e3-9dac-6efc0ebaaae0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:16.915866 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-c5568da2-d3c6-4199-baad-51eaf92dcf9d tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:05:16.930168 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46255549-2b5e-49e3-9dac-6efc0ebaaae0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b4513a21-d3e8-4c1a-aeb6-0f0a81d9b6fc,revision_number=None']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:05:16.932847 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-46255549-2b5e-49e3-9dac-6efc0ebaaae0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:05:17.013905 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-46255549-2b5e-49e3-9dac-6efc0ebaaae0 admin admin] Notify callbacks [] for security_group, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:17.015023 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-46255549-2b5e-49e3-9dac-6efc0ebaaae0 admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/b4513a21-d3e8-4c1a-aeb6-0f0a81d9b6fc HTTP/1.1" status: 204  len: 168 time: 0.4205909
May 25 18:05:18.171722 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 52620) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 18:05:18.175059 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-67084f9b-d1d3-419f-a40b-baf52f718cab None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:18.276680 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.v2.base [None req-325cb4fc-115a-4fad-8671-c8bddf4a2d48 admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-1659174020-network', 'tenant_id': '6964ff917bfd44b1b1eca0a430c6cf1a'}} {{(pid=99027) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 18:05:18.281687 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-325cb4fc-115a-4fad-8671-c8bddf4a2d48 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 18:05:18.285572 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-325cb4fc-115a-4fad-8671-c8bddf4a2d48 admin admin] Usage tracker for resource:network and tenant:6964ff917bfd44b1b1eca0a430c6cf1a is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 18:05:18.288396 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-325cb4fc-115a-4fad-8671-c8bddf4a2d48 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 18:05:18.294938 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-325cb4fc-115a-4fad-8671-c8bddf4a2d48 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 18:05:18.386625 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-325cb4fc-115a-4fad-8671-c8bddf4a2d48 admin admin] Made reservation on behalf of 6964ff917bfd44b1b1eca0a430c6cf1a for: {'network': 1} {{(pid=99027) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 18:05:18.388817 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-325cb4fc-115a-4fad-8671-c8bddf4a2d48 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-1465344'] for network, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:18.402666 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-325cb4fc-115a-4fad-8671-c8bddf4a2d48 admin admin] Notify callbacks [] for security_group, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:18.416806 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-325cb4fc-115a-4fad-8671-c8bddf4a2d48 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 18:05:18.420599 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-325cb4fc-115a-4fad-8671-c8bddf4a2d48 admin admin] Usage tracker for resource:security_group_rule and tenant:6964ff917bfd44b1b1eca0a430c6cf1a is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 18:05:18.423384 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-325cb4fc-115a-4fad-8671-c8bddf4a2d48 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 18:05:18.429240 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-325cb4fc-115a-4fad-8671-c8bddf4a2d48 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 18:05:18.512389 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-325cb4fc-115a-4fad-8671-c8bddf4a2d48 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:18.620134 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-325cb4fc-115a-4fad-8671-c8bddf4a2d48 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:18.623131 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-a762f6fd-5cc4-4bb1-8b5c-4a3de84b1f2a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:05:18.651494 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-325cb4fc-115a-4fad-8671-c8bddf4a2d48 admin admin] vlan segment allocate from pool success with {'vlan_id': 1307, 'physical_network': 'physnet1'}  {{(pid=99027) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 25 18:05:18.660091 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-325cb4fc-115a-4fad-8671-c8bddf4a2d48 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d58a7933-8361-40fa-9837-e332b7361c61,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:05:18.664303 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-325cb4fc-115a-4fad-8671-c8bddf4a2d48 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.041s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:05:18.666971 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-325cb4fc-115a-4fad-8671-c8bddf4a2d48 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1469168'] for segment, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:18.667305 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.db.segments_db [None req-325cb4fc-115a-4fad-8671-c8bddf4a2d48 admin admin] Added segment 2abbf128-e5e5-4349-af70-f8887ef58b0f of type vlan for network 66e6b1a7-3352-49c8-951e-25e4133a13bb
May 25 18:05:18.692734 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-325cb4fc-115a-4fad-8671-c8bddf4a2d48 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8781840806997'] for network, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:18.843474 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-325cb4fc-115a-4fad-8671-c8bddf4a2d48 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-459299', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551400'] for network, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:18.844836 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-325cb4fc-115a-4fad-8671-c8bddf4a2d48 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:05:18.845445 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-325cb4fc-115a-4fad-8671-c8bddf4a2d48 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for network, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:18.851047 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-61bad660-4409-4b35-8053-b5331f0a750e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:05:18.949804 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-325cb4fc-115a-4fad-8671-c8bddf4a2d48 admin admin] Pushing event updated for resources: {'Network': ['ID=66e6b1a7-3352-49c8-951e-25e4133a13bb,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:05:18.952291 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-325cb4fc-115a-4fad-8671-c8bddf4a2d48 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.101s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:05:18.959923 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Network 66e6b1a7-3352-49c8-951e-25e4133a13bb details requested by agent ovs-agent-dv-cinder-789564-2-iscsi with host dv-cinder-789564-2-iscsi {{(pid=99028) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 25 18:05:19.038594 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-325cb4fc-115a-4fad-8671-c8bddf4a2d48 admin admin] 10.222.0.122 "POST /v2.0/networks HTTP/1.1" status: 201  len: 886 time: 0.8657477
May 25 18:05:19.041382 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 52626) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 18:05:19.047391 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.v2.base [None req-1cff2a03-ac0e-4d78-9a53-20ca3f66d88a admin admin] Request body: {'subnet': {'network_id': '66e6b1a7-3352-49c8-951e-25e4133a13bb', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-1659174020-subnet', 'tenant_id': '6964ff917bfd44b1b1eca0a430c6cf1a', 'ip_version': 4}} {{(pid=99027) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 18:05:19.052176 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-1cff2a03-ac0e-4d78-9a53-20ca3f66d88a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 18:05:19.056645 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-1cff2a03-ac0e-4d78-9a53-20ca3f66d88a admin admin] Usage tracker for resource:subnet and tenant:6964ff917bfd44b1b1eca0a430c6cf1a is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 18:05:19.060090 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-1cff2a03-ac0e-4d78-9a53-20ca3f66d88a admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 18:05:19.066123 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-1cff2a03-ac0e-4d78-9a53-20ca3f66d88a admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 18:05:19.208757 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1cff2a03-ac0e-4d78-9a53-20ca3f66d88a admin admin] Made reservation on behalf of 6964ff917bfd44b1b1eca0a430c6cf1a for: {'subnet': 1} {{(pid=99027) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 18:05:19.211880 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-1cff2a03-ac0e-4d78-9a53-20ca3f66d88a admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-14778112'] for subnet, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:19.713801 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-1cff2a03-ac0e-4d78-9a53-20ca3f66d88a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114466', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-15467018', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-14778134'] for subnet, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:19.717516 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-a7abc5b9-d0c4-4b12-93d8-0c402f30c5ac admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:05:19.788402 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1cff2a03-ac0e-4d78-9a53-20ca3f66d88a admin admin] Pushing event updated for resources: {'Subnet': ['ID=7e40c2eb-fb3c-4338-9398-6fcd43705fa8,revision_number=0']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:05:19.792696 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-1cff2a03-ac0e-4d78-9a53-20ca3f66d88a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:05:19.801829 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1cff2a03-ac0e-4d78-9a53-20ca3f66d88a admin admin] Checking segment: {'id': '2abbf128-e5e5-4349-af70-f8887ef58b0f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1307, 'network_id': '66e6b1a7-3352-49c8-951e-25e4133a13bb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=99027) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 18:05:19.802179 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1cff2a03-ac0e-4d78-9a53-20ca3f66d88a admin admin] Network hostable DHCP agents. Network: 66e6b1a7-3352-49c8-951e-25e4133a13bb, hostable agents: ['c8b0a350-254b-4562-874b-120ecdef0e25'], hosted agents: [] {{(pid=99027) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 25 18:05:19.929677 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1cff2a03-ac0e-4d78-9a53-20ca3f66d88a admin admin] Network 66e6b1a7-3352-49c8-951e-25e4133a13bb is scheduled to be hosted by DHCP agent c8b0a350-254b-4562-874b-120ecdef0e25 with binding_index 1 {{(pid=99027) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 25 18:05:20.038103 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.base_scheduler [None req-1cff2a03-ac0e-4d78-9a53-20ca3f66d88a admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-789564-2-iscsi, 66e6b1a7-3352-49c8-951e-25e4133a13bb) {{(pid=99027) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 18:05:20.047512 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f55039e4-88e0-4fa2-84b4-7e0ec9952d66 None None] Network 66e6b1a7-3352-49c8-951e-25e4133a13bb requested from dv-cinder-789564-2-iscsi {{(pid=99028) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 18:05:20.047977 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1cff2a03-ac0e-4d78-9a53-20ca3f66d88a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:05:20.048269 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-1cff2a03-ac0e-4d78-9a53-20ca3f66d88a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for subnet, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:20.186911 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-1cff2a03-ac0e-4d78-9a53-20ca3f66d88a admin admin] 10.222.0.122 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 848 time: 1.1444688
May 25 18:05:20.189526 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 52630) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 18:05:20.194596 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.v2.base [None req-6dd9462c-4428-4a95-b9e4-be2f187bcbc9 admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-1659174020-router', 'tenant_id': '6964ff917bfd44b1b1eca0a430c6cf1a', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb'}}} {{(pid=99027) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 18:05:20.199338 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-6dd9462c-4428-4a95-b9e4-be2f187bcbc9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 18:05:20.203211 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-6dd9462c-4428-4a95-b9e4-be2f187bcbc9 admin admin] Usage tracker for resource:router and tenant:6964ff917bfd44b1b1eca0a430c6cf1a is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 18:05:20.206125 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-6dd9462c-4428-4a95-b9e4-be2f187bcbc9 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 18:05:20.212379 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-6dd9462c-4428-4a95-b9e4-be2f187bcbc9 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 18:05:20.265201 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d72651a3-1148-4acb-9a27-71c120c6978d None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpe415bc4a-81ee-5198-a7be-1f5e4adc5586-66e6b1a7-3352-49c8-951e-25e4133a13bb', 'network_id': '66e6b1a7-3352-49c8-951e-25e4133a13bb', 'tenant_id': '6964ff917bfd44b1b1eca0a430c6cf1a', 'fixed_ips': [{'subnet_id': '7e40c2eb-fb3c-4338-9398-6fcd43705fa8'}]}} from dv-cinder-789564-2-iscsi. {{(pid=99028) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
May 25 18:05:20.265201 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-d72651a3-1148-4acb-9a27-71c120c6978d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_create {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:20.294691 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-6dd9462c-4428-4a95-b9e4-be2f187bcbc9 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-415064', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-6983'] for router, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:20.295638 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-6dd9462c-4428-4a95-b9e4-be2f187bcbc9 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-414296', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-419975', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-491114', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-6988'] for router, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:20.310939 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-6dd9462c-4428-4a95-b9e4-be2f187bcbc9 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:20.415403 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.db_base_plugin_common [None req-d72651a3-1148-4acb-9a27-71c120c6978d None None] Allocated IP 172.20.0.2 (66e6b1a7-3352-49c8-951e-25e4133a13bb/7e40c2eb-fb3c-4338-9398-6fcd43705fa8/ecd5b317-fc50-4dd7-97b3-ff9cfdd800e8) {{(pid=99028) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 18:05:20.634860 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-d72651a3-1148-4acb-9a27-71c120c6978d None None] Notify callbacks [] for port, precommit_create {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:20.644846 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-d72651a3-1148-4acb-9a27-71c120c6978d None None] Transition to ACTIVE for port object ecd5b317-fc50-4dd7-97b3-ff9cfdd800e8 will not be triggered until provisioned by entity L2. {{(pid=99028) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 18:05:20.661017 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-6dd9462c-4428-4a95-b9e4-be2f187bcbc9 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-420002', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-415082', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-6970'] for router, precommit_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:20.663840 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-d72651a3-1148-4acb-9a27-71c120c6978d None None] Transition to ACTIVE for port object ecd5b317-fc50-4dd7-97b3-ff9cfdd800e8 will not be triggered until provisioned by entity DHCP. {{(pid=99028) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 18:05:20.734729 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-3104be2a-4ef4-45bf-b6a2-e7cfb57adc2a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:20.815426 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-d72651a3-1148-4acb-9a27-71c120c6978d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781840788179'] for port, after_create {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:20.821946 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-4f5d8397-5d69-4084-858a-c1856d72be07 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:05:20.884064 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d72651a3-1148-4acb-9a27-71c120c6978d None None] Network 66e6b1a7-3352-49c8-951e-25e4133a13bb is already hosted by enough agents. {{(pid=99028) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 18:05:20.885305 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.scheduler.base_scheduler [None req-d72651a3-1148-4acb-9a27-71c120c6978d None None] Resources bound (agent type, host, resource id):  {{(pid=99028) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 18:05:20.888938 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d72651a3-1148-4acb-9a27-71c120c6978d None None] Received port after_create {{(pid=99028) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 18:05:20.930012 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d72651a3-1148-4acb-9a27-71c120c6978d None None] Pushing event updated for resources: {'Port': ['ID=ecd5b317-fc50-4dd7-97b3-ff9cfdd800e8,revision_number=1']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:05:20.971839 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d72651a3-1148-4acb-9a27-71c120c6978d None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:05:20.972182 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d72651a3-1148-4acb-9a27-71c120c6978d None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:05:20.972514 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d72651a3-1148-4acb-9a27-71c120c6978d None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:05:20.972845 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d72651a3-1148-4acb-9a27-71c120c6978d None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:05:20.973196 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d72651a3-1148-4acb-9a27-71c120c6978d None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:05:20.973524 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d72651a3-1148-4acb-9a27-71c120c6978d None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:05:20.973846 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d72651a3-1148-4acb-9a27-71c120c6978d None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:05:20.974165 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d72651a3-1148-4acb-9a27-71c120c6978d None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:05:20.974526 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d72651a3-1148-4acb-9a27-71c120c6978d None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:05:20.974849 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d72651a3-1148-4acb-9a27-71c120c6978d None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:05:20.975162 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d72651a3-1148-4acb-9a27-71c120c6978d None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:05:20.975580 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d72651a3-1148-4acb-9a27-71c120c6978d None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:05:20.983051 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-d72651a3-1148-4acb-9a27-71c120c6978d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.161s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:05:20.991502 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:21.000965 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.managers [None req-d72651a3-1148-4acb-9a27-71c120c6978d None None] Attempting to bind port ecd5b317-fc50-4dd7-97b3-ff9cfdd800e8 on host dv-cinder-789564-2-iscsi for vnic_type normal with profile  {{(pid=99028) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 18:05:21.001370 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.managers [None req-d72651a3-1148-4acb-9a27-71c120c6978d None None] Attempting to bind port ecd5b317-fc50-4dd7-97b3-ff9cfdd800e8 by drivers openvswitch,hyperv on host dv-cinder-789564-2-iscsi at level 0 using segments [{'id': '2abbf128-e5e5-4349-af70-f8887ef58b0f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1307, 'network_id': '66e6b1a7-3352-49c8-951e-25e4133a13bb'}] {{(pid=99028) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 18:05:21.001735 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d72651a3-1148-4acb-9a27-71c120c6978d None None] Attempting to bind port ecd5b317-fc50-4dd7-97b3-ff9cfdd800e8 on network 66e6b1a7-3352-49c8-951e-25e4133a13bb {{(pid=99028) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 18:05:21.007634 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d72651a3-1148-4acb-9a27-71c120c6978d None None] Checking agent: {'id': '7bb67520-1e97-4ad9-9b97-101068bbe1a3', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-789564-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 17, 34, 21), 'started_at': datetime.datetime(2021, 5, 25, 17, 34, 51), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 18, 5, 21), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-789564-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=99028) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 18:05:21.008008 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d72651a3-1148-4acb-9a27-71c120c6978d None None] Checking segment: {'id': '2abbf128-e5e5-4349-af70-f8887ef58b0f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1307, 'network_id': '66e6b1a7-3352-49c8-951e-25e4133a13bb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=99028) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 18:05:21.008445 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-d72651a3-1148-4acb-9a27-71c120c6978d None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:21.008978 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d72651a3-1148-4acb-9a27-71c120c6978d None None] Bound using segment: {'id': '2abbf128-e5e5-4349-af70-f8887ef58b0f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1307, 'network_id': '66e6b1a7-3352-49c8-951e-25e4133a13bb'} {{(pid=99028) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 18:05:21.009333 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.managers [None req-d72651a3-1148-4acb-9a27-71c120c6978d None None] Bound port: ecd5b317-fc50-4dd7-97b3-ff9cfdd800e8, host: dv-cinder-789564-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '2abbf128-e5e5-4349-af70-f8887ef58b0f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1307, 'network_id': '66e6b1a7-3352-49c8-951e-25e4133a13bb'}}] {{(pid=99028) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 18:05:21.009697 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-d72651a3-1148-4acb-9a27-71c120c6978d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:21.085017 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-6dd9462c-4428-4a95-b9e4-be2f187bcbc9 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:21.096420 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-d72651a3-1148-4acb-9a27-71c120c6978d None None] For port ecd5b317-fc50-4dd7-97b3-ff9cfdd800e8, host dv-cinder-789564-2-iscsi, cleared binding levels {{(pid=99028) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 18:05:21.099804 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-d72651a3-1148-4acb-9a27-71c120c6978d None None] For port ecd5b317-fc50-4dd7-97b3-ff9cfdd800e8, host dv-cinder-789564-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=ecd5b317-fc50-4dd7-97b3-ff9cfdd800e8,segment=NetworkSegment(2abbf128-e5e5-4349-af70-f8887ef58b0f),segment_id=2abbf128-e5e5-4349-af70-f8887ef58b0f)] {{(pid=99028) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 18:05:21.209743 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-6dd9462c-4428-4a95-b9e4-be2f187bcbc9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:21.232167 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-d72651a3-1148-4acb-9a27-71c120c6978d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:21.235963 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:05:21.327655 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d72651a3-1148-4acb-9a27-71c120c6978d None None] Pushing event updated for resources: {'Port': ['ID=ecd5b317-fc50-4dd7-97b3-ff9cfdd800e8,revision_number=2']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:05:21.332542 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-d72651a3-1148-4acb-9a27-71c120c6978d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.097s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:05:21.352827 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.db_base_plugin_common [None req-6dd9462c-4428-4a95-b9e4-be2f187bcbc9 admin admin] Allocated IP 172.27.3.104 (eb7ec72b-a691-481b-8d7e-42c05e13a8cb/d6898f5f-da0b-4428-97b4-4cbe3e83caaa/c14ee1b8-5c0b-41af-875f-c2f8d16e0c25) {{(pid=99027) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 18:05:21.520452 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-6dd9462c-4428-4a95-b9e4-be2f187bcbc9 admin admin] Notify callbacks [] for port, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:21.637829 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-6dd9462c-4428-4a95-b9e4-be2f187bcbc9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781840788179', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15468986'] for port, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:21.641690 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-42862b33-c2cd-4d9c-a49d-a5655f3b7925 tempest-VolumesActionsTest-95065144 tempest-VolumesActionsTest-95065144-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:05:21.708722 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6dd9462c-4428-4a95-b9e4-be2f187bcbc9 admin admin] Network eb7ec72b-a691-481b-8d7e-42c05e13a8cb is already hosted by enough agents. {{(pid=99027) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 18:05:21.711960 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.base_scheduler [None req-6dd9462c-4428-4a95-b9e4-be2f187bcbc9 admin admin] Resources bound (agent type, host, resource id):  {{(pid=99027) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 18:05:21.715766 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6dd9462c-4428-4a95-b9e4-be2f187bcbc9 admin admin] Received port after_create {{(pid=99027) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 18:05:21.750468 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6dd9462c-4428-4a95-b9e4-be2f187bcbc9 admin admin] Pushing event updated for resources: {'Port': ['ID=c14ee1b8-5c0b-41af-875f-c2f8d16e0c25,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:05:21.756740 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-6dd9462c-4428-4a95-b9e4-be2f187bcbc9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.115s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:05:21.803616 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-7e261f94-b84f-443e-be49-3bc1ac903b55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:21.902671 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device ecd5b317-fc50-4dd7-97b3-ff9cfdd800e8 up at agent ovs-agent-dv-cinder-789564-2-iscsi {{(pid=99028) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 18:05:22.060573 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Provisioning for port ecd5b317-fc50-4dd7-97b3-ff9cfdd800e8 completed by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 18:05:22.178093 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1093f2b4-bb33-432f-bf92-693a17ae70c0 None None] Network 66e6b1a7-3352-49c8-951e-25e4133a13bb requested from dv-cinder-789564-2-iscsi {{(pid=99028) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 18:05:22.271905 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-6dd9462c-4428-4a95-b9e4-be2f187bcbc9 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:22.385393 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-0e1d460e-3707-4809-bc86-15e5f62fc1a0 None None] Provisioning for port ecd5b317-fc50-4dd7-97b3-ff9cfdd800e8 completed by entity DHCP. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 18:05:22.399313 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-0e1d460e-3707-4809-bc86-15e5f62fc1a0 None None] Provisioning complete for port ecd5b317-fc50-4dd7-97b3-ff9cfdd800e8 triggered by entity DHCP. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 18:05:22.399693 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-0e1d460e-3707-4809-bc86-15e5f62fc1a0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:22.534811 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-0e1d460e-3707-4809-bc86-15e5f62fc1a0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:22.570202 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-0e1d460e-3707-4809-bc86-15e5f62fc1a0 None None] For port ecd5b317-fc50-4dd7-97b3-ff9cfdd800e8, host dv-cinder-789564-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=ecd5b317-fc50-4dd7-97b3-ff9cfdd800e8,segment=NetworkSegment(2abbf128-e5e5-4349-af70-f8887ef58b0f),segment_id=2abbf128-e5e5-4349-af70-f8887ef58b0f)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 18:05:22.633820 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-6dd9462c-4428-4a95-b9e4-be2f187bcbc9 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-415057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-420065'] for router, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:22.683220 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-0e1d460e-3707-4809-bc86-15e5f62fc1a0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:22.685158 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-d72651a3-1148-4acb-9a27-71c120c6978d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:05:22.753503 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e1d460e-3707-4809-bc86-15e5f62fc1a0 None None] Pushing event updated for resources: {'Port': ['ID=ecd5b317-fc50-4dd7-97b3-ff9cfdd800e8,revision_number=3']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:05:22.757166 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-0e1d460e-3707-4809-bc86-15e5f62fc1a0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:05:22.807654 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-a92f8ba1-3711-440b-af39-28d482b5a988 None None] Provisioning complete for port ecd5b317-fc50-4dd7-97b3-ff9cfdd800e8 triggered by entity DHCP. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 18:05:22.807931 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-a92f8ba1-3711-440b-af39-28d482b5a988 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:23.014634 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6dd9462c-4428-4a95-b9e4-be2f187bcbc9 admin admin] Router e2284a8f-630f-40d9-8cdd-17a1bb5a3448 is scheduled to L3 agent eaeb6875-c4ed-43b6-8658-aa4e52324fdf with binding_index 1 {{(pid=99027) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
May 25 18:05:23.193417 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6dd9462c-4428-4a95-b9e4-be2f187bcbc9 admin admin] Notify agent at l3_agent.dv-cinder-789564-2-iscsi the message routers_updated {{(pid=99027) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 25 18:05:23.201914 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e42463b8-49aa-499b-b203-988fe25f1c40 None None] Sync routers for ids ['e2284a8f-630f-40d9-8cdd-17a1bb5a3448'] in dv-cinder-789564-2-iscsi {{(pid=99028) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 25 18:05:23.211412 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e42463b8-49aa-499b-b203-988fe25f1c40 None None] Routers {'e2284a8f-630f-40d9-8cdd-17a1bb5a3448'} bound to L3 agent in host dv-cinder-789564-2-iscsi {{(pid=99028) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 18:05:23.212043 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-e42463b8-49aa-499b-b203-988fe25f1c40 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcae5a01c10>, 'dv-cinder-789564-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-25T17:34:21Z,description=<?>,heartbeat_timestamp=2021-05-25T18:05:21Z,host='dv-cinder-789564-2-iscsi',id=eaeb6875-c4ed-43b6-8658-aa4e52324fdf,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T17:34:21Z,topic='l3_agent')) {'router_ids': ['e2284a8f-630f-40d9-8cdd-17a1bb5a3448'], 'active': True} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 18:05:23.317571 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-6dd9462c-4428-4a95-b9e4-be2f187bcbc9 admin admin] Notify callbacks [] for router, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:23.318987 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-6dd9462c-4428-4a95-b9e4-be2f187bcbc9 admin admin] 10.222.0.122 "POST /v2.0/routers HTTP/1.1" status: 201  len: 924 time: 3.1285107
May 25 18:05:23.323203 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 52634) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 18:05:23.401066 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvr_db [None req-e42463b8-49aa-499b-b203-988fe25f1c40 None None] Set router e2284a8f-630f-40d9-8cdd-17a1bb5a3448 gateway port host: dv-cinder-789564-2-iscsi {{(pid=99028) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 18:05:23.501547 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-6df2b2a7-a54e-4d57-9be3-033078b9d5b3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:23.703261 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-e42463b8-49aa-499b-b203-988fe25f1c40 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcae5a01c10>, [{'id': 'e2284a8f-630f-40d9-8cdd-17a1bb5a3448', 'name': 'tempest-TestVolumeBootPattern-1659174020-router', 'tenant_id': '6964ff917bfd44b1b1eca0a430c6cf1a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.104'}], 'enable_snat': True}, 'gw_port_id': 'c14ee1b8-5c0b-41af-875f-c2f8d16e0c25', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T18:05:20Z', 'updated_at': '2021-05-25T18:05:21Z', 'revision_number': 3, 'project_id': '6964ff917bfd44b1b1eca0a430c6cf1a', 'gw_port': {'id': 'c14ee1b8-5c0b-41af-875f-c2f8d16e0c25', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:1c:b0:0f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e2284a8f-630f-40d9-8cdd-17a1bb5a3448', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.104', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T18:05:21Z', 'updated_at': '2021-05-25T18:05:21Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi'}], 'dv-cinder-789564-2-iscsi', False) {} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 18:05:23.707148 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e42463b8-49aa-499b-b203-988fe25f1c40 None None] Checking router: e2284a8f-630f-40d9-8cdd-17a1bb5a3448 for host: dv-cinder-789564-2-iscsi {{(pid=99028) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 25 18:05:23.707504 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e42463b8-49aa-499b-b203-988fe25f1c40 None None] Updating router e2284a8f-630f-40d9-8cdd-17a1bb5a3448 port c14ee1b8-5c0b-41af-875f-c2f8d16e0c25 binding host dv-cinder-789564-2-iscsi {{(pid=99028) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 25 18:05:23.797329 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-e42463b8-49aa-499b-b203-988fe25f1c40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:23.889537 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device ecd5b317-fc50-4dd7-97b3-ff9cfdd800e8 up at agent ovs-agent-dv-cinder-789564-2-iscsi {{(pid=99028) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 18:05:24.004493 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-6a7e178b-6307-4d3f-b25e-3758b77ef718 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:24.068807 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Provisioning complete for port ecd5b317-fc50-4dd7-97b3-ff9cfdd800e8 triggered by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 18:05:24.069322 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:24.207021 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.db_base_plugin_common [None req-6a7e178b-6307-4d3f-b25e-3758b77ef718 admin admin] Allocated IP 172.20.0.1 (66e6b1a7-3352-49c8-951e-25e4133a13bb/7e40c2eb-fb3c-4338-9398-6fcd43705fa8/6239732d-4c0c-4187-b7e6-292b3569ab65) {{(pid=99027) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 18:05:24.296987 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-e42463b8-49aa-499b-b203-988fe25f1c40 None None] Notify callbacks [] for port, precommit_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:24.309249 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-e42463b8-49aa-499b-b203-988fe25f1c40 None None] Transition to ACTIVE for port object c14ee1b8-5c0b-41af-875f-c2f8d16e0c25 will not be triggered until provisioned by entity L2. {{(pid=99028) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 18:05:24.354381 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-6a7e178b-6307-4d3f-b25e-3758b77ef718 admin admin] Notify callbacks [] for port, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:24.369629 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.provisioning_blocks [None req-6a7e178b-6307-4d3f-b25e-3758b77ef718 admin admin] Transition to ACTIVE for port object 6239732d-4c0c-4187-b7e6-292b3569ab65 will not be triggered until provisioned by entity DHCP. {{(pid=99027) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 18:05:24.431933 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-e42463b8-49aa-499b-b203-988fe25f1c40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:24.436590 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:05:24.514382 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.managers [None req-e42463b8-49aa-499b-b203-988fe25f1c40 None None] Attempting to bind port c14ee1b8-5c0b-41af-875f-c2f8d16e0c25 on host dv-cinder-789564-2-iscsi for vnic_type normal with profile  {{(pid=99028) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 18:05:24.514657 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.managers [None req-e42463b8-49aa-499b-b203-988fe25f1c40 None None] Attempting to bind port c14ee1b8-5c0b-41af-875f-c2f8d16e0c25 by drivers openvswitch,hyperv on host dv-cinder-789564-2-iscsi at level 0 using segments [{'id': '471771f9-c462-4865-800d-0d5029e9eb3e', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb'}] {{(pid=99028) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 18:05:24.515025 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e42463b8-49aa-499b-b203-988fe25f1c40 None None] Attempting to bind port c14ee1b8-5c0b-41af-875f-c2f8d16e0c25 on network eb7ec72b-a691-481b-8d7e-42c05e13a8cb {{(pid=99028) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 18:05:24.520708 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff3bc3e1-64fe-46b7-bc22-9e8f367560fd None None] Pushing event updated for resources: {'Port': ['ID=c14ee1b8-5c0b-41af-875f-c2f8d16e0c25,revision_number=2']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:05:24.525479 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-ff3bc3e1-64fe-46b7-bc22-9e8f367560fd None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:05:24.526402 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e42463b8-49aa-499b-b203-988fe25f1c40 None None] Checking agent: {'id': '7bb67520-1e97-4ad9-9b97-101068bbe1a3', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-789564-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 17, 34, 21), 'started_at': datetime.datetime(2021, 5, 25, 17, 34, 51), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 18, 5, 21), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-789564-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=99028) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 18:05:24.526776 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e42463b8-49aa-499b-b203-988fe25f1c40 None None] Checking segment: {'id': '471771f9-c462-4865-800d-0d5029e9eb3e', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=99028) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 18:05:24.527182 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-e42463b8-49aa-499b-b203-988fe25f1c40 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:24.527572 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e42463b8-49aa-499b-b203-988fe25f1c40 None None] Bound using segment: {'id': '471771f9-c462-4865-800d-0d5029e9eb3e', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb'} {{(pid=99028) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 18:05:24.528043 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.managers [None req-e42463b8-49aa-499b-b203-988fe25f1c40 None None] Bound port: c14ee1b8-5c0b-41af-875f-c2f8d16e0c25, host: dv-cinder-789564-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '471771f9-c462-4865-800d-0d5029e9eb3e', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb'}}] {{(pid=99028) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 18:05:24.528492 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-e42463b8-49aa-499b-b203-988fe25f1c40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:24.529608 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-6a7e178b-6307-4d3f-b25e-3758b77ef718 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781840788179', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15468986'] for port, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:24.533531 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-ec4cb654-3324-499e-a891-ca5dad42f693 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:05:24.599711 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6a7e178b-6307-4d3f-b25e-3758b77ef718 admin admin] Network 66e6b1a7-3352-49c8-951e-25e4133a13bb is already hosted by enough agents. {{(pid=99027) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 18:05:24.600480 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-e42463b8-49aa-499b-b203-988fe25f1c40 None None] For port c14ee1b8-5c0b-41af-875f-c2f8d16e0c25, host dv-cinder-789564-2-iscsi, cleared binding levels {{(pid=99028) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 18:05:24.602332 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.base_scheduler [None req-6a7e178b-6307-4d3f-b25e-3758b77ef718 admin admin] Resources bound (agent type, host, resource id):  {{(pid=99027) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 18:05:24.604168 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-e42463b8-49aa-499b-b203-988fe25f1c40 None None] For port c14ee1b8-5c0b-41af-875f-c2f8d16e0c25, host dv-cinder-789564-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=c14ee1b8-5c0b-41af-875f-c2f8d16e0c25,segment=NetworkSegment(471771f9-c462-4865-800d-0d5029e9eb3e),segment_id=471771f9-c462-4865-800d-0d5029e9eb3e)] {{(pid=99028) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 18:05:24.605985 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6a7e178b-6307-4d3f-b25e-3758b77ef718 admin admin] Received port after_create {{(pid=99027) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 18:05:24.636119 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a7e178b-6307-4d3f-b25e-3758b77ef718 admin admin] Pushing event updated for resources: {'Port': ['ID=6239732d-4c0c-4187-b7e6-292b3569ab65,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:05:24.642614 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-6a7e178b-6307-4d3f-b25e-3758b77ef718 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.109s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:05:24.664515 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-6a7e178b-6307-4d3f-b25e-3758b77ef718 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-421008'] for router_interface, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:24.723759 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-e42463b8-49aa-499b-b203-988fe25f1c40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:24.729113 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-89411d75-83e0-4e21-bf09-f28cebc71a4e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:05:24.811994 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e42463b8-49aa-499b-b203-988fe25f1c40 None None] Routers {'e2284a8f-630f-40d9-8cdd-17a1bb5a3448'} bound to L3 agent in host dv-cinder-789564-2-iscsi {{(pid=99028) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 18:05:24.812650 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-e42463b8-49aa-499b-b203-988fe25f1c40 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcae5a01c10>, 'dv-cinder-789564-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-25T17:34:21Z,description=<?>,heartbeat_timestamp=2021-05-25T18:05:21Z,host='dv-cinder-789564-2-iscsi',id=eaeb6875-c4ed-43b6-8658-aa4e52324fdf,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T17:34:21Z,topic='l3_agent')) {'router_ids': ['e2284a8f-630f-40d9-8cdd-17a1bb5a3448'], 'active': True} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 18:05:24.872840 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff3bc3e1-64fe-46b7-bc22-9e8f367560fd None None] Pushing event updated for resources: {'Port': ['ID=c14ee1b8-5c0b-41af-875f-c2f8d16e0c25,revision_number=3']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:05:24.887316 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-ff3bc3e1-64fe-46b7-bc22-9e8f367560fd None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.158s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:05:24.967216 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-f0602b8b-f05e-43f4-9d1d-127939005574 None None] Provisioning for port 6239732d-4c0c-4187-b7e6-292b3569ab65 completed by entity DHCP. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 18:05:24.990922 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-f0602b8b-f05e-43f4-9d1d-127939005574 None None] Provisioning complete for port 6239732d-4c0c-4187-b7e6-292b3569ab65 triggered by entity DHCP. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 18:05:24.991297 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-f0602b8b-f05e-43f4-9d1d-127939005574 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:25.061189 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.plugin [None req-f0602b8b-f05e-43f4-9d1d-127939005574 None None] Port 6239732d-4c0c-4187-b7e6-292b3569ab65 cannot update to ACTIVE because it is not bound. {{(pid=99028) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 25 18:05:25.063525 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvr_db [None req-e42463b8-49aa-499b-b203-988fe25f1c40 None None] Set router e2284a8f-630f-40d9-8cdd-17a1bb5a3448 gateway port host: dv-cinder-789564-2-iscsi {{(pid=99028) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 18:05:25.119625 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-6a7e178b-6307-4d3f-b25e-3758b77ef718 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:25.344855 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-6a7e178b-6307-4d3f-b25e-3758b77ef718 admin admin] Notify callbacks [] for port, precommit_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:25.350965 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-e42463b8-49aa-499b-b203-988fe25f1c40 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcae5a01c10>, [{'id': 'e2284a8f-630f-40d9-8cdd-17a1bb5a3448', 'name': 'tempest-TestVolumeBootPattern-1659174020-router', 'tenant_id': '6964ff917bfd44b1b1eca0a430c6cf1a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.104'}], 'enable_snat': True}, 'gw_port_id': 'c14ee1b8-5c0b-41af-875f-c2f8d16e0c25', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T18:05:20Z', 'updated_at': '2021-05-25T18:05:21Z', 'revision_number': 3, 'project_id': '6964ff917bfd44b1b1eca0a430c6cf1a', 'gw_port': {'id': 'c14ee1b8-5c0b-41af-875f-c2f8d16e0c25', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:1c:b0:0f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e2284a8f-630f-40d9-8cdd-17a1bb5a3448', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.104', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T18:05:21Z', 'updated_at': '2021-05-25T18:05:24Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi'}], 'dv-cinder-789564-2-iscsi', False) {} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 18:05:25.356604 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e42463b8-49aa-499b-b203-988fe25f1c40 None None] The sync data for ids ['e2284a8f-630f-40d9-8cdd-17a1bb5a3448'] in dv-cinder-789564-2-iscsi is: [{'id': 'e2284a8f-630f-40d9-8cdd-17a1bb5a3448', 'name': 'tempest-TestVolumeBootPattern-1659174020-router', 'tenant_id': '6964ff917bfd44b1b1eca0a430c6cf1a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.104'}], 'enable_snat': True}, 'gw_port_id': 'c14ee1b8-5c0b-41af-875f-c2f8d16e0c25', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T18:05:20Z', 'updated_at': '2021-05-25T18:05:21Z', 'revision_number': 3, 'project_id': '6964ff917bfd44b1b1eca0a430c6cf1a', 'gw_port': {'id': 'c14ee1b8-5c0b-41af-875f-c2f8d16e0c25', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:1c:b0:0f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e2284a8f-630f-40d9-8cdd-17a1bb5a3448', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.104', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T18:05:21Z', 'updated_at': '2021-05-25T18:05:24Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi'}] {{(pid=99028) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 25 18:05:25.489032 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-6a7e178b-6307-4d3f-b25e-3758b77ef718 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15468979'] for port, after_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:25.514533 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-4042612e-03a0-46d3-85ac-bdb052b06f36 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:05:25.601394 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a7e178b-6307-4d3f-b25e-3758b77ef718 admin admin] Pushing event updated for resources: {'Port': ['ID=6239732d-4c0c-4187-b7e6-292b3569ab65,revision_number=2']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:05:25.606594 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-6a7e178b-6307-4d3f-b25e-3758b77ef718 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:05:25.611155 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-6a7e178b-6307-4d3f-b25e-3758b77ef718 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-549394', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-420925'] for router_interface, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:25.761249 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6a7e178b-6307-4d3f-b25e-3758b77ef718 admin admin] Network 66e6b1a7-3352-49c8-951e-25e4133a13bb is already hosted by enough agents. {{(pid=99027) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 18:05:25.762532 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.base_scheduler [None req-6a7e178b-6307-4d3f-b25e-3758b77ef718 admin admin] Resources bound (agent type, host, resource id):  {{(pid=99027) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 18:05:25.923879 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device c14ee1b8-5c0b-41af-875f-c2f8d16e0c25 up at agent ovs-agent-dv-cinder-789564-2-iscsi {{(pid=99028) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 18:05:25.978051 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6a7e178b-6307-4d3f-b25e-3758b77ef718 admin admin] Router e2284a8f-630f-40d9-8cdd-17a1bb5a3448 has already been hosted by L3 agent eaeb6875-c4ed-43b6-8658-aa4e52324fdf {{(pid=99027) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 25 18:05:26.009785 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-983dbf21-a304-47f2-aa47-1b39833e15b1 None None] Provisioning complete for port 6239732d-4c0c-4187-b7e6-292b3569ab65 triggered by entity DHCP. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 18:05:26.010468 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-983dbf21-a304-47f2-aa47-1b39833e15b1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:26.066415 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.plugin [None req-983dbf21-a304-47f2-aa47-1b39833e15b1 None None] Port 6239732d-4c0c-4187-b7e6-292b3569ab65 cannot update to ACTIVE because it is not bound. {{(pid=99028) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 25 18:05:26.094518 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Provisioning for port c14ee1b8-5c0b-41af-875f-c2f8d16e0c25 completed by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 18:05:26.099800 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Provisioning complete for port c14ee1b8-5c0b-41af-875f-c2f8d16e0c25 triggered by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 18:05:26.100179 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:26.179072 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6a7e178b-6307-4d3f-b25e-3758b77ef718 admin admin] Notify agent at l3_agent.dv-cinder-789564-2-iscsi the message routers_updated {{(pid=99027) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 25 18:05:26.191179 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-6a7e178b-6307-4d3f-b25e-3758b77ef718 admin admin] 10.222.0.122 "PUT /v2.0/routers/e2284a8f-630f-40d9-8cdd-17a1bb5a3448/add_router_interface HTTP/1.1" status: 200  len: 503 time: 2.8653104
May 25 18:05:26.272451 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:26.289456 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] For port c14ee1b8-5c0b-41af-875f-c2f8d16e0c25, host dv-cinder-789564-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=c14ee1b8-5c0b-41af-875f-c2f8d16e0c25,segment=NetworkSegment(471771f9-c462-4865-800d-0d5029e9eb3e),segment_id=471771f9-c462-4865-800d-0d5029e9eb3e)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 18:05:26.403161 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:26.406575 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-d16f39f4-30fc-4b2c-8411-64bb4bf9e96e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:05:26.493752 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Pushing event updated for resources: {'Port': ['ID=c14ee1b8-5c0b-41af-875f-c2f8d16e0c25,revision_number=4']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:05:26.497126 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:05:26.757991 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.agents_db [None req-14fae233-15dc-4576-836b-621c5f95b584 None None] Agent healthcheck: found 6 active agents {{(pid=99029) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 18:05:26.961635 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4e3ada6e-7c78-4859-9878-bcd0c5c9d5f9 None None] Sync routers for ids ['e2284a8f-630f-40d9-8cdd-17a1bb5a3448'] in dv-cinder-789564-2-iscsi {{(pid=99029) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 25 18:05:26.971150 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4e3ada6e-7c78-4859-9878-bcd0c5c9d5f9 None None] Routers {'e2284a8f-630f-40d9-8cdd-17a1bb5a3448'} bound to L3 agent in host dv-cinder-789564-2-iscsi {{(pid=99029) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 18:05:26.971811 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_hamode_db [None req-4e3ada6e-7c78-4859-9878-bcd0c5c9d5f9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcae71263d0>, 'dv-cinder-789564-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-25T17:34:21Z,description=<?>,heartbeat_timestamp=2021-05-25T18:05:21Z,host='dv-cinder-789564-2-iscsi',id=eaeb6875-c4ed-43b6-8658-aa4e52324fdf,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T17:34:21Z,topic='l3_agent')) {'router_ids': ['e2284a8f-630f-40d9-8cdd-17a1bb5a3448'], 'active': True} {{(pid=99029) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 18:05:27.037593 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 52652) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 18:05:27.042998 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.v2.base [None req-edd91354-dd69-4107-886c-89a4a0ae6db7 admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-887772658-network', 'tenant_id': '86736d5088ad4061b747699be757d295'}} {{(pid=99026) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 18:05:27.047543 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-edd91354-dd69-4107-886c-89a4a0ae6db7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 18:05:27.051250 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-edd91354-dd69-4107-886c-89a4a0ae6db7 admin admin] Usage tracker for resource:network and tenant:86736d5088ad4061b747699be757d295 is out of sync, need to count used quota {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 18:05:27.055427 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-edd91354-dd69-4107-886c-89a4a0ae6db7 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 18:05:27.061867 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-edd91354-dd69-4107-886c-89a4a0ae6db7 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 18:05:27.151815 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_dvr_db [None req-4e3ada6e-7c78-4859-9878-bcd0c5c9d5f9 None None] Set router e2284a8f-630f-40d9-8cdd-17a1bb5a3448 gateway port host: dv-cinder-789564-2-iscsi {{(pid=99029) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 18:05:27.168844 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-edd91354-dd69-4107-886c-89a4a0ae6db7 admin admin] Made reservation on behalf of 86736d5088ad4061b747699be757d295 for: {'network': 1} {{(pid=99026) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 18:05:27.171137 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-edd91354-dd69-4107-886c-89a4a0ae6db7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-1465344'] for network, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:27.183603 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-edd91354-dd69-4107-886c-89a4a0ae6db7 admin admin] Notify callbacks [] for security_group, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:27.198399 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-edd91354-dd69-4107-886c-89a4a0ae6db7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 18:05:27.202299 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-edd91354-dd69-4107-886c-89a4a0ae6db7 admin admin] Usage tracker for resource:security_group_rule and tenant:86736d5088ad4061b747699be757d295 is out of sync, need to count used quota {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 18:05:27.205172 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-edd91354-dd69-4107-886c-89a4a0ae6db7 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 18:05:27.211889 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-edd91354-dd69-4107-886c-89a4a0ae6db7 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 18:05:27.302156 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-edd91354-dd69-4107-886c-89a4a0ae6db7 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:27.368987 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-edd91354-dd69-4107-886c-89a4a0ae6db7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:27.374897 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-9be563d8-b717-4486-8ec8-05d96f14ae3b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:05:27.402916 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-edd91354-dd69-4107-886c-89a4a0ae6db7 admin admin] vlan segment allocate from pool success with {'vlan_id': 1319, 'physical_network': 'physnet1'}  {{(pid=99026) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 25 18:05:27.415519 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-edd91354-dd69-4107-886c-89a4a0ae6db7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b6b54980-b5d5-413d-a564-a7238139e824,revision_number=1']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:05:27.423405 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-edd91354-dd69-4107-886c-89a4a0ae6db7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1469168'] for segment, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:27.423676 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.db.segments_db [None req-edd91354-dd69-4107-886c-89a4a0ae6db7 admin admin] Added segment 519aa405-52e1-4777-ad06-c8bf40b2bbf0 of type vlan for network d0c065bb-fb8d-40d4-a3f3-66b00161a624
May 25 18:05:27.425464 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edd91354-dd69-4107-886c-89a4a0ae6db7 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:05:27.425891 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edd91354-dd69-4107-886c-89a4a0ae6db7 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:05:27.426256 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edd91354-dd69-4107-886c-89a4a0ae6db7 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:05:27.426621 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edd91354-dd69-4107-886c-89a4a0ae6db7 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:05:27.426975 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edd91354-dd69-4107-886c-89a4a0ae6db7 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:05:27.427334 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edd91354-dd69-4107-886c-89a4a0ae6db7 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:05:27.427686 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edd91354-dd69-4107-886c-89a4a0ae6db7 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:05:27.428037 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edd91354-dd69-4107-886c-89a4a0ae6db7 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:05:27.428392 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edd91354-dd69-4107-886c-89a4a0ae6db7 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:05:27.428740 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edd91354-dd69-4107-886c-89a4a0ae6db7 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:05:27.429107 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edd91354-dd69-4107-886c-89a4a0ae6db7 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:05:27.429455 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edd91354-dd69-4107-886c-89a4a0ae6db7 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:05:27.436511 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-edd91354-dd69-4107-886c-89a4a0ae6db7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.062s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:05:27.459370 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-edd91354-dd69-4107-886c-89a4a0ae6db7 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8781840806997'] for network, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:27.472483 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_hamode_db [None req-4e3ada6e-7c78-4859-9878-bcd0c5c9d5f9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcae71263d0>, [{'id': 'e2284a8f-630f-40d9-8cdd-17a1bb5a3448', 'name': 'tempest-TestVolumeBootPattern-1659174020-router', 'tenant_id': '6964ff917bfd44b1b1eca0a430c6cf1a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.104'}], 'enable_snat': True}, 'gw_port_id': 'c14ee1b8-5c0b-41af-875f-c2f8d16e0c25', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T18:05:20Z', 'updated_at': '2021-05-25T18:05:24Z', 'revision_number': 4, 'project_id': '6964ff917bfd44b1b1eca0a430c6cf1a', 'gw_port': {'id': 'c14ee1b8-5c0b-41af-875f-c2f8d16e0c25', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:1c:b0:0f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e2284a8f-630f-40d9-8cdd-17a1bb5a3448', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.104', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T18:05:21Z', 'updated_at': '2021-05-25T18:05:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi', '_interfaces': [{'id': '6239732d-4c0c-4187-b7e6-292b3569ab65', 'name': '', 'network_id': '66e6b1a7-3352-49c8-951e-25e4133a13bb', 'tenant_id': '6964ff917bfd44b1b1eca0a430c6cf1a', 'mac_address': 'fa:16:3e:16:61:66', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e2284a8f-630f-40d9-8cdd-17a1bb5a3448', 'device_owner': 'network:router_interface', 'standard_attr_id': 657, 'fixed_ips': [{'subnet_id': '7e40c2eb-fb3c-4338-9398-6fcd43705fa8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T18:05:24Z', 'updated_at': '2021-05-25T18:05:25Z', 'revision_number': 2, 'project_id': '6964ff917bfd44b1b1eca0a430c6cf1a', 'subnets': [{'id': '7e40c2eb-fb3c-4338-9398-6fcd43705fa8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-789564-2-iscsi', False) {} {{(pid=99029) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 18:05:27.478005 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4e3ada6e-7c78-4859-9878-bcd0c5c9d5f9 None None] Checking router: e2284a8f-630f-40d9-8cdd-17a1bb5a3448 for host: dv-cinder-789564-2-iscsi {{(pid=99029) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 25 18:05:27.478005 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4e3ada6e-7c78-4859-9878-bcd0c5c9d5f9 None None] Updating router e2284a8f-630f-40d9-8cdd-17a1bb5a3448 port 6239732d-4c0c-4187-b7e6-292b3569ab65 binding host dv-cinder-789564-2-iscsi {{(pid=99029) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 25 18:05:27.529011 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron_lib.callbacks.manager [None req-4e3ada6e-7c78-4859-9878-bcd0c5c9d5f9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99029) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:27.574362 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-edd91354-dd69-4107-886c-89a4a0ae6db7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-459299', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551400'] for network, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:27.575731 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-edd91354-dd69-4107-886c-89a4a0ae6db7 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:05:27.576317 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-edd91354-dd69-4107-886c-89a4a0ae6db7 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for network, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:27.581359 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:05:27.682391 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-edd91354-dd69-4107-886c-89a4a0ae6db7 admin admin] Pushing event updated for resources: {'Network': ['ID=d0c065bb-fb8d-40d4-a3f3-66b00161a624,revision_number=1']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:05:27.685073 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-edd91354-dd69-4107-886c-89a4a0ae6db7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.104s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:05:27.692215 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Network d0c065bb-fb8d-40d4-a3f3-66b00161a624 details requested by agent ovs-agent-dv-cinder-789564-2-iscsi with host dv-cinder-789564-2-iscsi {{(pid=99028) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 25 18:05:27.750348 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 52656) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 18:05:27.757104 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.v2.base [None req-046af5d0-3d43-428c-89a3-b57b7b3f69ee admin admin] Request body: {'subnet': {'network_id': 'd0c065bb-fb8d-40d4-a3f3-66b00161a624', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-887772658-subnet', 'tenant_id': '86736d5088ad4061b747699be757d295', 'ip_version': 4}} {{(pid=99027) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 18:05:27.760629 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-edd91354-dd69-4107-886c-89a4a0ae6db7 admin admin] 10.222.0.122 "POST /v2.0/networks HTTP/1.1" status: 201  len: 885 time: 0.7220483
May 25 18:05:27.763124 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-046af5d0-3d43-428c-89a3-b57b7b3f69ee admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 18:05:27.767171 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-046af5d0-3d43-428c-89a3-b57b7b3f69ee admin admin] Usage tracker for resource:subnet and tenant:86736d5088ad4061b747699be757d295 is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 18:05:27.770076 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-046af5d0-3d43-428c-89a3-b57b7b3f69ee admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 18:05:27.776221 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-046af5d0-3d43-428c-89a3-b57b7b3f69ee admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 18:05:27.868608 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device c14ee1b8-5c0b-41af-875f-c2f8d16e0c25 up at agent ovs-agent-dv-cinder-789564-2-iscsi {{(pid=99028) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 18:05:27.871622 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-046af5d0-3d43-428c-89a3-b57b7b3f69ee admin admin] Made reservation on behalf of 86736d5088ad4061b747699be757d295 for: {'subnet': 1} {{(pid=99027) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 18:05:27.874302 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-046af5d0-3d43-428c-89a3-b57b7b3f69ee admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-14778112'] for subnet, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:27.906319 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron_lib.callbacks.manager [None req-4e3ada6e-7c78-4859-9878-bcd0c5c9d5f9 None None] Notify callbacks [] for port, precommit_update {{(pid=99029) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:27.918186 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.provisioning_blocks [None req-4e3ada6e-7c78-4859-9878-bcd0c5c9d5f9 None None] Transition to ACTIVE for port object 6239732d-4c0c-4187-b7e6-292b3569ab65 will not be triggered until provisioned by entity L2. {{(pid=99029) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 18:05:27.939768 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Provisioning complete for port c14ee1b8-5c0b-41af-875f-c2f8d16e0c25 triggered by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 18:05:27.940066 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:28.083022 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron_lib.callbacks.manager [None req-4e3ada6e-7c78-4859-9878-bcd0c5c9d5f9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99029) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:28.088036 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG oslo_concurrency.lockutils [None req-d6f378ce-bf3a-47a0-82f9-664f9dfa448d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:05:28.237113 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1d11c63-56ee-4db2-9dec-3246f2dd0565 None None] Pushing event updated for resources: {'Port': ['ID=6239732d-4c0c-4187-b7e6-292b3569ab65,revision_number=3']} {{(pid=99029) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:05:28.249952 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c1d11c63-56ee-4db2-9dec-3246f2dd0565 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99029) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:05:28.250295 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c1d11c63-56ee-4db2-9dec-3246f2dd0565 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99029) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:05:28.250631 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c1d11c63-56ee-4db2-9dec-3246f2dd0565 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99029) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:05:28.250953 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c1d11c63-56ee-4db2-9dec-3246f2dd0565 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99029) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:05:28.251471 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c1d11c63-56ee-4db2-9dec-3246f2dd0565 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99029) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:05:28.251800 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c1d11c63-56ee-4db2-9dec-3246f2dd0565 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99029) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:05:28.252126 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c1d11c63-56ee-4db2-9dec-3246f2dd0565 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99029) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:05:28.252440 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c1d11c63-56ee-4db2-9dec-3246f2dd0565 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99029) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:05:28.252955 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c1d11c63-56ee-4db2-9dec-3246f2dd0565 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99029) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:05:28.253303 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c1d11c63-56ee-4db2-9dec-3246f2dd0565 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99029) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:05:28.253619 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c1d11c63-56ee-4db2-9dec-3246f2dd0565 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99029) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:05:28.253935 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c1d11c63-56ee-4db2-9dec-3246f2dd0565 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99029) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:05:28.261832 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG oslo_concurrency.lockutils [None req-c1d11c63-56ee-4db2-9dec-3246f2dd0565 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.174s {{(pid=99029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:05:28.311937 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.plugins.ml2.managers [None req-4e3ada6e-7c78-4859-9878-bcd0c5c9d5f9 None None] Attempting to bind port 6239732d-4c0c-4187-b7e6-292b3569ab65 on host dv-cinder-789564-2-iscsi for vnic_type normal with profile  {{(pid=99029) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 18:05:28.312311 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.plugins.ml2.managers [None req-4e3ada6e-7c78-4859-9878-bcd0c5c9d5f9 None None] Attempting to bind port 6239732d-4c0c-4187-b7e6-292b3569ab65 by drivers openvswitch,hyperv on host dv-cinder-789564-2-iscsi at level 0 using segments [{'id': '2abbf128-e5e5-4349-af70-f8887ef58b0f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1307, 'network_id': '66e6b1a7-3352-49c8-951e-25e4133a13bb'}] {{(pid=99029) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 18:05:28.312674 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4e3ada6e-7c78-4859-9878-bcd0c5c9d5f9 None None] Attempting to bind port 6239732d-4c0c-4187-b7e6-292b3569ab65 on network 66e6b1a7-3352-49c8-951e-25e4133a13bb {{(pid=99029) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 18:05:28.318323 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4e3ada6e-7c78-4859-9878-bcd0c5c9d5f9 None None] Checking agent: {'id': '7bb67520-1e97-4ad9-9b97-101068bbe1a3', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-789564-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 17, 34, 21), 'started_at': datetime.datetime(2021, 5, 25, 17, 34, 51), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 18, 5, 21), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-789564-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=99029) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 18:05:28.318717 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4e3ada6e-7c78-4859-9878-bcd0c5c9d5f9 None None] Checking segment: {'id': '2abbf128-e5e5-4349-af70-f8887ef58b0f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1307, 'network_id': '66e6b1a7-3352-49c8-951e-25e4133a13bb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=99029) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 18:05:28.319113 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron_lib.callbacks.manager [None req-4e3ada6e-7c78-4859-9878-bcd0c5c9d5f9 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=99029) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:28.319529 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4e3ada6e-7c78-4859-9878-bcd0c5c9d5f9 None None] Bound using segment: {'id': '2abbf128-e5e5-4349-af70-f8887ef58b0f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1307, 'network_id': '66e6b1a7-3352-49c8-951e-25e4133a13bb'} {{(pid=99029) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 18:05:28.319983 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.plugins.ml2.managers [None req-4e3ada6e-7c78-4859-9878-bcd0c5c9d5f9 None None] Bound port: 6239732d-4c0c-4187-b7e6-292b3569ab65, host: dv-cinder-789564-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '2abbf128-e5e5-4349-af70-f8887ef58b0f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1307, 'network_id': '66e6b1a7-3352-49c8-951e-25e4133a13bb'}}] {{(pid=99029) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 18:05:28.320378 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron_lib.callbacks.manager [None req-4e3ada6e-7c78-4859-9878-bcd0c5c9d5f9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99029) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:28.367456 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-046af5d0-3d43-428c-89a3-b57b7b3f69ee admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114466', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-15467018', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-14778134'] for subnet, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:28.372203 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-a85be3f4-de6f-4da0-80ce-eb213c6f8b3a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:05:28.410385 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.plugins.ml2.db [None req-4e3ada6e-7c78-4859-9878-bcd0c5c9d5f9 None None] For port 6239732d-4c0c-4187-b7e6-292b3569ab65, host dv-cinder-789564-2-iscsi, cleared binding levels {{(pid=99029) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 18:05:28.414775 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.plugins.ml2.db [None req-4e3ada6e-7c78-4859-9878-bcd0c5c9d5f9 None None] For port 6239732d-4c0c-4187-b7e6-292b3569ab65, host dv-cinder-789564-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=6239732d-4c0c-4187-b7e6-292b3569ab65,segment=NetworkSegment(2abbf128-e5e5-4349-af70-f8887ef58b0f),segment_id=2abbf128-e5e5-4349-af70-f8887ef58b0f)] {{(pid=99029) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 18:05:28.501152 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron_lib.callbacks.manager [None req-4e3ada6e-7c78-4859-9878-bcd0c5c9d5f9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99029) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:28.506170 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG oslo_concurrency.lockutils [None req-e74fd6bf-e9c9-404e-a99f-b72ef91b7147 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:05:28.550544 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-046af5d0-3d43-428c-89a3-b57b7b3f69ee admin admin] Pushing event updated for resources: {'Subnet': ['ID=23442663-84d3-4654-aee4-80434487f265,revision_number=0']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:05:28.555036 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-046af5d0-3d43-428c-89a3-b57b7b3f69ee admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.183s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:05:28.559398 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-046af5d0-3d43-428c-89a3-b57b7b3f69ee admin admin] Checking segment: {'id': '519aa405-52e1-4777-ad06-c8bf40b2bbf0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1319, 'network_id': 'd0c065bb-fb8d-40d4-a3f3-66b00161a624'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=99027) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 18:05:28.559817 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-046af5d0-3d43-428c-89a3-b57b7b3f69ee admin admin] Network hostable DHCP agents. Network: d0c065bb-fb8d-40d4-a3f3-66b00161a624, hostable agents: ['c8b0a350-254b-4562-874b-120ecdef0e25'], hosted agents: [] {{(pid=99027) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 25 18:05:28.581772 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4e3ada6e-7c78-4859-9878-bcd0c5c9d5f9 None None] Routers {'e2284a8f-630f-40d9-8cdd-17a1bb5a3448'} bound to L3 agent in host dv-cinder-789564-2-iscsi {{(pid=99029) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 18:05:28.582403 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_hamode_db [None req-4e3ada6e-7c78-4859-9878-bcd0c5c9d5f9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcae71263d0>, 'dv-cinder-789564-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-25T17:34:21Z,description=<?>,heartbeat_timestamp=2021-05-25T18:05:21Z,host='dv-cinder-789564-2-iscsi',id=eaeb6875-c4ed-43b6-8658-aa4e52324fdf,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T17:34:21Z,topic='l3_agent')) {'router_ids': ['e2284a8f-630f-40d9-8cdd-17a1bb5a3448'], 'active': True} {{(pid=99029) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 18:05:28.650641 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1d11c63-56ee-4db2-9dec-3246f2dd0565 None None] Pushing event updated for resources: {'Port': ['ID=6239732d-4c0c-4187-b7e6-292b3569ab65,revision_number=4']} {{(pid=99029) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:05:28.653796 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG oslo_concurrency.lockutils [None req-c1d11c63-56ee-4db2-9dec-3246f2dd0565 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.148s {{(pid=99029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:05:28.739925 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-046af5d0-3d43-428c-89a3-b57b7b3f69ee admin admin] Network d0c065bb-fb8d-40d4-a3f3-66b00161a624 is scheduled to be hosted by DHCP agent c8b0a350-254b-4562-874b-120ecdef0e25 with binding_index 1 {{(pid=99027) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 25 18:05:28.771748 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_dvr_db [None req-4e3ada6e-7c78-4859-9878-bcd0c5c9d5f9 None None] Set router e2284a8f-630f-40d9-8cdd-17a1bb5a3448 gateway port host: dv-cinder-789564-2-iscsi {{(pid=99029) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 18:05:28.951390 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.base_scheduler [None req-046af5d0-3d43-428c-89a3-b57b7b3f69ee admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-789564-2-iscsi, d0c065bb-fb8d-40d4-a3f3-66b00161a624) {{(pid=99027) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 18:05:28.959971 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-23f1c05f-8593-4333-9a23-dd9732345ba2 None None] Network d0c065bb-fb8d-40d4-a3f3-66b00161a624 requested from dv-cinder-789564-2-iscsi {{(pid=99028) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 18:05:28.967691 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-046af5d0-3d43-428c-89a3-b57b7b3f69ee admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:05:28.968355 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-046af5d0-3d43-428c-89a3-b57b7b3f69ee admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for subnet, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:29.083964 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_hamode_db [None req-4e3ada6e-7c78-4859-9878-bcd0c5c9d5f9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcae71263d0>, [{'id': 'e2284a8f-630f-40d9-8cdd-17a1bb5a3448', 'name': 'tempest-TestVolumeBootPattern-1659174020-router', 'tenant_id': '6964ff917bfd44b1b1eca0a430c6cf1a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.104'}], 'enable_snat': True}, 'gw_port_id': 'c14ee1b8-5c0b-41af-875f-c2f8d16e0c25', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T18:05:20Z', 'updated_at': '2021-05-25T18:05:24Z', 'revision_number': 4, 'project_id': '6964ff917bfd44b1b1eca0a430c6cf1a', 'gw_port': {'id': 'c14ee1b8-5c0b-41af-875f-c2f8d16e0c25', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:1c:b0:0f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e2284a8f-630f-40d9-8cdd-17a1bb5a3448', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.104', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T18:05:21Z', 'updated_at': '2021-05-25T18:05:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi', '_interfaces': [{'id': '6239732d-4c0c-4187-b7e6-292b3569ab65', 'name': '', 'network_id': '66e6b1a7-3352-49c8-951e-25e4133a13bb', 'tenant_id': '6964ff917bfd44b1b1eca0a430c6cf1a', 'mac_address': 'fa:16:3e:16:61:66', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e2284a8f-630f-40d9-8cdd-17a1bb5a3448', 'device_owner': 'network:router_interface', 'standard_attr_id': 657, 'fixed_ips': [{'subnet_id': '7e40c2eb-fb3c-4338-9398-6fcd43705fa8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T18:05:24Z', 'updated_at': '2021-05-25T18:05:28Z', 'revision_number': 4, 'project_id': '6964ff917bfd44b1b1eca0a430c6cf1a', 'subnets': [{'id': '7e40c2eb-fb3c-4338-9398-6fcd43705fa8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-789564-2-iscsi', False) {} {{(pid=99029) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 18:05:29.087802 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4e3ada6e-7c78-4859-9878-bcd0c5c9d5f9 None None] The sync data for ids ['e2284a8f-630f-40d9-8cdd-17a1bb5a3448'] in dv-cinder-789564-2-iscsi is: [{'id': 'e2284a8f-630f-40d9-8cdd-17a1bb5a3448', 'name': 'tempest-TestVolumeBootPattern-1659174020-router', 'tenant_id': '6964ff917bfd44b1b1eca0a430c6cf1a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.104'}], 'enable_snat': True}, 'gw_port_id': 'c14ee1b8-5c0b-41af-875f-c2f8d16e0c25', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T18:05:20Z', 'updated_at': '2021-05-25T18:05:24Z', 'revision_number': 4, 'project_id': '6964ff917bfd44b1b1eca0a430c6cf1a', 'gw_port': {'id': 'c14ee1b8-5c0b-41af-875f-c2f8d16e0c25', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:1c:b0:0f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e2284a8f-630f-40d9-8cdd-17a1bb5a3448', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.104', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T18:05:21Z', 'updated_at': '2021-05-25T18:05:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi', '_interfaces': [{'id': '6239732d-4c0c-4187-b7e6-292b3569ab65', 'name': '', 'network_id': '66e6b1a7-3352-49c8-951e-25e4133a13bb', 'tenant_id': '6964ff917bfd44b1b1eca0a430c6cf1a', 'mac_address': 'fa:16:3e:16:61:66', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e2284a8f-630f-40d9-8cdd-17a1bb5a3448', 'device_owner': 'network:router_interface', 'standard_attr_id': 657, 'fixed_ips': [{'subnet_id': '7e40c2eb-fb3c-4338-9398-6fcd43705fa8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T18:05:24Z', 'updated_at': '2021-05-25T18:05:28Z', 'revision_number': 4, 'project_id': '6964ff917bfd44b1b1eca0a430c6cf1a', 'subnets': [{'id': '7e40c2eb-fb3c-4338-9398-6fcd43705fa8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=99029) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 25 18:05:29.152188 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-046af5d0-3d43-428c-89a3-b57b7b3f69ee admin admin] 10.222.0.122 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 847 time: 1.4006901
May 25 18:05:29.154795 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 52660) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 18:05:29.161980 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.v2.base [None req-155562b2-b223-43d3-9e5a-a26326f80099 admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-887772658-router', 'tenant_id': '86736d5088ad4061b747699be757d295', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb'}}} {{(pid=99026) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 18:05:29.168225 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-155562b2-b223-43d3-9e5a-a26326f80099 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 18:05:29.179095 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-155562b2-b223-43d3-9e5a-a26326f80099 admin admin] Usage tracker for resource:router and tenant:86736d5088ad4061b747699be757d295 is out of sync, need to count used quota {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 18:05:29.182315 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.quota.resource [None req-155562b2-b223-43d3-9e5a-a26326f80099 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=99026) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 18:05:29.186225 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7ed6b46d-ae66-446b-b9a1-5974e67f10dd None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpe415bc4a-81ee-5198-a7be-1f5e4adc5586-d0c065bb-fb8d-40d4-a3f3-66b00161a624', 'network_id': 'd0c065bb-fb8d-40d4-a3f3-66b00161a624', 'tenant_id': '86736d5088ad4061b747699be757d295', 'fixed_ips': [{'subnet_id': '23442663-84d3-4654-aee4-80434487f265'}]}} from dv-cinder-789564-2-iscsi. {{(pid=99028) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
May 25 18:05:29.187040 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-7ed6b46d-ae66-446b-b9a1-5974e67f10dd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_create {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:29.188277 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.quota.driver [None req-155562b2-b223-43d3-9e5a-a26326f80099 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=99026) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 18:05:29.300103 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-155562b2-b223-43d3-9e5a-a26326f80099 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-415064', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-6983'] for router, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:29.301561 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-155562b2-b223-43d3-9e5a-a26326f80099 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-414296', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-419975', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-491114', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-6988'] for router, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:29.326411 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-155562b2-b223-43d3-9e5a-a26326f80099 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:29.367139 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.db_base_plugin_common [None req-7ed6b46d-ae66-446b-b9a1-5974e67f10dd None None] Allocated IP 172.20.0.2 (d0c065bb-fb8d-40d4-a3f3-66b00161a624/23442663-84d3-4654-aee4-80434487f265/0559b054-25c6-47a3-ba20-d541ac352b02) {{(pid=99028) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 18:05:29.624478 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-7ed6b46d-ae66-446b-b9a1-5974e67f10dd None None] Notify callbacks [] for port, precommit_create {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:29.638951 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-7ed6b46d-ae66-446b-b9a1-5974e67f10dd None None] Transition to ACTIVE for port object 0559b054-25c6-47a3-ba20-d541ac352b02 will not be triggered until provisioned by entity L2. {{(pid=99028) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 18:05:29.662259 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-7ed6b46d-ae66-446b-b9a1-5974e67f10dd None None] Transition to ACTIVE for port object 0559b054-25c6-47a3-ba20-d541ac352b02 will not be triggered until provisioned by entity DHCP. {{(pid=99028) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 18:05:29.758980 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-155562b2-b223-43d3-9e5a-a26326f80099 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-420002', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-415082', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-6970'] for router, precommit_update {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:29.764184 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-7ed6b46d-ae66-446b-b9a1-5974e67f10dd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781840788179'] for port, after_create {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:29.772067 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:05:29.847339 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7ed6b46d-ae66-446b-b9a1-5974e67f10dd None None] Network d0c065bb-fb8d-40d4-a3f3-66b00161a624 is already hosted by enough agents. {{(pid=99028) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 18:05:29.851072 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.scheduler.base_scheduler [None req-7ed6b46d-ae66-446b-b9a1-5974e67f10dd None None] Resources bound (agent type, host, resource id):  {{(pid=99028) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 18:05:29.859321 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7ed6b46d-ae66-446b-b9a1-5974e67f10dd None None] Received port after_create {{(pid=99028) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 18:05:29.901707 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ed6b46d-ae66-446b-b9a1-5974e67f10dd None None] Pushing event updated for resources: {'Port': ['ID=0559b054-25c6-47a3-ba20-d541ac352b02,revision_number=1']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:05:29.909287 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-7ed6b46d-ae66-446b-b9a1-5974e67f10dd None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.138s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:05:29.948330 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device 6239732d-4c0c-4187-b7e6-292b3569ab65 up at agent ovs-agent-dv-cinder-789564-2-iscsi {{(pid=99028) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 18:05:30.038216 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.managers [None req-7ed6b46d-ae66-446b-b9a1-5974e67f10dd None None] Attempting to bind port 0559b054-25c6-47a3-ba20-d541ac352b02 on host dv-cinder-789564-2-iscsi for vnic_type normal with profile  {{(pid=99028) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 18:05:30.039309 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.managers [None req-7ed6b46d-ae66-446b-b9a1-5974e67f10dd None None] Attempting to bind port 0559b054-25c6-47a3-ba20-d541ac352b02 by drivers openvswitch,hyperv on host dv-cinder-789564-2-iscsi at level 0 using segments [{'id': '519aa405-52e1-4777-ad06-c8bf40b2bbf0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1319, 'network_id': 'd0c065bb-fb8d-40d4-a3f3-66b00161a624'}] {{(pid=99028) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 18:05:30.039684 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7ed6b46d-ae66-446b-b9a1-5974e67f10dd None None] Attempting to bind port 0559b054-25c6-47a3-ba20-d541ac352b02 on network d0c065bb-fb8d-40d4-a3f3-66b00161a624 {{(pid=99028) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 18:05:30.053749 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7ed6b46d-ae66-446b-b9a1-5974e67f10dd None None] Checking agent: {'id': '7bb67520-1e97-4ad9-9b97-101068bbe1a3', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-789564-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 17, 34, 21), 'started_at': datetime.datetime(2021, 5, 25, 17, 34, 51), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 18, 5, 21), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-789564-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=99028) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 18:05:30.055106 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7ed6b46d-ae66-446b-b9a1-5974e67f10dd None None] Checking segment: {'id': '519aa405-52e1-4777-ad06-c8bf40b2bbf0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1319, 'network_id': 'd0c065bb-fb8d-40d4-a3f3-66b00161a624'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=99028) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 18:05:30.055538 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-7ed6b46d-ae66-446b-b9a1-5974e67f10dd None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:30.055948 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7ed6b46d-ae66-446b-b9a1-5974e67f10dd None None] Bound using segment: {'id': '519aa405-52e1-4777-ad06-c8bf40b2bbf0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1319, 'network_id': 'd0c065bb-fb8d-40d4-a3f3-66b00161a624'} {{(pid=99028) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 18:05:30.056448 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.managers [None req-7ed6b46d-ae66-446b-b9a1-5974e67f10dd None None] Bound port: 0559b054-25c6-47a3-ba20-d541ac352b02, host: dv-cinder-789564-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '519aa405-52e1-4777-ad06-c8bf40b2bbf0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1319, 'network_id': 'd0c065bb-fb8d-40d4-a3f3-66b00161a624'}}] {{(pid=99028) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 18:05:30.057025 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-7ed6b46d-ae66-446b-b9a1-5974e67f10dd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:30.164837 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Provisioning for port 6239732d-4c0c-4187-b7e6-292b3569ab65 completed by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 18:05:30.173895 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Provisioning complete for port 6239732d-4c0c-4187-b7e6-292b3569ab65 triggered by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 18:05:30.174276 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:30.221759 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-7ed6b46d-ae66-446b-b9a1-5974e67f10dd None None] For port 0559b054-25c6-47a3-ba20-d541ac352b02, host dv-cinder-789564-2-iscsi, cleared binding levels {{(pid=99028) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 18:05:30.236438 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-7ed6b46d-ae66-446b-b9a1-5974e67f10dd None None] For port 0559b054-25c6-47a3-ba20-d541ac352b02, host dv-cinder-789564-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=0559b054-25c6-47a3-ba20-d541ac352b02,segment=NetworkSegment(519aa405-52e1-4777-ad06-c8bf40b2bbf0),segment_id=519aa405-52e1-4777-ad06-c8bf40b2bbf0)] {{(pid=99028) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 18:05:30.244833 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-155562b2-b223-43d3-9e5a-a26326f80099 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:30.307454 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:30.346878 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] For port 6239732d-4c0c-4187-b7e6-292b3569ab65, host dv-cinder-789564-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=6239732d-4c0c-4187-b7e6-292b3569ab65,segment=NetworkSegment(2abbf128-e5e5-4349-af70-f8887ef58b0f),segment_id=2abbf128-e5e5-4349-af70-f8887ef58b0f)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 18:05:30.386653 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-155562b2-b223-43d3-9e5a-a26326f80099 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:30.414680 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-7ed6b46d-ae66-446b-b9a1-5974e67f10dd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:30.419356 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-ff3bc3e1-64fe-46b7-bc22-9e8f367560fd None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:05:30.456831 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:30.500138 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ed6b46d-ae66-446b-b9a1-5974e67f10dd None None] Pushing event updated for resources: {'Port': ['ID=0559b054-25c6-47a3-ba20-d541ac352b02,revision_number=2']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:05:30.503848 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-7ed6b46d-ae66-446b-b9a1-5974e67f10dd None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:05:30.503848 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.032s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:05:30.524565 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.db_base_plugin_common [None req-155562b2-b223-43d3-9e5a-a26326f80099 admin admin] Allocated IP 172.27.3.224 (eb7ec72b-a691-481b-8d7e-42c05e13a8cb/d6898f5f-da0b-4428-97b4-4cbe3e83caaa/99329f25-e0c1-49ca-9a07-ab8ede691506) {{(pid=99026) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 18:05:30.577359 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Pushing event updated for resources: {'Port': ['ID=6239732d-4c0c-4187-b7e6-292b3569ab65,revision_number=5']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:05:30.577359 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:05:30.709311 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-155562b2-b223-43d3-9e5a-a26326f80099 admin admin] Notify callbacks [] for port, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:30.917619 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-155562b2-b223-43d3-9e5a-a26326f80099 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781840788179', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15476536'] for port, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:30.921466 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-9a72be09-6466-477b-9439-e6c7345c060b tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:05:30.984412 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-155562b2-b223-43d3-9e5a-a26326f80099 admin admin] Network eb7ec72b-a691-481b-8d7e-42c05e13a8cb is already hosted by enough agents. {{(pid=99026) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 18:05:30.986922 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.scheduler.base_scheduler [None req-155562b2-b223-43d3-9e5a-a26326f80099 admin admin] Resources bound (agent type, host, resource id):  {{(pid=99026) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 18:05:30.991110 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.l3_dvrscheduler_db [None req-155562b2-b223-43d3-9e5a-a26326f80099 admin admin] Received port after_create {{(pid=99026) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 18:05:31.021519 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-155562b2-b223-43d3-9e5a-a26326f80099 admin admin] Pushing event updated for resources: {'Port': ['ID=99329f25-e0c1-49ca-9a07-ab8ede691506,revision_number=1']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:05:31.028920 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-155562b2-b223-43d3-9e5a-a26326f80099 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.107s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:05:31.306786 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fa5fc7d4-141a-4cb4-b2c1-8cd5c563ac5c None None] Network d0c065bb-fb8d-40d4-a3f3-66b00161a624 requested from dv-cinder-789564-2-iscsi {{(pid=99028) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 18:05:31.499500 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-155562b2-b223-43d3-9e5a-a26326f80099 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:31.502304 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-1387c638-5ece-4035-862d-04c26af4c0d6 None None] Provisioning for port 0559b054-25c6-47a3-ba20-d541ac352b02 completed by entity DHCP. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 18:05:31.851974 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-155562b2-b223-43d3-9e5a-a26326f80099 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-415057', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-420065'] for router, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:31.946098 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device 6239732d-4c0c-4187-b7e6-292b3569ab65 up at agent ovs-agent-dv-cinder-789564-2-iscsi {{(pid=99028) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 18:05:32.018900 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Provisioning complete for port 6239732d-4c0c-4187-b7e6-292b3569ab65 triggered by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 18:05:32.019273 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:32.137634 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device 0559b054-25c6-47a3-ba20-d541ac352b02 up at agent ovs-agent-dv-cinder-789564-2-iscsi {{(pid=99028) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 18:05:32.168684 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-155562b2-b223-43d3-9e5a-a26326f80099 admin admin] Router 7254d5fe-a81c-4f09-89f1-982ac4492476 is scheduled to L3 agent eaeb6875-c4ed-43b6-8658-aa4e52324fdf with binding_index 1 {{(pid=99026) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
May 25 18:05:32.276820 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Provisioning for port 0559b054-25c6-47a3-ba20-d541ac352b02 completed by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 18:05:32.282312 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Provisioning complete for port 0559b054-25c6-47a3-ba20-d541ac352b02 triggered by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 18:05:32.282768 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:32.401545 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:32.434677 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] For port 0559b054-25c6-47a3-ba20-d541ac352b02, host dv-cinder-789564-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=0559b054-25c6-47a3-ba20-d541ac352b02,segment=NetworkSegment(519aa405-52e1-4777-ad06-c8bf40b2bbf0),segment_id=519aa405-52e1-4777-ad06-c8bf40b2bbf0)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 18:05:32.459156 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-155562b2-b223-43d3-9e5a-a26326f80099 admin admin] Notify agent at l3_agent.dv-cinder-789564-2-iscsi the message routers_updated {{(pid=99026) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 25 18:05:32.469350 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f74f8a09-1261-4356-93be-b6b6f7d5a735 None None] Sync routers for ids ['7254d5fe-a81c-4f09-89f1-982ac4492476'] in dv-cinder-789564-2-iscsi {{(pid=99028) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 25 18:05:32.479439 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f74f8a09-1261-4356-93be-b6b6f7d5a735 None None] Routers {'7254d5fe-a81c-4f09-89f1-982ac4492476'} bound to L3 agent in host dv-cinder-789564-2-iscsi {{(pid=99028) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 18:05:32.480065 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-f74f8a09-1261-4356-93be-b6b6f7d5a735 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcae5920dc0>, 'dv-cinder-789564-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-25T17:34:21Z,description=<?>,heartbeat_timestamp=2021-05-25T18:05:21Z,host='dv-cinder-789564-2-iscsi',id=eaeb6875-c4ed-43b6-8658-aa4e52324fdf,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T17:34:21Z,topic='l3_agent')) {'router_ids': ['7254d5fe-a81c-4f09-89f1-982ac4492476'], 'active': True} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 18:05:32.533241 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:32.545570 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-2cccbc58-093b-4648-a206-1e82bc09d06a None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:05:32.546345 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-155562b2-b223-43d3-9e5a-a26326f80099 admin admin] Notify callbacks [] for router, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:32.547518 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-155562b2-b223-43d3-9e5a-a26326f80099 admin admin] 10.222.0.122 "POST /v2.0/routers HTTP/1.1" status: 201  len: 923 time: 3.3911257
May 25 18:05:32.550270 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 52664) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 18:05:32.694680 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Pushing event updated for resources: {'Port': ['ID=0559b054-25c6-47a3-ba20-d541ac352b02,revision_number=3']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:05:32.699009 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.153s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:05:32.716785 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvr_db [None req-f74f8a09-1261-4356-93be-b6b6f7d5a735 None None] Set router 7254d5fe-a81c-4f09-89f1-982ac4492476 gateway port host: dv-cinder-789564-2-iscsi {{(pid=99028) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 18:05:33.012974 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-f74f8a09-1261-4356-93be-b6b6f7d5a735 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcae5920dc0>, [{'id': '7254d5fe-a81c-4f09-89f1-982ac4492476', 'name': 'tempest-TestVolumeBootPattern-887772658-router', 'tenant_id': '86736d5088ad4061b747699be757d295', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.224'}], 'enable_snat': True}, 'gw_port_id': '99329f25-e0c1-49ca-9a07-ab8ede691506', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T18:05:29Z', 'updated_at': '2021-05-25T18:05:31Z', 'revision_number': 3, 'project_id': '86736d5088ad4061b747699be757d295', 'gw_port': {'id': '99329f25-e0c1-49ca-9a07-ab8ede691506', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:5b:82:13', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7254d5fe-a81c-4f09-89f1-982ac4492476', 'device_owner': 'network:router_gateway', 'standard_attr_id': 668, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.224', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T18:05:30Z', 'updated_at': '2021-05-25T18:05:30Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi'}], 'dv-cinder-789564-2-iscsi', False) {} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 18:05:33.016908 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f74f8a09-1261-4356-93be-b6b6f7d5a735 None None] Checking router: 7254d5fe-a81c-4f09-89f1-982ac4492476 for host: dv-cinder-789564-2-iscsi {{(pid=99028) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 25 18:05:33.017309 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f74f8a09-1261-4356-93be-b6b6f7d5a735 None None] Updating router 7254d5fe-a81c-4f09-89f1-982ac4492476 port 99329f25-e0c1-49ca-9a07-ab8ede691506 binding host dv-cinder-789564-2-iscsi {{(pid=99028) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 25 18:05:33.070430 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-f74f8a09-1261-4356-93be-b6b6f7d5a735 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:33.233867 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-0ec8d033-8f05-493d-b49a-ec55925a17d9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:33.441580 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.db_base_plugin_common [None req-0ec8d033-8f05-493d-b49a-ec55925a17d9 admin admin] Allocated IP 172.20.0.1 (d0c065bb-fb8d-40d4-a3f3-66b00161a624/23442663-84d3-4654-aee4-80434487f265/6dc2d19d-c86b-486a-a83e-6387508db507) {{(pid=99026) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 18:05:33.449853 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-f74f8a09-1261-4356-93be-b6b6f7d5a735 None None] Notify callbacks [] for port, precommit_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:33.461511 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-f74f8a09-1261-4356-93be-b6b6f7d5a735 None None] Transition to ACTIVE for port object 99329f25-e0c1-49ca-9a07-ab8ede691506 will not be triggered until provisioned by entity L2. {{(pid=99028) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 18:05:33.545643 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-f74f8a09-1261-4356-93be-b6b6f7d5a735 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:33.550455 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-4282d590-f646-4271-babb-21d5b9e261ff None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:05:33.591627 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-0ec8d033-8f05-493d-b49a-ec55925a17d9 admin admin] Notify callbacks [] for port, precommit_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:33.607635 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.provisioning_blocks [None req-0ec8d033-8f05-493d-b49a-ec55925a17d9 admin admin] Transition to ACTIVE for port object 6dc2d19d-c86b-486a-a83e-6387508db507 will not be triggered until provisioned by entity DHCP. {{(pid=99026) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 18:05:33.627977 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.managers [None req-f74f8a09-1261-4356-93be-b6b6f7d5a735 None None] Attempting to bind port 99329f25-e0c1-49ca-9a07-ab8ede691506 on host dv-cinder-789564-2-iscsi for vnic_type normal with profile  {{(pid=99028) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 18:05:33.628353 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.managers [None req-f74f8a09-1261-4356-93be-b6b6f7d5a735 None None] Attempting to bind port 99329f25-e0c1-49ca-9a07-ab8ede691506 by drivers openvswitch,hyperv on host dv-cinder-789564-2-iscsi at level 0 using segments [{'id': '471771f9-c462-4865-800d-0d5029e9eb3e', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb'}] {{(pid=99028) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 18:05:33.628721 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f74f8a09-1261-4356-93be-b6b6f7d5a735 None None] Attempting to bind port 99329f25-e0c1-49ca-9a07-ab8ede691506 on network eb7ec72b-a691-481b-8d7e-42c05e13a8cb {{(pid=99028) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 18:05:33.634677 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3befc076-42aa-4033-a2bc-93df038d707d None None] Pushing event updated for resources: {'Port': ['ID=99329f25-e0c1-49ca-9a07-ab8ede691506,revision_number=2']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:05:33.644294 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-3befc076-42aa-4033-a2bc-93df038d707d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:05:33.644294 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f74f8a09-1261-4356-93be-b6b6f7d5a735 None None] Checking agent: {'id': '7bb67520-1e97-4ad9-9b97-101068bbe1a3', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-789564-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 17, 34, 21), 'started_at': datetime.datetime(2021, 5, 25, 17, 34, 51), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 18, 5, 21), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-789564-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=99028) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 18:05:33.644294 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f74f8a09-1261-4356-93be-b6b6f7d5a735 None None] Checking segment: {'id': '471771f9-c462-4865-800d-0d5029e9eb3e', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=99028) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 18:05:33.644294 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-f74f8a09-1261-4356-93be-b6b6f7d5a735 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:33.644294 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f74f8a09-1261-4356-93be-b6b6f7d5a735 None None] Bound using segment: {'id': '471771f9-c462-4865-800d-0d5029e9eb3e', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb'} {{(pid=99028) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 18:05:33.644294 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.managers [None req-f74f8a09-1261-4356-93be-b6b6f7d5a735 None None] Bound port: 99329f25-e0c1-49ca-9a07-ab8ede691506, host: dv-cinder-789564-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '471771f9-c462-4865-800d-0d5029e9eb3e', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb'}}] {{(pid=99028) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 18:05:33.644294 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-f74f8a09-1261-4356-93be-b6b6f7d5a735 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:33.706604 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-0ec8d033-8f05-493d-b49a-ec55925a17d9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781840788179', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15476536'] for port, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:33.712127 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-ec66aca7-c5a0-486f-8dbe-61a71963e47b tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:05:33.714937 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-f74f8a09-1261-4356-93be-b6b6f7d5a735 None None] For port 99329f25-e0c1-49ca-9a07-ab8ede691506, host dv-cinder-789564-2-iscsi, cleared binding levels {{(pid=99028) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 18:05:33.717948 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-f74f8a09-1261-4356-93be-b6b6f7d5a735 None None] For port 99329f25-e0c1-49ca-9a07-ab8ede691506, host dv-cinder-789564-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=99329f25-e0c1-49ca-9a07-ab8ede691506,segment=NetworkSegment(471771f9-c462-4865-800d-0d5029e9eb3e),segment_id=471771f9-c462-4865-800d-0d5029e9eb3e)] {{(pid=99028) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 18:05:33.776062 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0ec8d033-8f05-493d-b49a-ec55925a17d9 admin admin] Network d0c065bb-fb8d-40d4-a3f3-66b00161a624 is already hosted by enough agents. {{(pid=99026) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 18:05:33.780278 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.scheduler.base_scheduler [None req-0ec8d033-8f05-493d-b49a-ec55925a17d9 admin admin] Resources bound (agent type, host, resource id):  {{(pid=99026) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 18:05:33.784060 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0ec8d033-8f05-493d-b49a-ec55925a17d9 admin admin] Received port after_create {{(pid=99026) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 18:05:33.808709 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-f74f8a09-1261-4356-93be-b6b6f7d5a735 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:33.813622 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-1f3565c1-1d93-4062-9085-bfa0b292cffd None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:05:33.834023 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ec8d033-8f05-493d-b49a-ec55925a17d9 admin admin] Pushing event updated for resources: {'Port': ['ID=6dc2d19d-c86b-486a-a83e-6387508db507,revision_number=1']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:05:33.834023 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-0ec8d033-8f05-493d-b49a-ec55925a17d9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.120s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:05:33.846311 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-0ec8d033-8f05-493d-b49a-ec55925a17d9 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-421008'] for router_interface, before_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:33.890764 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f74f8a09-1261-4356-93be-b6b6f7d5a735 None None] Routers {'7254d5fe-a81c-4f09-89f1-982ac4492476'} bound to L3 agent in host dv-cinder-789564-2-iscsi {{(pid=99028) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 18:05:33.891423 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-f74f8a09-1261-4356-93be-b6b6f7d5a735 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcae5920dc0>, 'dv-cinder-789564-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-25T17:34:21Z,description=<?>,heartbeat_timestamp=2021-05-25T18:05:21Z,host='dv-cinder-789564-2-iscsi',id=eaeb6875-c4ed-43b6-8658-aa4e52324fdf,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T17:34:21Z,topic='l3_agent')) {'router_ids': ['7254d5fe-a81c-4f09-89f1-982ac4492476'], 'active': True} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 18:05:33.946766 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device 0559b054-25c6-47a3-ba20-d541ac352b02 up at agent ovs-agent-dv-cinder-789564-2-iscsi {{(pid=99028) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 18:05:34.035176 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3befc076-42aa-4033-a2bc-93df038d707d None None] Pushing event updated for resources: {'Port': ['ID=99329f25-e0c1-49ca-9a07-ab8ede691506,revision_number=3']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:05:34.043850 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-3befc076-42aa-4033-a2bc-93df038d707d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.230s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:05:34.128715 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-f91f7da7-047f-4066-903c-ecf59849e6d0 None None] Provisioning for port 6dc2d19d-c86b-486a-a83e-6387508db507 completed by entity DHCP. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 18:05:34.143104 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-f91f7da7-047f-4066-903c-ecf59849e6d0 None None] Provisioning complete for port 6dc2d19d-c86b-486a-a83e-6387508db507 triggered by entity DHCP. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 18:05:34.148265 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-f91f7da7-047f-4066-903c-ecf59849e6d0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:34.188885 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Provisioning complete for port 0559b054-25c6-47a3-ba20-d541ac352b02 triggered by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 18:05:34.189359 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:34.272151 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvr_db [None req-f74f8a09-1261-4356-93be-b6b6f7d5a735 None None] Set router 7254d5fe-a81c-4f09-89f1-982ac4492476 gateway port host: dv-cinder-789564-2-iscsi {{(pid=99028) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 18:05:34.302547 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-0ec8d033-8f05-493d-b49a-ec55925a17d9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:34.407393 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.plugin [None req-f91f7da7-047f-4066-903c-ecf59849e6d0 None None] Port 6dc2d19d-c86b-486a-a83e-6387508db507 cannot update to ACTIVE because it is not bound. {{(pid=99028) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 25 18:05:34.537753 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-0ec8d033-8f05-493d-b49a-ec55925a17d9 admin admin] Notify callbacks [] for port, precommit_update {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:34.625580 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-0ec8d033-8f05-493d-b49a-ec55925a17d9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15476529'] for port, after_update {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:34.646489 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-f74f8a09-1261-4356-93be-b6b6f7d5a735 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcae5920dc0>, [{'id': '7254d5fe-a81c-4f09-89f1-982ac4492476', 'name': 'tempest-TestVolumeBootPattern-887772658-router', 'tenant_id': '86736d5088ad4061b747699be757d295', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.224'}], 'enable_snat': True}, 'gw_port_id': '99329f25-e0c1-49ca-9a07-ab8ede691506', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T18:05:29Z', 'updated_at': '2021-05-25T18:05:31Z', 'revision_number': 3, 'project_id': '86736d5088ad4061b747699be757d295', 'gw_port': {'id': '99329f25-e0c1-49ca-9a07-ab8ede691506', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:5b:82:13', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7254d5fe-a81c-4f09-89f1-982ac4492476', 'device_owner': 'network:router_gateway', 'standard_attr_id': 668, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.224', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T18:05:30Z', 'updated_at': '2021-05-25T18:05:33Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi'}], 'dv-cinder-789564-2-iscsi', False) {} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 18:05:34.650520 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f74f8a09-1261-4356-93be-b6b6f7d5a735 None None] The sync data for ids ['7254d5fe-a81c-4f09-89f1-982ac4492476'] in dv-cinder-789564-2-iscsi is: [{'id': '7254d5fe-a81c-4f09-89f1-982ac4492476', 'name': 'tempest-TestVolumeBootPattern-887772658-router', 'tenant_id': '86736d5088ad4061b747699be757d295', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.224'}], 'enable_snat': True}, 'gw_port_id': '99329f25-e0c1-49ca-9a07-ab8ede691506', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T18:05:29Z', 'updated_at': '2021-05-25T18:05:31Z', 'revision_number': 3, 'project_id': '86736d5088ad4061b747699be757d295', 'gw_port': {'id': '99329f25-e0c1-49ca-9a07-ab8ede691506', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:5b:82:13', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7254d5fe-a81c-4f09-89f1-982ac4492476', 'device_owner': 'network:router_gateway', 'standard_attr_id': 668, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.224', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T18:05:30Z', 'updated_at': '2021-05-25T18:05:33Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi'}] {{(pid=99028) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 25 18:05:34.655807 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-fd2a33f7-32bb-47b3-afdf-dcb463f6abb9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:05:34.742643 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-0ec8d033-8f05-493d-b49a-ec55925a17d9 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-549394', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-420925'] for router_interface, after_create {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:34.746336 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ec8d033-8f05-493d-b49a-ec55925a17d9 admin admin] Pushing event updated for resources: {'Port': ['ID=6dc2d19d-c86b-486a-a83e-6387508db507,revision_number=2']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:05:34.749623 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-0ec8d033-8f05-493d-b49a-ec55925a17d9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.095s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:05:34.906450 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0ec8d033-8f05-493d-b49a-ec55925a17d9 admin admin] Network d0c065bb-fb8d-40d4-a3f3-66b00161a624 is already hosted by enough agents. {{(pid=99026) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 18:05:34.907543 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.scheduler.base_scheduler [None req-0ec8d033-8f05-493d-b49a-ec55925a17d9 admin admin] Resources bound (agent type, host, resource id):  {{(pid=99026) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 18:05:35.114506 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0ec8d033-8f05-493d-b49a-ec55925a17d9 admin admin] Router 7254d5fe-a81c-4f09-89f1-982ac4492476 has already been hosted by L3 agent eaeb6875-c4ed-43b6-8658-aa4e52324fdf {{(pid=99026) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 25 18:05:35.134768 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-2ad6bc8b-b768-4a4f-a69d-d7d1fb988be0 None None] Provisioning complete for port 6dc2d19d-c86b-486a-a83e-6387508db507 triggered by entity DHCP. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 18:05:35.135145 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-2ad6bc8b-b768-4a4f-a69d-d7d1fb988be0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:35.195206 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.plugin [None req-2ad6bc8b-b768-4a4f-a69d-d7d1fb988be0 None None] Port 6dc2d19d-c86b-486a-a83e-6387508db507 cannot update to ACTIVE because it is not bound. {{(pid=99028) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 25 18:05:35.302061 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0ec8d033-8f05-493d-b49a-ec55925a17d9 admin admin] Notify agent at l3_agent.dv-cinder-789564-2-iscsi the message routers_updated {{(pid=99026) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 25 18:05:35.319368 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-0ec8d033-8f05-493d-b49a-ec55925a17d9 admin admin] 10.222.0.122 "PUT /v2.0/routers/7254d5fe-a81c-4f09-89f1-982ac4492476/add_router_interface HTTP/1.1" status: 200  len: 503 time: 2.7598433
May 25 18:05:35.913631 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device 99329f25-e0c1-49ca-9a07-ab8ede691506 up at agent ovs-agent-dv-cinder-789564-2-iscsi {{(pid=99028) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 18:05:36.034331 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 52674) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 18:05:36.040349 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.v2.base [None req-8734f2d3-f3ab-4236-8618-6439847c0d60 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1944539434', 'description': 'tempest-secgroup-smoke-1944539434 description', 'project_id': '6964ff917bfd44b1b1eca0a430c6cf1a'}} {{(pid=99027) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 18:05:36.046265 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-8734f2d3-f3ab-4236-8618-6439847c0d60 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 18:05:36.050117 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-8734f2d3-f3ab-4236-8618-6439847c0d60 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Usage tracker for resource:security_group and tenant:6964ff917bfd44b1b1eca0a430c6cf1a is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 18:05:36.053500 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-8734f2d3-f3ab-4236-8618-6439847c0d60 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 18:05:36.059917 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-8734f2d3-f3ab-4236-8618-6439847c0d60 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 18:05:36.065385 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Provisioning for port 99329f25-e0c1-49ca-9a07-ab8ede691506 completed by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 18:05:36.071292 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Provisioning complete for port 99329f25-e0c1-49ca-9a07-ab8ede691506 triggered by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 18:05:36.071666 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:36.174190 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-8734f2d3-f3ab-4236-8618-6439847c0d60 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Notify callbacks [] for security_group, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:36.193421 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:36.196199 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-8734f2d3-f3ab-4236-8618-6439847c0d60 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 18:05:36.200408 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-8734f2d3-f3ab-4236-8618-6439847c0d60 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Usage tracker for resource:security_group_rule and tenant:6964ff917bfd44b1b1eca0a430c6cf1a is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 18:05:36.204518 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-8734f2d3-f3ab-4236-8618-6439847c0d60 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 18:05:36.210246 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] For port 99329f25-e0c1-49ca-9a07-ab8ede691506, host dv-cinder-789564-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=99329f25-e0c1-49ca-9a07-ab8ede691506,segment=NetworkSegment(471771f9-c462-4865-800d-0d5029e9eb3e),segment_id=471771f9-c462-4865-800d-0d5029e9eb3e)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 18:05:36.210771 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-8734f2d3-f3ab-4236-8618-6439847c0d60 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 18:05:36.283337 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-8734f2d3-f3ab-4236-8618-6439847c0d60 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Notify callbacks [] for security_group, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:36.294517 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:36.296411 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-0e1d460e-3707-4809-bc86-15e5f62fc1a0 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:05:36.366020 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Pushing event updated for resources: {'Port': ['ID=99329f25-e0c1-49ca-9a07-ab8ede691506,revision_number=4']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:05:36.367955 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-8734f2d3-f3ab-4236-8618-6439847c0d60 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:36.369195 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:05:36.374188 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-937fbfbc-7fd8-43dd-98a6-165fb5e3bea1 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:05:36.399305 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-934de389-3877-4ce1-89e1-dd67515bc51c None None] Sync routers for ids ['7254d5fe-a81c-4f09-89f1-982ac4492476'] in dv-cinder-789564-2-iscsi {{(pid=99029) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 25 18:05:36.408671 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_dvrscheduler_db [None req-934de389-3877-4ce1-89e1-dd67515bc51c None None] Routers {'7254d5fe-a81c-4f09-89f1-982ac4492476'} bound to L3 agent in host dv-cinder-789564-2-iscsi {{(pid=99029) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 18:05:36.409371 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_hamode_db [None req-934de389-3877-4ce1-89e1-dd67515bc51c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcae7126400>, 'dv-cinder-789564-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-25T17:34:21Z,description=<?>,heartbeat_timestamp=2021-05-25T18:05:21Z,host='dv-cinder-789564-2-iscsi',id=eaeb6875-c4ed-43b6-8658-aa4e52324fdf,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T17:34:21Z,topic='l3_agent')) {'router_ids': ['7254d5fe-a81c-4f09-89f1-982ac4492476'], 'active': True} {{(pid=99029) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 18:05:36.414536 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8734f2d3-f3ab-4236-8618-6439847c0d60 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Pushing event updated for resources: {'SecurityGroup': ['ID=ae00d844-d334-4393-8fc2-9764c8279060,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:05:36.417564 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-8734f2d3-f3ab-4236-8618-6439847c0d60 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:05:36.505950 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-8734f2d3-f3ab-4236-8618-6439847c0d60 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Notify callbacks [] for security_group, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:36.507214 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-8734f2d3-f3ab-4236-8618-6439847c0d60 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] 10.222.0.122 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1794 time: 0.4718854
May 25 18:05:36.510154 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 52678) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 18:05:36.515747 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.v2.base [None req-e025881a-412e-4f12-9509-d86a97d3f638 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Request body: {'security_group_rule': {'security_group_id': 'ae00d844-d334-4393-8fc2-9764c8279060', 'project_id': '6964ff917bfd44b1b1eca0a430c6cf1a', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=99027) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 18:05:36.522009 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-e025881a-412e-4f12-9509-d86a97d3f638 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 18:05:36.525826 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-e025881a-412e-4f12-9509-d86a97d3f638 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Usage tracker for resource:security_group_rule and tenant:6964ff917bfd44b1b1eca0a430c6cf1a is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 18:05:36.528766 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-e025881a-412e-4f12-9509-d86a97d3f638 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 18:05:36.534417 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-e025881a-412e-4f12-9509-d86a97d3f638 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 18:05:36.587739 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_dvr_db [None req-934de389-3877-4ce1-89e1-dd67515bc51c None None] Set router 7254d5fe-a81c-4f09-89f1-982ac4492476 gateway port host: dv-cinder-789564-2-iscsi {{(pid=99029) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 18:05:36.677317 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-e025881a-412e-4f12-9509-d86a97d3f638 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Notify callbacks [] for security_group_rule, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:36.737765 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-e025881a-412e-4f12-9509-d86a97d3f638 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:36.825510 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-e025881a-412e-4f12-9509-d86a97d3f638 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459369'] for security_group_rule, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:36.827633 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:05:36.854152 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e025881a-412e-4f12-9509-d86a97d3f638 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=ae55aee1-de1d-4181-841f-3f12812877d6,revision_number=0']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:05:36.856825 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-e025881a-412e-4f12-9509-d86a97d3f638 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:05:36.923331 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_hamode_db [None req-934de389-3877-4ce1-89e1-dd67515bc51c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcae7126400>, [{'id': '7254d5fe-a81c-4f09-89f1-982ac4492476', 'name': 'tempest-TestVolumeBootPattern-887772658-router', 'tenant_id': '86736d5088ad4061b747699be757d295', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.224'}], 'enable_snat': True}, 'gw_port_id': '99329f25-e0c1-49ca-9a07-ab8ede691506', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T18:05:29Z', 'updated_at': '2021-05-25T18:05:34Z', 'revision_number': 4, 'project_id': '86736d5088ad4061b747699be757d295', 'gw_port': {'id': '99329f25-e0c1-49ca-9a07-ab8ede691506', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:5b:82:13', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7254d5fe-a81c-4f09-89f1-982ac4492476', 'device_owner': 'network:router_gateway', 'standard_attr_id': 668, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.224', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T18:05:30Z', 'updated_at': '2021-05-25T18:05:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi', '_interfaces': [{'id': '6dc2d19d-c86b-486a-a83e-6387508db507', 'name': '', 'network_id': 'd0c065bb-fb8d-40d4-a3f3-66b00161a624', 'tenant_id': '86736d5088ad4061b747699be757d295', 'mac_address': 'fa:16:3e:af:74:b6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7254d5fe-a81c-4f09-89f1-982ac4492476', 'device_owner': 'network:router_interface', 'standard_attr_id': 669, 'fixed_ips': [{'subnet_id': '23442663-84d3-4654-aee4-80434487f265', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T18:05:33Z', 'updated_at': '2021-05-25T18:05:34Z', 'revision_number': 2, 'project_id': '86736d5088ad4061b747699be757d295', 'subnets': [{'id': '23442663-84d3-4654-aee4-80434487f265', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-789564-2-iscsi', False) {} {{(pid=99029) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 18:05:36.927774 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-934de389-3877-4ce1-89e1-dd67515bc51c None None] Checking router: 7254d5fe-a81c-4f09-89f1-982ac4492476 for host: dv-cinder-789564-2-iscsi {{(pid=99029) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 25 18:05:36.928072 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-934de389-3877-4ce1-89e1-dd67515bc51c None None] Updating router 7254d5fe-a81c-4f09-89f1-982ac4492476 port 6dc2d19d-c86b-486a-a83e-6387508db507 binding host dv-cinder-789564-2-iscsi {{(pid=99029) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 25 18:05:36.945885 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-e025881a-412e-4f12-9509-d86a97d3f638 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Notify callbacks [] for security_group_rule, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:36.953662 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-e025881a-412e-4f12-9509-d86a97d3f638 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] 10.222.0.122 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 0.4361207
May 25 18:05:36.953662 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 52682) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 18:05:36.955047 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.v2.base [None req-cd54d285-b3b6-4207-9dd2-1398cb41e128 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Request body: {'security_group_rule': {'security_group_id': 'ae00d844-d334-4393-8fc2-9764c8279060', 'project_id': '6964ff917bfd44b1b1eca0a430c6cf1a', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=99027) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 18:05:36.960988 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-cd54d285-b3b6-4207-9dd2-1398cb41e128 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 18:05:36.964842 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-cd54d285-b3b6-4207-9dd2-1398cb41e128 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Usage tracker for resource:security_group_rule and tenant:6964ff917bfd44b1b1eca0a430c6cf1a is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 18:05:36.967672 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-cd54d285-b3b6-4207-9dd2-1398cb41e128 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 18:05:36.973654 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-cd54d285-b3b6-4207-9dd2-1398cb41e128 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 18:05:36.979477 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron_lib.callbacks.manager [None req-934de389-3877-4ce1-89e1-dd67515bc51c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99029) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:37.089490 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-cd54d285-b3b6-4207-9dd2-1398cb41e128 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Notify callbacks [] for security_group_rule, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:37.151629 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-cd54d285-b3b6-4207-9dd2-1398cb41e128 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:37.231126 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-cd54d285-b3b6-4207-9dd2-1398cb41e128 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459369'] for security_group_rule, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:37.233641 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-8ef1d05f-f6d8-41f9-92a6-51a6f3abd183 tempest-AttachVolumeShelveTestJSON-1799171361 tempest-AttachVolumeShelveTestJSON-1799171361-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:05:37.251579 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd54d285-b3b6-4207-9dd2-1398cb41e128 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b342f6b9-3def-4c8f-982c-63389f45476d,revision_number=0']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:05:37.262911 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-cd54d285-b3b6-4207-9dd2-1398cb41e128 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:05:37.314965 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron_lib.callbacks.manager [None req-934de389-3877-4ce1-89e1-dd67515bc51c None None] Notify callbacks [] for port, precommit_update {{(pid=99029) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:37.326080 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.provisioning_blocks [None req-934de389-3877-4ce1-89e1-dd67515bc51c None None] Transition to ACTIVE for port object 6dc2d19d-c86b-486a-a83e-6387508db507 will not be triggered until provisioned by entity L2. {{(pid=99029) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 18:05:37.350958 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-cd54d285-b3b6-4207-9dd2-1398cb41e128 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Notify callbacks [] for security_group_rule, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:37.352172 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-cd54d285-b3b6-4207-9dd2-1398cb41e128 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] 10.222.0.122 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 763 time: 0.4013367
May 25 18:05:37.355040 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 52686) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 18:05:37.360164 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.v2.base [None req-8cd9ad47-7002-4120-8851-84a10a830d97 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Request body: {'security_group_rule': {'security_group_id': 'ae00d844-d334-4393-8fc2-9764c8279060', 'project_id': '6964ff917bfd44b1b1eca0a430c6cf1a', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=99027) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 18:05:37.366854 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-8cd9ad47-7002-4120-8851-84a10a830d97 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 18:05:37.370620 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-8cd9ad47-7002-4120-8851-84a10a830d97 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Usage tracker for resource:security_group_rule and tenant:6964ff917bfd44b1b1eca0a430c6cf1a is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 18:05:37.373442 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-8cd9ad47-7002-4120-8851-84a10a830d97 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 18:05:37.379361 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-8cd9ad47-7002-4120-8851-84a10a830d97 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 18:05:37.436518 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron_lib.callbacks.manager [None req-934de389-3877-4ce1-89e1-dd67515bc51c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99029) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:37.440562 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG oslo_concurrency.lockutils [None req-d3703660-749f-4f8a-9c4d-1acd9653f4a9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:05:37.471419 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-8cd9ad47-7002-4120-8851-84a10a830d97 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Notify callbacks [] for security_group_rule, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:37.540381 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-8cd9ad47-7002-4120-8851-84a10a830d97 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:37.567940 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7bc44509-b119-4b87-a18a-7ce4a91faeab None None] Pushing event updated for resources: {'Port': ['ID=6dc2d19d-c86b-486a-a83e-6387508db507,revision_number=3']} {{(pid=99029) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:05:37.594265 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG oslo_concurrency.lockutils [None req-7bc44509-b119-4b87-a18a-7ce4a91faeab None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.154s {{(pid=99029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:05:37.631745 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-8cd9ad47-7002-4120-8851-84a10a830d97 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459369'] for security_group_rule, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:37.642665 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:05:37.662159 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8cd9ad47-7002-4120-8851-84a10a830d97 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=588940bc-0bc5-490e-9bbe-95af73cbba3c,revision_number=0']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:05:37.665117 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-8cd9ad47-7002-4120-8851-84a10a830d97 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.022s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:05:37.668374 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.plugins.ml2.managers [None req-934de389-3877-4ce1-89e1-dd67515bc51c None None] Attempting to bind port 6dc2d19d-c86b-486a-a83e-6387508db507 on host dv-cinder-789564-2-iscsi for vnic_type normal with profile  {{(pid=99029) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 18:05:37.668474 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.plugins.ml2.managers [None req-934de389-3877-4ce1-89e1-dd67515bc51c None None] Attempting to bind port 6dc2d19d-c86b-486a-a83e-6387508db507 by drivers openvswitch,hyperv on host dv-cinder-789564-2-iscsi at level 0 using segments [{'id': '519aa405-52e1-4777-ad06-c8bf40b2bbf0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1319, 'network_id': 'd0c065bb-fb8d-40d4-a3f3-66b00161a624'}] {{(pid=99029) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 18:05:37.668769 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-934de389-3877-4ce1-89e1-dd67515bc51c None None] Attempting to bind port 6dc2d19d-c86b-486a-a83e-6387508db507 on network d0c065bb-fb8d-40d4-a3f3-66b00161a624 {{(pid=99029) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 18:05:37.675352 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-934de389-3877-4ce1-89e1-dd67515bc51c None None] Checking agent: {'id': '7bb67520-1e97-4ad9-9b97-101068bbe1a3', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-789564-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 17, 34, 21), 'started_at': datetime.datetime(2021, 5, 25, 17, 34, 51), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 18, 5, 21), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-789564-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=99029) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 18:05:37.681450 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-934de389-3877-4ce1-89e1-dd67515bc51c None None] Checking segment: {'id': '519aa405-52e1-4777-ad06-c8bf40b2bbf0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1319, 'network_id': 'd0c065bb-fb8d-40d4-a3f3-66b00161a624'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=99029) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 18:05:37.681450 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron_lib.callbacks.manager [None req-934de389-3877-4ce1-89e1-dd67515bc51c None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=99029) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:37.681450 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-934de389-3877-4ce1-89e1-dd67515bc51c None None] Bound using segment: {'id': '519aa405-52e1-4777-ad06-c8bf40b2bbf0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1319, 'network_id': 'd0c065bb-fb8d-40d4-a3f3-66b00161a624'} {{(pid=99029) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 18:05:37.681450 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.plugins.ml2.managers [None req-934de389-3877-4ce1-89e1-dd67515bc51c None None] Bound port: 6dc2d19d-c86b-486a-a83e-6387508db507, host: dv-cinder-789564-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '519aa405-52e1-4777-ad06-c8bf40b2bbf0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1319, 'network_id': 'd0c065bb-fb8d-40d4-a3f3-66b00161a624'}}] {{(pid=99029) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 18:05:37.681450 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron_lib.callbacks.manager [None req-934de389-3877-4ce1-89e1-dd67515bc51c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99029) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:37.772234 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.plugins.ml2.db [None req-934de389-3877-4ce1-89e1-dd67515bc51c None None] For port 6dc2d19d-c86b-486a-a83e-6387508db507, host dv-cinder-789564-2-iscsi, cleared binding levels {{(pid=99029) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 18:05:37.772234 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.plugins.ml2.db [None req-934de389-3877-4ce1-89e1-dd67515bc51c None None] For port 6dc2d19d-c86b-486a-a83e-6387508db507, host dv-cinder-789564-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=6dc2d19d-c86b-486a-a83e-6387508db507,segment=NetworkSegment(519aa405-52e1-4777-ad06-c8bf40b2bbf0),segment_id=519aa405-52e1-4777-ad06-c8bf40b2bbf0)] {{(pid=99029) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 18:05:37.796524 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-8cd9ad47-7002-4120-8851-84a10a830d97 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Notify callbacks [] for security_group_rule, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:37.797758 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-8cd9ad47-7002-4120-8851-84a10a830d97 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] 10.222.0.122 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.4417615
May 25 18:05:37.800373 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 52690) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 18:05:37.806425 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.v2.base [None req-727f1c85-2226-4856-bd71-e0774b8c1e2f tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Request body: {'security_group_rule': {'security_group_id': 'ae00d844-d334-4393-8fc2-9764c8279060', 'project_id': '6964ff917bfd44b1b1eca0a430c6cf1a', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=99027) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 18:05:37.820711 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-727f1c85-2226-4856-bd71-e0774b8c1e2f tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 18:05:37.824861 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-727f1c85-2226-4856-bd71-e0774b8c1e2f tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Usage tracker for resource:security_group_rule and tenant:6964ff917bfd44b1b1eca0a430c6cf1a is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 18:05:37.827755 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-727f1c85-2226-4856-bd71-e0774b8c1e2f tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 18:05:37.833900 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-727f1c85-2226-4856-bd71-e0774b8c1e2f tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 18:05:37.879542 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device 99329f25-e0c1-49ca-9a07-ab8ede691506 up at agent ovs-agent-dv-cinder-789564-2-iscsi {{(pid=99028) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 18:05:37.894217 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron_lib.callbacks.manager [None req-934de389-3877-4ce1-89e1-dd67515bc51c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99029) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:37.898782 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG oslo_concurrency.lockutils [None req-91f8f6a8-9701-4a28-8be1-d06c4f5748ca None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:05:37.945996 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-727f1c85-2226-4856-bd71-e0774b8c1e2f tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Notify callbacks [] for security_group_rule, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:37.964935 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Provisioning complete for port 99329f25-e0c1-49ca-9a07-ab8ede691506 triggered by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 18:05:37.965627 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:37.968090 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7bc44509-b119-4b87-a18a-7ce4a91faeab None None] Pushing event updated for resources: {'Port': ['ID=6dc2d19d-c86b-486a-a83e-6387508db507,revision_number=4']} {{(pid=99029) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:05:37.972470 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG oslo_concurrency.lockutils [None req-7bc44509-b119-4b87-a18a-7ce4a91faeab None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=99029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:05:37.983018 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_dvrscheduler_db [None req-934de389-3877-4ce1-89e1-dd67515bc51c None None] Routers {'7254d5fe-a81c-4f09-89f1-982ac4492476'} bound to L3 agent in host dv-cinder-789564-2-iscsi {{(pid=99029) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 18:05:37.983642 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_hamode_db [None req-934de389-3877-4ce1-89e1-dd67515bc51c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcae7126400>, 'dv-cinder-789564-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-25T17:34:21Z,description=<?>,heartbeat_timestamp=2021-05-25T18:05:21Z,host='dv-cinder-789564-2-iscsi',id=eaeb6875-c4ed-43b6-8658-aa4e52324fdf,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T17:34:21Z,topic='l3_agent')) {'router_ids': ['7254d5fe-a81c-4f09-89f1-982ac4492476'], 'active': True} {{(pid=99029) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 18:05:38.035202 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-727f1c85-2226-4856-bd71-e0774b8c1e2f tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:38.122885 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-727f1c85-2226-4856-bd71-e0774b8c1e2f tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459369'] for security_group_rule, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:38.126041 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:05:38.149321 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-727f1c85-2226-4856-bd71-e0774b8c1e2f tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=72dd4a1f-333a-4620-874c-7630584c2ec1,revision_number=0']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:05:38.160563 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-727f1c85-2226-4856-bd71-e0774b8c1e2f tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.034s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:05:38.173448 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_dvr_db [None req-934de389-3877-4ce1-89e1-dd67515bc51c None None] Set router 7254d5fe-a81c-4f09-89f1-982ac4492476 gateway port host: dv-cinder-789564-2-iscsi {{(pid=99029) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 18:05:38.265192 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-727f1c85-2226-4856-bd71-e0774b8c1e2f tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Notify callbacks [] for security_group_rule, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:38.269010 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-727f1c85-2226-4856-bd71-e0774b8c1e2f tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] 10.222.0.122 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 768 time: 0.4651647
May 25 18:05:38.269190 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 52694) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 18:05:38.276180 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.v2.base [None req-c157c719-99bd-466c-b4a7-f86f96542869 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Request body: {'security_group_rule': {'security_group_id': 'ae00d844-d334-4393-8fc2-9764c8279060', 'project_id': '6964ff917bfd44b1b1eca0a430c6cf1a', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=99027) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 18:05:38.282458 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-c157c719-99bd-466c-b4a7-f86f96542869 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 18:05:38.288743 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-c157c719-99bd-466c-b4a7-f86f96542869 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Usage tracker for resource:security_group_rule and tenant:6964ff917bfd44b1b1eca0a430c6cf1a is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 18:05:38.292722 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-c157c719-99bd-466c-b4a7-f86f96542869 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 18:05:38.299897 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-c157c719-99bd-466c-b4a7-f86f96542869 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 18:05:38.419432 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.db.securitygroups_db [None req-c157c719-99bd-466c-b4a7-f86f96542869 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Project 6964ff917bfd44b1b1eca0a430c6cf1a added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted.
May 25 18:05:38.425353 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-c157c719-99bd-466c-b4a7-f86f96542869 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Notify callbacks [] for security_group_rule, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:38.486456 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_hamode_db [None req-934de389-3877-4ce1-89e1-dd67515bc51c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcae7126400>, [{'id': '7254d5fe-a81c-4f09-89f1-982ac4492476', 'name': 'tempest-TestVolumeBootPattern-887772658-router', 'tenant_id': '86736d5088ad4061b747699be757d295', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.224'}], 'enable_snat': True}, 'gw_port_id': '99329f25-e0c1-49ca-9a07-ab8ede691506', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T18:05:29Z', 'updated_at': '2021-05-25T18:05:34Z', 'revision_number': 4, 'project_id': '86736d5088ad4061b747699be757d295', 'gw_port': {'id': '99329f25-e0c1-49ca-9a07-ab8ede691506', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:5b:82:13', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7254d5fe-a81c-4f09-89f1-982ac4492476', 'device_owner': 'network:router_gateway', 'standard_attr_id': 668, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.224', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T18:05:30Z', 'updated_at': '2021-05-25T18:05:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi', '_interfaces': [{'id': '6dc2d19d-c86b-486a-a83e-6387508db507', 'name': '', 'network_id': 'd0c065bb-fb8d-40d4-a3f3-66b00161a624', 'tenant_id': '86736d5088ad4061b747699be757d295', 'mac_address': 'fa:16:3e:af:74:b6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7254d5fe-a81c-4f09-89f1-982ac4492476', 'device_owner': 'network:router_interface', 'standard_attr_id': 669, 'fixed_ips': [{'subnet_id': '23442663-84d3-4654-aee4-80434487f265', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T18:05:33Z', 'updated_at': '2021-05-25T18:05:37Z', 'revision_number': 4, 'project_id': '86736d5088ad4061b747699be757d295', 'subnets': [{'id': '23442663-84d3-4654-aee4-80434487f265', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-789564-2-iscsi', False) {} {{(pid=99029) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 18:05:38.491071 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-934de389-3877-4ce1-89e1-dd67515bc51c None None] The sync data for ids ['7254d5fe-a81c-4f09-89f1-982ac4492476'] in dv-cinder-789564-2-iscsi is: [{'id': '7254d5fe-a81c-4f09-89f1-982ac4492476', 'name': 'tempest-TestVolumeBootPattern-887772658-router', 'tenant_id': '86736d5088ad4061b747699be757d295', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.224'}], 'enable_snat': True}, 'gw_port_id': '99329f25-e0c1-49ca-9a07-ab8ede691506', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T18:05:29Z', 'updated_at': '2021-05-25T18:05:34Z', 'revision_number': 4, 'project_id': '86736d5088ad4061b747699be757d295', 'gw_port': {'id': '99329f25-e0c1-49ca-9a07-ab8ede691506', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:5b:82:13', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7254d5fe-a81c-4f09-89f1-982ac4492476', 'device_owner': 'network:router_gateway', 'standard_attr_id': 668, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.224', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T18:05:30Z', 'updated_at': '2021-05-25T18:05:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi', '_interfaces': [{'id': '6dc2d19d-c86b-486a-a83e-6387508db507', 'name': '', 'network_id': 'd0c065bb-fb8d-40d4-a3f3-66b00161a624', 'tenant_id': '86736d5088ad4061b747699be757d295', 'mac_address': 'fa:16:3e:af:74:b6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7254d5fe-a81c-4f09-89f1-982ac4492476', 'device_owner': 'network:router_interface', 'standard_attr_id': 669, 'fixed_ips': [{'subnet_id': '23442663-84d3-4654-aee4-80434487f265', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T18:05:33Z', 'updated_at': '2021-05-25T18:05:37Z', 'revision_number': 4, 'project_id': '86736d5088ad4061b747699be757d295', 'subnets': [{'id': '23442663-84d3-4654-aee4-80434487f265', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=99029) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 25 18:05:38.492630 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-c157c719-99bd-466c-b4a7-f86f96542869 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:38.631840 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-c157c719-99bd-466c-b4a7-f86f96542869 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459369'] for security_group_rule, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:38.638867 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:05:38.666339 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c157c719-99bd-466c-b4a7-f86f96542869 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=4e6363ff-bfeb-4590-acc4-6ff4cc1c5e9e,revision_number=0']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:05:38.668761 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-c157c719-99bd-466c-b4a7-f86f96542869 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.033s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:05:38.780313 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-c157c719-99bd-466c-b4a7-f86f96542869 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Notify callbacks [] for security_group_rule, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:38.781530 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-c157c719-99bd-466c-b4a7-f86f96542869 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] 10.222.0.122 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 774 time: 0.5113413
May 25 18:05:38.784358 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 52698) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 18:05:38.789976 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.v2.base [None req-e0e48346-e100-4a58-9d63-b9c15ff3b060 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Request body: {'security_group_rule': {'security_group_id': 'ae00d844-d334-4393-8fc2-9764c8279060', 'project_id': '6964ff917bfd44b1b1eca0a430c6cf1a', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=99027) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 18:05:38.799351 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-e0e48346-e100-4a58-9d63-b9c15ff3b060 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 18:05:38.800623 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-e0e48346-e100-4a58-9d63-b9c15ff3b060 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Usage tracker for resource:security_group_rule and tenant:6964ff917bfd44b1b1eca0a430c6cf1a is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 18:05:38.803819 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-e0e48346-e100-4a58-9d63-b9c15ff3b060 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 18:05:38.809584 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-e0e48346-e100-4a58-9d63-b9c15ff3b060 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 18:05:38.911167 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.db.securitygroups_db [None req-e0e48346-e100-4a58-9d63-b9c15ff3b060 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Project 6964ff917bfd44b1b1eca0a430c6cf1a added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted.
May 25 18:05:38.917924 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-e0e48346-e100-4a58-9d63-b9c15ff3b060 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Notify callbacks [] for security_group_rule, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:38.994109 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-e0e48346-e100-4a58-9d63-b9c15ff3b060 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:39.065368 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-e0e48346-e100-4a58-9d63-b9c15ff3b060 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459369'] for security_group_rule, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:39.068211 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:05:39.091879 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0e48346-e100-4a58-9d63-b9c15ff3b060 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=bbcc334e-2320-49f6-881c-3c278b8bc9b3,revision_number=0']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:05:39.097218 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-e0e48346-e100-4a58-9d63-b9c15ff3b060 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:05:39.225279 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-e0e48346-e100-4a58-9d63-b9c15ff3b060 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Notify callbacks [] for security_group_rule, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:39.226503 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-e0e48346-e100-4a58-9d63-b9c15ff3b060 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] 10.222.0.122 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 773 time: 0.4411185
May 25 18:05:39.896353 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device 6dc2d19d-c86b-486a-a83e-6387508db507 up at agent ovs-agent-dv-cinder-789564-2-iscsi {{(pid=99028) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 18:05:40.047920 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Provisioning for port 6dc2d19d-c86b-486a-a83e-6387508db507 completed by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 18:05:40.052832 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Provisioning complete for port 6dc2d19d-c86b-486a-a83e-6387508db507 triggered by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 18:05:40.053243 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:40.169768 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:40.201235 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] For port 6dc2d19d-c86b-486a-a83e-6387508db507, host dv-cinder-789564-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=6dc2d19d-c86b-486a-a83e-6387508db507,segment=NetworkSegment(519aa405-52e1-4777-ad06-c8bf40b2bbf0),segment_id=519aa405-52e1-4777-ad06-c8bf40b2bbf0)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 18:05:40.310786 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:40.312626 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:05:40.384580 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Pushing event updated for resources: {'Port': ['ID=6dc2d19d-c86b-486a-a83e-6387508db507,revision_number=5']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:05:40.387723 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:05:41.796892 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:41.891612 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device 6dc2d19d-c86b-486a-a83e-6387508db507 up at agent ovs-agent-dv-cinder-789564-2-iscsi {{(pid=99028) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 18:05:41.961978 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Provisioning complete for port 6dc2d19d-c86b-486a-a83e-6387508db507 triggered by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 18:05:41.962355 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:48.208376 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-e4169dd1-6fa8-4a8b-a190-ac49553c4bc6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:50.687735 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-f2dbc8a6-0cf9-4ba1-a488-a319b8cfde1e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:50.870159 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:51.824891 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-7e261f94-b84f-443e-be49-3bc1ac903b55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:53.435759 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-6df2b2a7-a54e-4d57-9be3-033078b9d5b3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:55.055928 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-4876a76c-fce4-4c92-a635-44c701ac4769 req-c34c414b-72a0-4fb8-97d6-9a8d709ef9c8 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Synchronizing usage tracker for tenant:6964ff917bfd44b1b1eca0a430c6cf1a on resource:security_group {{(pid=99027) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 18:05:55.133019 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-4876a76c-fce4-4c92-a635-44c701ac4769 req-c34c414b-72a0-4fb8-97d6-9a8d709ef9c8 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Unset dirty status for tenant:6964ff917bfd44b1b1eca0a430c6cf1a on resource:security_group {{(pid=99027) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 18:05:55.134261 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-4876a76c-fce4-4c92-a635-44c701ac4769 req-c34c414b-72a0-4fb8-97d6-9a8d709ef9c8 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] 10.222.0.122 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1944539434&fields=id&tenant_id=6964ff917bfd44b1b1eca0a430c6cf1a HTTP/1.1" status: 200  len: 267 time: 0.1172359
May 25 18:05:55.283682 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4876a76c-fce4-4c92-a635-44c701ac4769 req-af61d59d-2b50-49bb-b6cb-9b9281c90067 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:05:55.284364 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-4876a76c-fce4-4c92-a635-44c701ac4769 req-af61d59d-2b50-49bb-b6cb-9b9281c90067 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Synchronizing usage tracker for tenant:6964ff917bfd44b1b1eca0a430c6cf1a on resource:network {{(pid=99027) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 18:05:55.401548 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-4876a76c-fce4-4c92-a635-44c701ac4769 req-af61d59d-2b50-49bb-b6cb-9b9281c90067 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Unset dirty status for tenant:6964ff917bfd44b1b1eca0a430c6cf1a on resource:network {{(pid=99027) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 18:05:55.402840 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-4876a76c-fce4-4c92-a635-44c701ac4769 req-af61d59d-2b50-49bb-b6cb-9b9281c90067 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] 10.222.0.122 "GET /v2.0/networks?id=66e6b1a7-3352-49c8-951e-25e4133a13bb HTTP/1.1" status: 200  len: 812 time: 0.2621152
May 25 18:05:55.417775 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-4876a76c-fce4-4c92-a635-44c701ac4769 req-a444ca6e-28a4-42ff-9f89-760587644da6 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] 10.222.0.122 "GET /v2.0/quotas/6964ff917bfd44b1b1eca0a430c6cf1a HTTP/1.1" status: 200  len: 375 time: 0.0095084
May 25 18:05:55.501923 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-4876a76c-fce4-4c92-a635-44c701ac4769 req-fd512da3-941b-4e00-ae08-eb535adb1e56 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Synchronizing usage tracker for tenant:6964ff917bfd44b1b1eca0a430c6cf1a on resource:port {{(pid=99027) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 18:05:55.601790 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-4876a76c-fce4-4c92-a635-44c701ac4769 req-fd512da3-941b-4e00-ae08-eb535adb1e56 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Unset dirty status for tenant:6964ff917bfd44b1b1eca0a430c6cf1a on resource:port {{(pid=99027) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 18:05:55.603040 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-4876a76c-fce4-4c92-a635-44c701ac4769 req-fd512da3-941b-4e00-ae08-eb535adb1e56 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] 10.222.0.122 "GET /v2.0/ports?tenant_id=6964ff917bfd44b1b1eca0a430c6cf1a&fields=id HTTP/1.1" status: 200  len: 302 time: 0.1804645
May 25 18:05:55.725134 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [req-4876a76c-fce4-4c92-a635-44c701ac4769 req-51bb8fcf-68c0-4524-9c15-c26cd6a2d16d service neutron] http://10.222.0.122:9696/v2.0/extensions returned with HTTP 200 {{(pid=99027) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 25 18:05:55.726118 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-4876a76c-fce4-4c92-a635-44c701ac4769 req-51bb8fcf-68c0-4524-9c15-c26cd6a2d16d service neutron] 10.222.0.122 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.1114640
May 25 18:05:55.858962 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-4876a76c-fce4-4c92-a635-44c701ac4769 req-39a4c6f3-0919-448c-80ac-5922e866a76d service neutron] 10.222.0.122 "GET /v2.0/networks/66e6b1a7-3352-49c8-951e-25e4133a13bb?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1268053
May 25 18:05:55.989617 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-4876a76c-fce4-4c92-a635-44c701ac4769 req-508972b8-f53c-47f6-a343-830726d31144 service neutron] 10.222.0.122 "GET /v2.0/networks/66e6b1a7-3352-49c8-951e-25e4133a13bb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1242433
May 25 18:05:56.870230 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-59d5c302-99a2-4115-8780-daff3f72184a req-b6174aea-9a30-408b-a32a-a3042f98e24a tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] 10.222.0.122 "GET /v2.0/ports?device_id=76bacbde-212b-4bd5-b147-4cf3c743d2d6 HTTP/1.1" status: 200  len: 210 time: 0.0443122
May 25 18:05:58.026364 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-c7b993d4-a3b6-4bad-939d-9946106b26cb req-f43087c8-cd97-41dd-97ea-0da8237f81af tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] 10.222.0.122 "GET /v2.0/ports?device_id=76bacbde-212b-4bd5-b147-4cf3c743d2d6 HTTP/1.1" status: 200  len: 210 time: 0.0441115
May 25 18:05:59.177099 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-f847599c-8d51-4851-b5c1-a592a5b42590 req-58829cc1-baaf-451a-b402-76121907f189 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] 10.222.0.122 "GET /v2.0/ports?device_id=76bacbde-212b-4bd5-b147-4cf3c743d2d6 HTTP/1.1" status: 200  len: 210 time: 0.0427632
May 25 18:05:59.509647 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4876a76c-fce4-4c92-a635-44c701ac4769 req-9d0e90fc-8372-40e2-93e9-ba916081f11e tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:05:59.511069 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-4876a76c-fce4-4c92-a635-44c701ac4769 req-9d0e90fc-8372-40e2-93e9-ba916081f11e tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] 10.222.0.125 "GET /v2.0/networks?id=66e6b1a7-3352-49c8-951e-25e4133a13bb HTTP/1.1" status: 200  len: 812 time: 0.1499085
May 25 18:05:59.565355 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-4876a76c-fce4-4c92-a635-44c701ac4769 req-6ae6208c-eb3d-4777-85dd-1731c4d7854a tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] 10.222.0.125 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=6964ff917bfd44b1b1eca0a430c6cf1a HTTP/1.1" status: 200  len: 380 time: 0.0410345
May 25 18:05:59.575216 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.v2.base [req-4876a76c-fce4-4c92-a635-44c701ac4769 req-39d56a7c-0170-4807-9a3e-b81c01446f91 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Request body: {'port': {'device_id': '76bacbde-212b-4bd5-b147-4cf3c743d2d6', 'network_id': '66e6b1a7-3352-49c8-951e-25e4133a13bb', 'admin_state_up': True, 'tenant_id': '6964ff917bfd44b1b1eca0a430c6cf1a', 'security_groups': ['ae00d844-d334-4393-8fc2-9764c8279060']}} {{(pid=99027) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 18:05:59.714067 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [req-4876a76c-fce4-4c92-a635-44c701ac4769 req-39d56a7c-0170-4807-9a3e-b81c01446f91 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 18:05:59.724073 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [req-4876a76c-fce4-4c92-a635-44c701ac4769 req-39d56a7c-0170-4807-9a3e-b81c01446f91 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 18:05:59.802141 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-4876a76c-fce4-4c92-a635-44c701ac4769 req-39d56a7c-0170-4807-9a3e-b81c01446f91 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Made reservation on behalf of 6964ff917bfd44b1b1eca0a430c6cf1a for: {'port': 1} {{(pid=99027) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 25 18:05:59.806102 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-4876a76c-fce4-4c92-a635-44c701ac4769 req-39d56a7c-0170-4807-9a3e-b81c01446f91 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:05:59.974354 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.db_base_plugin_common [req-4876a76c-fce4-4c92-a635-44c701ac4769 req-39d56a7c-0170-4807-9a3e-b81c01446f91 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Allocated IP 172.20.0.13 (66e6b1a7-3352-49c8-951e-25e4133a13bb/7e40c2eb-fb3c-4338-9398-6fcd43705fa8/f7d352f2-c558-4275-816b-84b53eee03cb) {{(pid=99027) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 18:06:00.305670 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-4876a76c-fce4-4c92-a635-44c701ac4769 req-39d56a7c-0170-4807-9a3e-b81c01446f91 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Notify callbacks [] for port, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:06:00.371843 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-282f837d-88af-47dc-8111-da74ec5e1f09 req-05f8a530-bc33-407e-a5fc-095fadc236e4 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] 10.222.0.122 "GET /v2.0/ports?device_id=76bacbde-212b-4bd5-b147-4cf3c743d2d6 HTTP/1.1" status: 200  len: 210 time: 0.0704210
May 25 18:06:00.378613 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.provisioning_blocks [req-4876a76c-fce4-4c92-a635-44c701ac4769 req-39d56a7c-0170-4807-9a3e-b81c01446f91 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Transition to ACTIVE for port object f7d352f2-c558-4275-816b-84b53eee03cb will not be triggered until provisioned by entity DHCP. {{(pid=99027) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 18:06:00.481575 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-4876a76c-fce4-4c92-a635-44c701ac4769 req-39d56a7c-0170-4807-9a3e-b81c01446f91 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781840788179', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15468986'] for port, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:06:00.487166 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-055756b5-30e8-4510-964f-fece910e947f service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:06:00.551363 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-4876a76c-fce4-4c92-a635-44c701ac4769 req-39d56a7c-0170-4807-9a3e-b81c01446f91 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Network 66e6b1a7-3352-49c8-951e-25e4133a13bb is already hosted by enough agents. {{(pid=99027) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 18:06:00.554592 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.base_scheduler [req-4876a76c-fce4-4c92-a635-44c701ac4769 req-39d56a7c-0170-4807-9a3e-b81c01446f91 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Resources bound (agent type, host, resource id):  {{(pid=99027) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 18:06:00.557051 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.l3_dvrscheduler_db [req-4876a76c-fce4-4c92-a635-44c701ac4769 req-39d56a7c-0170-4807-9a3e-b81c01446f91 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Received port after_create {{(pid=99027) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 18:06:00.603493 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39d56a7c-0170-4807-9a3e-b81c01446f91 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Pushing event updated for resources: {'Port': ['ID=f7d352f2-c558-4275-816b-84b53eee03cb,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:06:00.611643 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-39d56a7c-0170-4807-9a3e-b81c01446f91 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.124s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:06:00.634977 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4876a76c-fce4-4c92-a635-44c701ac4769 req-39d56a7c-0170-4807-9a3e-b81c01446f91 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:06:00.635594 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-4876a76c-fce4-4c92-a635-44c701ac4769 req-39d56a7c-0170-4807-9a3e-b81c01446f91 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-239387'] for port, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:06:00.796707 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-4876a76c-fce4-4c92-a635-44c701ac4769 req-39d56a7c-0170-4807-9a3e-b81c01446f91 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] 10.222.0.125 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 1.2250156
May 25 18:06:00.809841 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.v2.base [req-4876a76c-fce4-4c92-a635-44c701ac4769 req-d16675a7-68b9-401e-8268-37f4141b3283 service neutron] Request body: {'port': {'device_id': '76bacbde-212b-4bd5-b147-4cf3c743d2d6', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78956'}} {{(pid=99027) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 18:06:00.924357 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-4876a76c-fce4-4c92-a635-44c701ac4769 req-d16675a7-68b9-401e-8268-37f4141b3283 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:06:00.938452 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-3cf9eb31-feb3-4f9b-84c8-cd03331949ed None None] Provisioning for port f7d352f2-c558-4275-816b-84b53eee03cb completed by entity DHCP. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 18:06:00.943877 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-3cf9eb31-feb3-4f9b-84c8-cd03331949ed None None] Provisioning complete for port f7d352f2-c558-4275-816b-84b53eee03cb triggered by entity DHCP. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 18:06:00.944289 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-3cf9eb31-feb3-4f9b-84c8-cd03331949ed None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:06:01.001074 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.plugin [None req-3cf9eb31-feb3-4f9b-84c8-cd03331949ed None None] Port f7d352f2-c558-4275-816b-84b53eee03cb cannot update to ACTIVE because it is not bound. {{(pid=99028) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 25 18:06:01.267920 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.notifiers.nova [req-4876a76c-fce4-4c92-a635-44c701ac4769 req-d16675a7-68b9-401e-8268-37f4141b3283 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id f7d352f2-c558-4275-816b-84b53eee03cb {{(pid=99027) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 25 18:06:01.275575 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-4876a76c-fce4-4c92-a635-44c701ac4769 req-d16675a7-68b9-401e-8268-37f4141b3283 service neutron] Notify callbacks [] for port, precommit_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:06:01.290957 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.provisioning_blocks [req-4876a76c-fce4-4c92-a635-44c701ac4769 req-d16675a7-68b9-401e-8268-37f4141b3283 service neutron] Transition to ACTIVE for port object f7d352f2-c558-4275-816b-84b53eee03cb will not be triggered until provisioned by entity L2. {{(pid=99027) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 25 18:06:01.390259 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-4876a76c-fce4-4c92-a635-44c701ac4769 req-d16675a7-68b9-401e-8268-37f4141b3283 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15468979'] for port, after_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:06:01.395846 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-39d56a7c-0170-4807-9a3e-b81c01446f91 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:06:01.576531 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d16675a7-68b9-401e-8268-37f4141b3283 service neutron] Pushing event updated for resources: {'Port': ['ID=f7d352f2-c558-4275-816b-84b53eee03cb,revision_number=2']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:06:01.578197 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30c177e1-9025-4cbe-8ce2-97c26f4b5cef req-23dd36eb-46f0-43e1-a171-2cc46eba6210 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:06:01.579877 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-30c177e1-9025-4cbe-8ce2-97c26f4b5cef req-23dd36eb-46f0-43e1-a171-2cc46eba6210 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] 10.222.0.122 "GET /v2.0/ports?device_id=76bacbde-212b-4bd5-b147-4cf3c743d2d6 HTTP/1.1" status: 200  len: 944 time: 0.0957773
May 25 18:06:01.608342 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-d16675a7-68b9-401e-8268-37f4141b3283 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.212s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:06:01.638369 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-30c177e1-9025-4cbe-8ce2-97c26f4b5cef req-65688a64-d5e4-4d11-b866-3a7a56dbf85f tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] 10.222.0.122 "GET /v2.0/security-groups?id=ae00d844-d334-4393-8fc2-9764c8279060&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0455506
May 25 18:06:01.653777 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.managers [req-4876a76c-fce4-4c92-a635-44c701ac4769 req-d16675a7-68b9-401e-8268-37f4141b3283 service neutron] Attempting to bind port f7d352f2-c558-4275-816b-84b53eee03cb on host hv-cinder-78956 for vnic_type normal with profile  {{(pid=99027) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 25 18:06:01.653777 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.managers [req-4876a76c-fce4-4c92-a635-44c701ac4769 req-d16675a7-68b9-401e-8268-37f4141b3283 service neutron] Attempting to bind port f7d352f2-c558-4275-816b-84b53eee03cb by drivers openvswitch,hyperv on host hv-cinder-78956 at level 0 using segments [{'id': '2abbf128-e5e5-4349-af70-f8887ef58b0f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1307, 'network_id': '66e6b1a7-3352-49c8-951e-25e4133a13bb'}] {{(pid=99027) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 25 18:06:01.654093 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4876a76c-fce4-4c92-a635-44c701ac4769 req-d16675a7-68b9-401e-8268-37f4141b3283 service neutron] Attempting to bind port f7d352f2-c558-4275-816b-84b53eee03cb on network 66e6b1a7-3352-49c8-951e-25e4133a13bb {{(pid=99027) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 18:06:01.658799 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4876a76c-fce4-4c92-a635-44c701ac4769 req-d16675a7-68b9-401e-8268-37f4141b3283 service neutron] Port f7d352f2-c558-4275-816b-84b53eee03cb on network 66e6b1a7-3352-49c8-951e-25e4133a13bb not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78956 {{(pid=99027) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 25 18:06:01.659187 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4876a76c-fce4-4c92-a635-44c701ac4769 req-d16675a7-68b9-401e-8268-37f4141b3283 service neutron] Attempting to bind port f7d352f2-c558-4275-816b-84b53eee03cb on network 66e6b1a7-3352-49c8-951e-25e4133a13bb {{(pid=99027) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 25 18:06:01.664470 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4876a76c-fce4-4c92-a635-44c701ac4769 req-d16675a7-68b9-401e-8268-37f4141b3283 service neutron] Checking agent: {'id': '4d02a528-6a0e-4977-985f-4bcff1ca6cb7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78956', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 17, 40, 41), 'started_at': datetime.datetime(2021, 5, 25, 17, 40, 41), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 18, 5, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=99027) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 25 18:06:01.664794 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4876a76c-fce4-4c92-a635-44c701ac4769 req-d16675a7-68b9-401e-8268-37f4141b3283 service neutron] Checking segment: {'id': '2abbf128-e5e5-4349-af70-f8887ef58b0f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1307, 'network_id': '66e6b1a7-3352-49c8-951e-25e4133a13bb'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=99027) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 25 18:06:01.665195 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4876a76c-fce4-4c92-a635-44c701ac4769 req-d16675a7-68b9-401e-8268-37f4141b3283 service neutron] Bound using segment: {'id': '2abbf128-e5e5-4349-af70-f8887ef58b0f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1307, 'network_id': '66e6b1a7-3352-49c8-951e-25e4133a13bb'} {{(pid=99027) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 25 18:06:01.665613 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.managers [req-4876a76c-fce4-4c92-a635-44c701ac4769 req-d16675a7-68b9-401e-8268-37f4141b3283 service neutron] Bound port: f7d352f2-c558-4275-816b-84b53eee03cb, host: hv-cinder-78956, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '2abbf128-e5e5-4349-af70-f8887ef58b0f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1307, 'network_id': '66e6b1a7-3352-49c8-951e-25e4133a13bb'}}] {{(pid=99027) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 25 18:06:01.665950 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-4876a76c-fce4-4c92-a635-44c701ac4769 req-d16675a7-68b9-401e-8268-37f4141b3283 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:06:01.756426 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.db [req-4876a76c-fce4-4c92-a635-44c701ac4769 req-d16675a7-68b9-401e-8268-37f4141b3283 service neutron] For port f7d352f2-c558-4275-816b-84b53eee03cb, host hv-cinder-78956, cleared binding levels {{(pid=99027) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 25 18:06:01.759496 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.db [req-4876a76c-fce4-4c92-a635-44c701ac4769 req-d16675a7-68b9-401e-8268-37f4141b3283 service neutron] For port f7d352f2-c558-4275-816b-84b53eee03cb, host hv-cinder-78956, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=f7d352f2-c558-4275-816b-84b53eee03cb,segment=NetworkSegment(2abbf128-e5e5-4349-af70-f8887ef58b0f),segment_id=2abbf128-e5e5-4349-af70-f8887ef58b0f)] {{(pid=99027) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 25 18:06:01.887559 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-4876a76c-fce4-4c92-a635-44c701ac4769 req-d16675a7-68b9-401e-8268-37f4141b3283 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15468979'] for port, after_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:06:01.891484 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-d67ed42c-eb85-4e6b-bf7c-21705136a299 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:06:01.953067 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4876a76c-fce4-4c92-a635-44c701ac4769 req-d16675a7-68b9-401e-8268-37f4141b3283 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:06:01.953696 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-4876a76c-fce4-4c92-a635-44c701ac4769 req-d16675a7-68b9-401e-8268-37f4141b3283 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-239387'] for port, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:06:01.955118 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-4876a76c-fce4-4c92-a635-44c701ac4769 req-d16675a7-68b9-401e-8268-37f4141b3283 service neutron] 10.222.0.125 "PUT /v2.0/ports/f7d352f2-c558-4275-816b-84b53eee03cb HTTP/1.1" status: 200  len: 1094 time: 1.1492589
May 25 18:06:01.957931 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '76bacbde-212b-4bd5-b147-4cf3c743d2d6', 'tag': 'f7d352f2-c558-4275-816b-84b53eee03cb'}] {{(pid=99027) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 18:06:01.984738 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d16675a7-68b9-401e-8268-37f4141b3283 service neutron] Pushing event updated for resources: {'Port': ['ID=f7d352f2-c558-4275-816b-84b53eee03cb,revision_number=3']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:06:01.990114 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-d16675a7-68b9-401e-8268-37f4141b3283 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.098s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:06:02.010775 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '76bacbde-212b-4bd5-b147-4cf3c743d2d6', 'tag': 'f7d352f2-c558-4275-816b-84b53eee03cb', 'status': 'completed', 'code': 200}
May 25 18:06:02.139375 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0eef2388-3705-4e67-972c-850626b20ef9 req-fa72fc81-e843-4eb9-a29f-802176e2fdb6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:06:02.140878 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-0eef2388-3705-4e67-972c-850626b20ef9 req-fa72fc81-e843-4eb9-a29f-802176e2fdb6 service neutron] 10.222.0.125 "GET /v2.0/ports?tenant_id=6964ff917bfd44b1b1eca0a430c6cf1a&device_id=76bacbde-212b-4bd5-b147-4cf3c743d2d6 HTTP/1.1" status: 200  len: 1097 time: 0.0814962
May 25 18:06:02.288000 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0eef2388-3705-4e67-972c-850626b20ef9 req-4fa673b0-4e5b-4732-b65d-3f15cc1c8ff4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:06:02.289485 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-0eef2388-3705-4e67-972c-850626b20ef9 req-4fa673b0-4e5b-4732-b65d-3f15cc1c8ff4 service neutron] 10.222.0.125 "GET /v2.0/networks?tenant_id=6964ff917bfd44b1b1eca0a430c6cf1a&shared=False HTTP/1.1" status: 200  len: 914 time: 0.1396625
May 25 18:06:02.430050 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0eef2388-3705-4e67-972c-850626b20ef9 req-d72b3716-0bac-4937-bbe3-d38041c28157 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:06:02.431390 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-0eef2388-3705-4e67-972c-850626b20ef9 req-d72b3716-0bac-4937-bbe3-d38041c28157 service neutron] 10.222.0.125 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 871 time: 0.1317677
May 25 18:06:02.551615 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4876a76c-fce4-4c92-a635-44c701ac4769 req-da565fd9-add4-4c16-adf3-1f44b2610448 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:06:02.553117 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-4876a76c-fce4-4c92-a635-44c701ac4769 req-da565fd9-add4-4c16-adf3-1f44b2610448 service neutron] 10.222.0.125 "GET /v2.0/ports?tenant_id=6964ff917bfd44b1b1eca0a430c6cf1a&device_id=76bacbde-212b-4bd5-b147-4cf3c743d2d6 HTTP/1.1" status: 200  len: 1097 time: 0.0815203
May 25 18:06:02.714874 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-4876a76c-fce4-4c92-a635-44c701ac4769 req-891f9bb6-efc7-4c40-bdd4-f8ea410d625f service neutron] 10.222.0.125 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=f7d352f2-c558-4275-816b-84b53eee03cb HTTP/1.1" status: 200  len: 217 time: 0.1528230
May 25 18:06:02.783205 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4876a76c-fce4-4c92-a635-44c701ac4769 req-d3c1e21c-0881-409c-8447-08f05e7597be service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:06:02.784660 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-4876a76c-fce4-4c92-a635-44c701ac4769 req-d3c1e21c-0881-409c-8447-08f05e7597be service neutron] 10.222.0.125 "GET /v2.0/subnets?id=7e40c2eb-fb3c-4338-9398-6fcd43705fa8 HTTP/1.1" status: 200  len: 851 time: 0.0621521
May 25 18:06:02.827247 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6b4605f-fa74-4bf7-9f04-928daac4f68d req-df0b414e-8371-4b98-8208-6ca2917cae84 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:06:02.828770 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-c6b4605f-fa74-4bf7-9f04-928daac4f68d req-df0b414e-8371-4b98-8208-6ca2917cae84 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] 10.222.0.122 "GET /v2.0/ports?device_id=76bacbde-212b-4bd5-b147-4cf3c743d2d6 HTTP/1.1" status: 200  len: 944 time: 0.0839996
May 25 18:06:02.859873 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4876a76c-fce4-4c92-a635-44c701ac4769 req-390c3660-267c-4e3c-b30a-8bf831ac947e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:06:02.861364 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-4876a76c-fce4-4c92-a635-44c701ac4769 req-390c3660-267c-4e3c-b30a-8bf831ac947e service neutron] 10.222.0.125 "GET /v2.0/ports?network_id=66e6b1a7-3352-49c8-951e-25e4133a13bb&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0699313
May 25 18:06:02.890908 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-c6b4605f-fa74-4bf7-9f04-928daac4f68d req-f5c2ce77-a399-42dd-8325-da3b9d6364d2 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] 10.222.0.122 "GET /v2.0/security-groups?id=ae00d844-d334-4393-8fc2-9764c8279060&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0557318
May 25 18:06:02.993268 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-4876a76c-fce4-4c92-a635-44c701ac4769 req-766a7d00-8c80-4ad0-afeb-47e65a271f6b service neutron] 10.222.0.125 "GET /v2.0/networks/66e6b1a7-3352-49c8-951e-25e4133a13bb?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1262503
May 25 18:06:03.127635 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-4876a76c-fce4-4c92-a635-44c701ac4769 req-919d4038-9482-42d0-91d4-9b634ea025ee service neutron] 10.222.0.125 "GET /v2.0/networks/66e6b1a7-3352-49c8-951e-25e4133a13bb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1261992
May 25 18:06:03.754045 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.agents_db [None req-14fae233-15dc-4576-836b-621c5f95b584 None None] Agent healthcheck: found 6 active agents {{(pid=99029) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 18:06:04.113355 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11213d22-1cd1-4831-bd7e-2f460a526191 req-a9f07646-86c3-44ed-99db-7239b644a8ea tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:06:04.114658 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-11213d22-1cd1-4831-bd7e-2f460a526191 req-a9f07646-86c3-44ed-99db-7239b644a8ea tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Synchronizing usage tracker for tenant:6964ff917bfd44b1b1eca0a430c6cf1a on resource:port {{(pid=99027) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 18:06:04.224093 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-11213d22-1cd1-4831-bd7e-2f460a526191 req-a9f07646-86c3-44ed-99db-7239b644a8ea tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Unset dirty status for tenant:6964ff917bfd44b1b1eca0a430c6cf1a on resource:port {{(pid=99027) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 18:06:04.225293 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-11213d22-1cd1-4831-bd7e-2f460a526191 req-a9f07646-86c3-44ed-99db-7239b644a8ea tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] 10.222.0.122 "GET /v2.0/ports?device_id=76bacbde-212b-4bd5-b147-4cf3c743d2d6 HTTP/1.1" status: 200  len: 944 time: 0.1968961
May 25 18:06:04.276828 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-11213d22-1cd1-4831-bd7e-2f460a526191 req-e095d13b-8f70-48cb-b6ea-bbbd12aa5133 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] 10.222.0.122 "GET /v2.0/security-groups?id=ae00d844-d334-4393-8fc2-9764c8279060&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0457776
May 25 18:06:05.465676 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d4593fb-3f5b-4d14-82f5-894cfb64b1fe req-512cb395-d1f0-43d3-a552-e87e6b926411 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:06:05.467140 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-6d4593fb-3f5b-4d14-82f5-894cfb64b1fe req-512cb395-d1f0-43d3-a552-e87e6b926411 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] 10.222.0.122 "GET /v2.0/ports?device_id=76bacbde-212b-4bd5-b147-4cf3c743d2d6 HTTP/1.1" status: 200  len: 944 time: 0.0809724
May 25 18:06:05.513194 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-6d4593fb-3f5b-4d14-82f5-894cfb64b1fe req-5174731f-16a6-4789-826e-a66f222de617 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] 10.222.0.122 "GET /v2.0/security-groups?id=ae00d844-d334-4393-8fc2-9764c8279060&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0401878
May 25 18:06:06.697374 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f87f3056-218d-4f01-9fb8-9139bb0793a7 req-80d9b1d3-afb6-4e24-a52b-a581f4ebce21 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:06:06.698843 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-f87f3056-218d-4f01-9fb8-9139bb0793a7 req-80d9b1d3-afb6-4e24-a52b-a581f4ebce21 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] 10.222.0.122 "GET /v2.0/ports?device_id=76bacbde-212b-4bd5-b147-4cf3c743d2d6 HTTP/1.1" status: 200  len: 944 time: 0.0808804
May 25 18:06:06.743402 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-f87f3056-218d-4f01-9fb8-9139bb0793a7 req-acb97707-58cf-4e2f-aa7a-4ecdf3142678 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] 10.222.0.122 "GET /v2.0/security-groups?id=ae00d844-d334-4393-8fc2-9764c8279060&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0388680
May 25 18:06:08.032668 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bb44ebe-d04b-4194-8dc0-4fcabcab2a5f req-c210ca55-d40d-465d-817f-87b5ab63aef2 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:06:08.034095 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-0bb44ebe-d04b-4194-8dc0-4fcabcab2a5f req-c210ca55-d40d-465d-817f-87b5ab63aef2 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] 10.222.0.122 "GET /v2.0/ports?device_id=76bacbde-212b-4bd5-b147-4cf3c743d2d6 HTTP/1.1" status: 200  len: 944 time: 0.1861794
May 25 18:06:08.080231 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-0bb44ebe-d04b-4194-8dc0-4fcabcab2a5f req-c0abec60-fc32-4212-b031-c7b67477e1ef tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] 10.222.0.122 "GET /v2.0/security-groups?id=ae00d844-d334-4393-8fc2-9764c8279060&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0404336
May 25 18:06:09.267360 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-847cad3b-0cb6-4558-b083-391fcc19e613 req-506e1d44-42c7-4651-ade5-1b8a0ac2ebfc tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:06:09.269436 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-847cad3b-0cb6-4558-b083-391fcc19e613 req-506e1d44-42c7-4651-ade5-1b8a0ac2ebfc tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] 10.222.0.122 "GET /v2.0/ports?device_id=76bacbde-212b-4bd5-b147-4cf3c743d2d6 HTTP/1.1" status: 200  len: 944 time: 0.0836112
May 25 18:06:09.312847 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-847cad3b-0cb6-4558-b083-391fcc19e613 req-e09b3cf2-2375-45c4-8926-42d470dbeafb tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] 10.222.0.122 "GET /v2.0/security-groups?id=ae00d844-d334-4393-8fc2-9764c8279060&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0377629
May 25 18:06:09.553165 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Device f7d352f2-c558-4275-816b-84b53eee03cb details requested by agent hyperv_hv-cinder-78956 with host hv-cinder-78956 {{(pid=99028) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 25 18:06:09.686160 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] For port f7d352f2-c558-4275-816b-84b53eee03cb, host hv-cinder-78956, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=f7d352f2-c558-4275-816b-84b53eee03cb,segment=NetworkSegment(2abbf128-e5e5-4349-af70-f8887ef58b0f),segment_id=2abbf128-e5e5-4349-af70-f8887ef58b0f)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 18:06:09.699727 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Returning: {'device': 'f7d352f2-c558-4275-816b-84b53eee03cb', 'network_id': '66e6b1a7-3352-49c8-951e-25e4133a13bb', 'port_id': 'f7d352f2-c558-4275-816b-84b53eee03cb', 'mac_address': 'fa:16:3e:7b:ab:90', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1307, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '7e40c2eb-fb3c-4338-9398-6fcd43705fa8', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=99028) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 25 18:06:09.754099 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:06:09.770410 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.notifiers.nova [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id f7d352f2-c558-4275-816b-84b53eee03cb {{(pid=99028) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 25 18:06:09.786136 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] For port f7d352f2-c558-4275-816b-84b53eee03cb, host hv-cinder-78956, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=f7d352f2-c558-4275-816b-84b53eee03cb,segment=NetworkSegment(2abbf128-e5e5-4349-af70-f8887ef58b0f),segment_id=2abbf128-e5e5-4349-af70-f8887ef58b0f)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 18:06:09.904372 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:06:09.906297 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:06:09.975815 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Pushing event updated for resources: {'Port': ['ID=f7d352f2-c558-4275-816b-84b53eee03cb,revision_number=4']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:06:09.978922 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:06:10.415485 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] get_ports_and_sgs() called for port_ids ['f7d352f2-c558-4275-816b-84b53eee03cb'] {{(pid=99028) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 25 18:06:10.499423 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7c0605a-93b8-4b5b-ba7d-058977778b60 req-5dbe4b2c-666b-41a7-b4fb-e83abcefdc02 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:06:10.500874 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-b7c0605a-93b8-4b5b-ba7d-058977778b60 req-5dbe4b2c-666b-41a7-b4fb-e83abcefdc02 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] 10.222.0.122 "GET /v2.0/ports?device_id=76bacbde-212b-4bd5-b147-4cf3c743d2d6 HTTP/1.1" status: 200  len: 945 time: 0.0808673
May 25 18:06:10.546573 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-b7c0605a-93b8-4b5b-ba7d-058977778b60 req-8bb1e4eb-df83-4db9-bf82-60694ca853c8 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] 10.222.0.122 "GET /v2.0/security-groups?id=ae00d844-d334-4393-8fc2-9764c8279060&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0395215
May 25 18:06:11.563414 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Device f7d352f2-c558-4275-816b-84b53eee03cb up at agent hyperv_hv-cinder-78956 {{(pid=99028) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 25 18:06:11.732062 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Provisioning for port f7d352f2-c558-4275-816b-84b53eee03cb completed by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 25 18:06:11.737534 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.provisioning_blocks [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Provisioning complete for port f7d352f2-c558-4275-816b-84b53eee03cb triggered by entity L2. {{(pid=99028) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 25 18:06:11.738132 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1445437'] for port, provisioning_complete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:06:11.740314 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36d17642-b092-4c06-be37-a10f72121fb2 req-37951232-79d0-49b6-b8d4-d1f756a468a6 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:06:11.741835 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-36d17642-b092-4c06-be37-a10f72121fb2 req-37951232-79d0-49b6-b8d4-d1f756a468a6 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] 10.222.0.122 "GET /v2.0/ports?device_id=76bacbde-212b-4bd5-b147-4cf3c743d2d6 HTTP/1.1" status: 200  len: 945 time: 0.0842848
May 25 18:06:11.772399 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:06:11.792567 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-36d17642-b092-4c06-be37-a10f72121fb2 req-b0f35299-c09a-4d2b-a2f6-0a320c70ccea tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] 10.222.0.122 "GET /v2.0/security-groups?id=ae00d844-d334-4393-8fc2-9764c8279060&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0447929
May 25 18:06:11.870733 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:06:11.899918 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '76bacbde-212b-4bd5-b147-4cf3c743d2d6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f7d352f2-c558-4275-816b-84b53eee03cb'}] {{(pid=99028) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 18:06:11.910768 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] For port f7d352f2-c558-4275-816b-84b53eee03cb, host hv-cinder-78956, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=f7d352f2-c558-4275-816b-84b53eee03cb,segment=NetworkSegment(2abbf128-e5e5-4349-af70-f8887ef58b0f),segment_id=2abbf128-e5e5-4349-af70-f8887ef58b0f)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 18:06:11.946859 dv-cinder-789564-2-iscsi neutron-server[99028]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '76bacbde-212b-4bd5-b147-4cf3c743d2d6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f7d352f2-c558-4275-816b-84b53eee03cb', 'code': 200}
May 25 18:06:12.006679 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526'] for port, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:06:12.008579 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:06:12.077839 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Pushing event updated for resources: {'Port': ['ID=f7d352f2-c558-4275-816b-84b53eee03cb,revision_number=5']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:06:12.081492 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:06:12.509202 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9521225-5f83-4466-8a22-90054f7baaef req-4f215b30-c02a-417f-8523-5dce3b393a33 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:06:12.510652 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-d9521225-5f83-4466-8a22-90054f7baaef req-4f215b30-c02a-417f-8523-5dce3b393a33 service neutron] 10.222.0.125 "GET /v2.0/ports?device_id=76bacbde-212b-4bd5-b147-4cf3c743d2d6 HTTP/1.1" status: 200  len: 1099 time: 0.0708079
May 25 18:06:12.564823 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-d9521225-5f83-4466-8a22-90054f7baaef req-f6e8f25e-dc44-4977-bfae-85c4e7acd186 service neutron] 10.222.0.125 "GET /v2.0/security-groups?id=ae00d844-d334-4393-8fc2-9764c8279060&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0449648
May 25 18:06:12.984483 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ff25972-d1ab-47b3-8c9f-37a64a8f4533 req-700532e1-ed94-4a5e-ba1c-c17bd9575674 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:06:12.985985 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-4ff25972-d1ab-47b3-8c9f-37a64a8f4533 req-700532e1-ed94-4a5e-ba1c-c17bd9575674 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] 10.222.0.122 "GET /v2.0/ports?device_id=76bacbde-212b-4bd5-b147-4cf3c743d2d6 HTTP/1.1" status: 200  len: 946 time: 0.0858951
May 25 18:06:13.031681 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-4ff25972-d1ab-47b3-8c9f-37a64a8f4533 req-791a2b09-21f6-4004-a26b-9672628eafeb tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] 10.222.0.122 "GET /v2.0/security-groups?id=ae00d844-d334-4393-8fc2-9764c8279060&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0390615
May 25 18:06:14.231699 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-caf8b6ec-d49b-4652-a048-5602ede6bbd8 req-7de7b581-2167-4b57-ab27-8cc7f3425e0f tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:06:14.233225 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-caf8b6ec-d49b-4652-a048-5602ede6bbd8 req-7de7b581-2167-4b57-ab27-8cc7f3425e0f tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] 10.222.0.122 "GET /v2.0/ports?device_id=76bacbde-212b-4bd5-b147-4cf3c743d2d6 HTTP/1.1" status: 200  len: 946 time: 0.0934141
May 25 18:06:14.278502 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-caf8b6ec-d49b-4652-a048-5602ede6bbd8 req-a1579e7f-1c45-4eb6-b662-0f2cf92e24c5 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] 10.222.0.122 "GET /v2.0/security-groups?id=ae00d844-d334-4393-8fc2-9764c8279060&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0395403
May 25 18:06:14.459398 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b2ba5a8-8b98-441d-a965-cc0836150bff req-f458067f-da19-4d25-8925-4a93a26db8b7 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:06:14.460843 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-8b2ba5a8-8b98-441d-a965-cc0836150bff req-f458067f-da19-4d25-8925-4a93a26db8b7 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] 10.222.0.122 "GET /v2.0/ports?device_id=76bacbde-212b-4bd5-b147-4cf3c743d2d6 HTTP/1.1" status: 200  len: 946 time: 0.0792806
May 25 18:06:14.505869 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-8b2ba5a8-8b98-441d-a965-cc0836150bff req-b3f887d9-2a6f-4ac7-ad02-d83f9c3faa66 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] 10.222.0.122 "GET /v2.0/security-groups?id=ae00d844-d334-4393-8fc2-9764c8279060&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0391114
May 25 18:06:14.528755 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 52862) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 18:06:14.641464 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-afd58e7b-9d2a-4630-80af-4f9714041572 tempest-TestVolumeBootPattern-1251824712 tempest-TestVolumeBootPattern-1251824712-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:06:14.643563 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-afd58e7b-9d2a-4630-80af-4f9714041572 tempest-TestVolumeBootPattern-1251824712 tempest-TestVolumeBootPattern-1251824712-project-admin] 10.222.0.122 "GET /v2.0/ports?device_id=76bacbde-212b-4bd5-b147-4cf3c743d2d6 HTTP/1.1" status: 200  len: 1094 time: 0.1137826
May 25 18:06:14.646515 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 52868) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 18:06:14.652049 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.v2.base [None req-030ec2cb-cdc2-426b-8345-41ced92d40db tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Request body: {'floatingip': {'floating_network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'port_id': 'f7d352f2-c558-4275-816b-84b53eee03cb', 'tenant_id': '6964ff917bfd44b1b1eca0a430c6cf1a', 'fixed_ip_address': '172.20.0.13'}} {{(pid=99027) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 25 18:06:14.658606 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-030ec2cb-cdc2-426b-8345-41ced92d40db tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 25 18:06:14.662403 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-030ec2cb-cdc2-426b-8345-41ced92d40db tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Usage tracker for resource:floatingip and tenant:6964ff917bfd44b1b1eca0a430c6cf1a is out of sync, need to count used quota {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 25 18:06:14.665213 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [None req-030ec2cb-cdc2-426b-8345-41ced92d40db tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=99027) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 25 18:06:14.670865 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.quota.driver [None req-030ec2cb-cdc2-426b-8345-41ced92d40db tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=99027) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 25 18:06:14.761216 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-030ec2cb-cdc2-426b-8345-41ced92d40db tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Notify callbacks [] for floatingip, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:06:14.898371 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-030ec2cb-cdc2-426b-8345-41ced92d40db tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:06:15.033552 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.db_base_plugin_common [None req-030ec2cb-cdc2-426b-8345-41ced92d40db tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Allocated IP 172.27.3.53 (eb7ec72b-a691-481b-8d7e-42c05e13a8cb/d6898f5f-da0b-4428-97b4-4cbe3e83caaa/7bb3085a-746f-49b0-9d92-0da7a072165f) {{(pid=99027) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 25 18:06:15.285327 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-030ec2cb-cdc2-426b-8345-41ced92d40db tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Notify callbacks [] for port, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:06:15.372334 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-030ec2cb-cdc2-426b-8345-41ced92d40db tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781840788179', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15468986'] for port, after_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:06:15.376447 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:06:15.436999 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-030ec2cb-cdc2-426b-8345-41ced92d40db tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Network eb7ec72b-a691-481b-8d7e-42c05e13a8cb is already hosted by enough agents. {{(pid=99027) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 25 18:06:15.439965 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.base_scheduler [None req-030ec2cb-cdc2-426b-8345-41ced92d40db tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Resources bound (agent type, host, resource id):  {{(pid=99027) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 25 18:06:15.449231 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.l3_dvrscheduler_db [None req-030ec2cb-cdc2-426b-8345-41ced92d40db tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Received port after_create {{(pid=99027) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 25 18:06:15.473588 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-030ec2cb-cdc2-426b-8345-41ced92d40db tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Pushing event updated for resources: {'Port': ['ID=7bb3085a-746f-49b0-9d92-0da7a072165f,revision_number=1']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:06:15.478454 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-030ec2cb-cdc2-426b-8345-41ced92d40db tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.102s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:06:15.869738 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-030ec2cb-cdc2-426b-8345-41ced92d40db tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Notify callbacks [] for floatingip, precommit_create {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:06:15.996685 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-030ec2cb-cdc2-426b-8345-41ced92d40db tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-1465355'] for port, before_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:06:16.198546 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-030ec2cb-cdc2-426b-8345-41ced92d40db tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Notify callbacks [] for port, precommit_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:06:16.252109 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-030ec2cb-cdc2-426b-8345-41ced92d40db tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781841222548', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781840788197', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781840789526', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15468979'] for port, after_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:06:16.256428 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-6f5dca94-edbf-4ab8-9551-e87642f097f6 tempest-AttachVolumeTestJSON-1691874001 tempest-AttachVolumeTestJSON-1691874001-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:06:16.360533 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-030ec2cb-cdc2-426b-8345-41ced92d40db tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Pushing event updated for resources: {'Port': ['ID=7bb3085a-746f-49b0-9d92-0da7a072165f,revision_number=2']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:06:16.373274 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-030ec2cb-cdc2-426b-8345-41ced92d40db tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:06:16.373646 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-030ec2cb-cdc2-426b-8345-41ced92d40db tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:06:16.374006 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-030ec2cb-cdc2-426b-8345-41ced92d40db tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:06:16.374360 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-030ec2cb-cdc2-426b-8345-41ced92d40db tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:06:16.374708 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-030ec2cb-cdc2-426b-8345-41ced92d40db tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:06:16.375056 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-030ec2cb-cdc2-426b-8345-41ced92d40db tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:06:16.375402 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-030ec2cb-cdc2-426b-8345-41ced92d40db tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:06:16.375745 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-030ec2cb-cdc2-426b-8345-41ced92d40db tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:06:16.376088 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-030ec2cb-cdc2-426b-8345-41ced92d40db tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:06:16.376429 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-030ec2cb-cdc2-426b-8345-41ced92d40db tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:06:16.376768 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-030ec2cb-cdc2-426b-8345-41ced92d40db tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:06:16.377151 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-030ec2cb-cdc2-426b-8345-41ced92d40db tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:06:16.381890 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-030ec2cb-cdc2-426b-8345-41ced92d40db tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.126s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:06:16.384615 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-030ec2cb-cdc2-426b-8345-41ced92d40db tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-419865'] for floatingip, after_update {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:06:16.554335 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.db.l3_db [None req-030ec2cb-cdc2-426b-8345-41ced92d40db tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Floating IP d0a59b91-a74b-4c9c-b6f5-55dd359c83c2 associated. External IP: 172.27.3.53, port: f7d352f2-c558-4275-816b-84b53eee03cb.
May 25 18:06:16.998446 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-030ec2cb-cdc2-426b-8345-41ced92d40db tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Router e2284a8f-630f-40d9-8cdd-17a1bb5a3448 has already been hosted by L3 agent eaeb6875-c4ed-43b6-8658-aa4e52324fdf {{(pid=99027) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 25 18:06:17.176153 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-030ec2cb-cdc2-426b-8345-41ced92d40db tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Notify agent at l3_agent.dv-cinder-789564-2-iscsi the message routers_updated {{(pid=99027) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 25 18:06:17.185668 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6256247c-d7f9-44fb-92b9-0db90025bd14 None None] Sync routers for ids ['e2284a8f-630f-40d9-8cdd-17a1bb5a3448'] in dv-cinder-789564-2-iscsi {{(pid=99028) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 25 18:06:17.195722 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6256247c-d7f9-44fb-92b9-0db90025bd14 None None] Routers {'e2284a8f-630f-40d9-8cdd-17a1bb5a3448'} bound to L3 agent in host dv-cinder-789564-2-iscsi {{(pid=99028) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 18:06:17.203968 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-6256247c-d7f9-44fb-92b9-0db90025bd14 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcae6c0ec70>, 'dv-cinder-789564-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-25T17:34:21Z,description=<?>,heartbeat_timestamp=2021-05-25T18:05:51Z,host='dv-cinder-789564-2-iscsi',id=eaeb6875-c4ed-43b6-8658-aa4e52324fdf,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T17:34:21Z,topic='l3_agent')) {'router_ids': ['e2284a8f-630f-40d9-8cdd-17a1bb5a3448'], 'active': True} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 18:06:17.286786 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-030ec2cb-cdc2-426b-8345-41ced92d40db tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-239387'] for floatingip, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:06:17.346632 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-030ec2cb-cdc2-426b-8345-41ced92d40db tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] 10.222.0.122 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 996 time: 2.6989760
May 25 18:06:17.347413 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '76bacbde-212b-4bd5-b147-4cf3c743d2d6', 'tag': 'f7d352f2-c558-4275-816b-84b53eee03cb'}] {{(pid=99027) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 18:06:17.393881 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '76bacbde-212b-4bd5-b147-4cf3c743d2d6', 'tag': 'f7d352f2-c558-4275-816b-84b53eee03cb', 'status': 'completed', 'code': 200}
May 25 18:06:17.414704 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvr_db [None req-6256247c-d7f9-44fb-92b9-0db90025bd14 None None] Set router e2284a8f-630f-40d9-8cdd-17a1bb5a3448 gateway port host: dv-cinder-789564-2-iscsi {{(pid=99028) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 18:06:17.478575 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92ef14bc-7fdf-4716-9658-ad4a0d52b232 req-ceeb359b-9925-4582-81c9-73d0b7943527 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:06:17.480149 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-92ef14bc-7fdf-4716-9658-ad4a0d52b232 req-ceeb359b-9925-4582-81c9-73d0b7943527 service neutron] 10.222.0.125 "GET /v2.0/ports?tenant_id=6964ff917bfd44b1b1eca0a430c6cf1a&device_id=76bacbde-212b-4bd5-b147-4cf3c743d2d6 HTTP/1.1" status: 200  len: 1099 time: 0.0703402
May 25 18:06:17.637621 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92ef14bc-7fdf-4716-9658-ad4a0d52b232 req-e05893be-f13a-484e-9014-04a4d0bd680e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:06:17.637621 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-92ef14bc-7fdf-4716-9658-ad4a0d52b232 req-e05893be-f13a-484e-9014-04a4d0bd680e service neutron] 10.222.0.125 "GET /v2.0/networks?id=66e6b1a7-3352-49c8-951e-25e4133a13bb HTTP/1.1" status: 200  len: 914 time: 0.1366470
May 25 18:06:17.734976 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-92ef14bc-7fdf-4716-9658-ad4a0d52b232 req-01a14b7c-b911-421e-80d3-1d7f506d720b service neutron] 10.222.0.125 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=f7d352f2-c558-4275-816b-84b53eee03cb HTTP/1.1" status: 200  len: 999 time: 0.1017354
May 25 18:06:17.767694 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-6256247c-d7f9-44fb-92b9-0db90025bd14 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcae6c0ec70>, [{'id': 'e2284a8f-630f-40d9-8cdd-17a1bb5a3448', 'name': 'tempest-TestVolumeBootPattern-1659174020-router', 'tenant_id': '6964ff917bfd44b1b1eca0a430c6cf1a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.104'}], 'enable_snat': True}, 'gw_port_id': 'c14ee1b8-5c0b-41af-875f-c2f8d16e0c25', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T18:05:20Z', 'updated_at': '2021-05-25T18:05:24Z', 'revision_number': 4, 'project_id': '6964ff917bfd44b1b1eca0a430c6cf1a', 'gw_port': {'id': 'c14ee1b8-5c0b-41af-875f-c2f8d16e0c25', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:1c:b0:0f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e2284a8f-630f-40d9-8cdd-17a1bb5a3448', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.104', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T18:05:21Z', 'updated_at': '2021-05-25T18:05:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi', '_floatingips': [{'id': 'd0a59b91-a74b-4c9c-b6f5-55dd359c83c2', 'tenant_id': '6964ff917bfd44b1b1eca0a430c6cf1a', 'floating_ip_address': '172.27.3.53', 'floating_network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'router_id': 'e2284a8f-630f-40d9-8cdd-17a1bb5a3448', 'port_id': 'f7d352f2-c558-4275-816b-84b53eee03cb', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 681, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '66e6b1a7-3352-49c8-951e-25e4133a13bb', 'mac_address': 'fa:16:3e:7b:ab:90', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '76bacbde-212b-4bd5-b147-4cf3c743d2d6', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T18:06:15Z', 'updated_at': '2021-05-25T18:06:15Z', 'revision_number': 0, 'project_id': '6964ff917bfd44b1b1eca0a430c6cf1a', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '6239732d-4c0c-4187-b7e6-292b3569ab65', 'name': '', 'network_id': '66e6b1a7-3352-49c8-951e-25e4133a13bb', 'tenant_id': '6964ff917bfd44b1b1eca0a430c6cf1a', 'mac_address': 'fa:16:3e:16:61:66', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e2284a8f-630f-40d9-8cdd-17a1bb5a3448', 'device_owner': 'network:router_interface', 'standard_attr_id': 657, 'fixed_ips': [{'subnet_id': '7e40c2eb-fb3c-4338-9398-6fcd43705fa8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T18:05:24Z', 'updated_at': '2021-05-25T18:05:30Z', 'revision_number': 5, 'project_id': '6964ff917bfd44b1b1eca0a430c6cf1a', 'subnets': [{'id': '7e40c2eb-fb3c-4338-9398-6fcd43705fa8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-789564-2-iscsi', False) {} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 18:06:17.771844 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6256247c-d7f9-44fb-92b9-0db90025bd14 None None] Checking router: e2284a8f-630f-40d9-8cdd-17a1bb5a3448 for host: dv-cinder-789564-2-iscsi {{(pid=99028) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 25 18:06:17.780100 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6256247c-d7f9-44fb-92b9-0db90025bd14 None None] Routers {'e2284a8f-630f-40d9-8cdd-17a1bb5a3448'} bound to L3 agent in host dv-cinder-789564-2-iscsi {{(pid=99028) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 18:06:17.780713 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-6256247c-d7f9-44fb-92b9-0db90025bd14 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcae6c0ec70>, 'dv-cinder-789564-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-25T17:34:21Z,description=<?>,heartbeat_timestamp=2021-05-25T18:05:51Z,host='dv-cinder-789564-2-iscsi',id=eaeb6875-c4ed-43b6-8658-aa4e52324fdf,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T17:34:21Z,topic='l3_agent')) {'router_ids': ['e2284a8f-630f-40d9-8cdd-17a1bb5a3448'], 'active': True} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 18:06:17.797459 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92ef14bc-7fdf-4716-9658-ad4a0d52b232 req-d813b172-fd43-411c-b249-cb16e1bc7e59 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:06:17.799457 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-92ef14bc-7fdf-4716-9658-ad4a0d52b232 req-d813b172-fd43-411c-b249-cb16e1bc7e59 service neutron] 10.222.0.125 "GET /v2.0/subnets?id=7e40c2eb-fb3c-4338-9398-6fcd43705fa8 HTTP/1.1" status: 200  len: 851 time: 0.0573037
May 25 18:06:17.880633 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92ef14bc-7fdf-4716-9658-ad4a0d52b232 req-eb3ebd04-c921-487a-baa5-a82bccf8c349 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:06:17.882148 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-92ef14bc-7fdf-4716-9658-ad4a0d52b232 req-eb3ebd04-c921-487a-baa5-a82bccf8c349 service neutron] 10.222.0.125 "GET /v2.0/ports?network_id=66e6b1a7-3352-49c8-951e-25e4133a13bb&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0737493
May 25 18:06:17.967045 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvr_db [None req-6256247c-d7f9-44fb-92b9-0db90025bd14 None None] Set router e2284a8f-630f-40d9-8cdd-17a1bb5a3448 gateway port host: dv-cinder-789564-2-iscsi {{(pid=99028) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 18:06:18.018139 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-92ef14bc-7fdf-4716-9658-ad4a0d52b232 req-e4d4735e-6755-4733-bfe3-ee5ee73abc31 service neutron] 10.222.0.125 "GET /v2.0/networks/66e6b1a7-3352-49c8-951e-25e4133a13bb?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1272826
May 25 18:06:18.157523 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-92ef14bc-7fdf-4716-9658-ad4a0d52b232 req-760db7f9-04cc-4fd0-a156-088bcdfe4296 service neutron] 10.222.0.125 "GET /v2.0/networks/66e6b1a7-3352-49c8-951e-25e4133a13bb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1358271
May 25 18:06:18.243871 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-78704245-1dc5-4ddd-bd77-e6434c593ff4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:06:18.355713 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-6256247c-d7f9-44fb-92b9-0db90025bd14 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcae6c0ec70>, [{'id': 'e2284a8f-630f-40d9-8cdd-17a1bb5a3448', 'name': 'tempest-TestVolumeBootPattern-1659174020-router', 'tenant_id': '6964ff917bfd44b1b1eca0a430c6cf1a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.104'}], 'enable_snat': True}, 'gw_port_id': 'c14ee1b8-5c0b-41af-875f-c2f8d16e0c25', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T18:05:20Z', 'updated_at': '2021-05-25T18:05:24Z', 'revision_number': 4, 'project_id': '6964ff917bfd44b1b1eca0a430c6cf1a', 'gw_port': {'id': 'c14ee1b8-5c0b-41af-875f-c2f8d16e0c25', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:1c:b0:0f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e2284a8f-630f-40d9-8cdd-17a1bb5a3448', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.104', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T18:05:21Z', 'updated_at': '2021-05-25T18:05:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi', '_floatingips': [{'id': 'd0a59b91-a74b-4c9c-b6f5-55dd359c83c2', 'tenant_id': '6964ff917bfd44b1b1eca0a430c6cf1a', 'floating_ip_address': '172.27.3.53', 'floating_network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'router_id': 'e2284a8f-630f-40d9-8cdd-17a1bb5a3448', 'port_id': 'f7d352f2-c558-4275-816b-84b53eee03cb', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 681, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '66e6b1a7-3352-49c8-951e-25e4133a13bb', 'mac_address': 'fa:16:3e:7b:ab:90', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '76bacbde-212b-4bd5-b147-4cf3c743d2d6', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T18:06:15Z', 'updated_at': '2021-05-25T18:06:15Z', 'revision_number': 0, 'project_id': '6964ff917bfd44b1b1eca0a430c6cf1a', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '6239732d-4c0c-4187-b7e6-292b3569ab65', 'name': '', 'network_id': '66e6b1a7-3352-49c8-951e-25e4133a13bb', 'tenant_id': '6964ff917bfd44b1b1eca0a430c6cf1a', 'mac_address': 'fa:16:3e:16:61:66', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e2284a8f-630f-40d9-8cdd-17a1bb5a3448', 'device_owner': 'network:router_interface', 'standard_attr_id': 657, 'fixed_ips': [{'subnet_id': '7e40c2eb-fb3c-4338-9398-6fcd43705fa8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T18:05:24Z', 'updated_at': '2021-05-25T18:05:30Z', 'revision_number': 5, 'project_id': '6964ff917bfd44b1b1eca0a430c6cf1a', 'subnets': [{'id': '7e40c2eb-fb3c-4338-9398-6fcd43705fa8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-789564-2-iscsi', False) {} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 18:06:18.359687 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6256247c-d7f9-44fb-92b9-0db90025bd14 None None] The sync data for ids ['e2284a8f-630f-40d9-8cdd-17a1bb5a3448'] in dv-cinder-789564-2-iscsi is: [{'id': 'e2284a8f-630f-40d9-8cdd-17a1bb5a3448', 'name': 'tempest-TestVolumeBootPattern-1659174020-router', 'tenant_id': '6964ff917bfd44b1b1eca0a430c6cf1a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.104'}], 'enable_snat': True}, 'gw_port_id': 'c14ee1b8-5c0b-41af-875f-c2f8d16e0c25', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T18:05:20Z', 'updated_at': '2021-05-25T18:05:24Z', 'revision_number': 4, 'project_id': '6964ff917bfd44b1b1eca0a430c6cf1a', 'gw_port': {'id': 'c14ee1b8-5c0b-41af-875f-c2f8d16e0c25', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:1c:b0:0f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e2284a8f-630f-40d9-8cdd-17a1bb5a3448', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.104', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T18:05:21Z', 'updated_at': '2021-05-25T18:05:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi', '_floatingips': [{'id': 'd0a59b91-a74b-4c9c-b6f5-55dd359c83c2', 'tenant_id': '6964ff917bfd44b1b1eca0a430c6cf1a', 'floating_ip_address': '172.27.3.53', 'floating_network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'router_id': 'e2284a8f-630f-40d9-8cdd-17a1bb5a3448', 'port_id': 'f7d352f2-c558-4275-816b-84b53eee03cb', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 681, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '66e6b1a7-3352-49c8-951e-25e4133a13bb', 'mac_address': 'fa:16:3e:7b:ab:90', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '76bacbde-212b-4bd5-b147-4cf3c743d2d6', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T18:06:15Z', 'updated_at': '2021-05-25T18:06:15Z', 'revision_number': 0, 'project_id': '6964ff917bfd44b1b1eca0a430c6cf1a', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '6239732d-4c0c-4187-b7e6-292b3569ab65', 'name': '', 'network_id': '66e6b1a7-3352-49c8-951e-25e4133a13bb', 'tenant_id': '6964ff917bfd44b1b1eca0a430c6cf1a', 'mac_address': 'fa:16:3e:16:61:66', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e2284a8f-630f-40d9-8cdd-17a1bb5a3448', 'device_owner': 'network:router_interface', 'standard_attr_id': 657, 'fixed_ips': [{'subnet_id': '7e40c2eb-fb3c-4338-9398-6fcd43705fa8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T18:05:24Z', 'updated_at': '2021-05-25T18:05:30Z', 'revision_number': 5, 'project_id': '6964ff917bfd44b1b1eca0a430c6cf1a', 'subnets': [{'id': '7e40c2eb-fb3c-4338-9398-6fcd43705fa8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=99028) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 25 18:06:18.539407 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-407078c1-a610-4770-b0eb-cbdff1a74970 None None] New status for floating IP d0a59b91-a74b-4c9c-b6f5-55dd359c83c2: ACTIVE {{(pid=99029) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 25 18:06:20.697718 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-8ae9daf5-6ae4-429b-b80f-83febc57c6a4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:06:20.874715 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:06:21.891955 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-7e261f94-b84f-443e-be49-3bc1ac903b55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:06:23.394585 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-6df2b2a7-a54e-4d57-9be3-033078b9d5b3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:06:40.753774 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.agents_db [None req-14fae233-15dc-4576-836b-621c5f95b584 None None] Agent healthcheck: found 6 active agents {{(pid=99029) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 18:06:41.845932 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:06:48.176206 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-eea7b2c4-01ad-41af-811c-a66f17ba6285 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:06:50.678712 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-e5c3ebbe-df03-4e41-a9dc-71de273c1608 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:06:50.867430 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:06:51.776064 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-7e261f94-b84f-443e-be49-3bc1ac903b55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:06:53.404682 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-6df2b2a7-a54e-4d57-9be3-033078b9d5b3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:06:55.860091 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-0597c328-43fa-4c3e-b457-30b44329870e req-4e3018e6-bfa7-4d53-9616-064a76af7c25 service neutron] 10.222.0.125 "GET /v2.0/ports?device_id=76bacbde-212b-4bd5-b147-4cf3c743d2d6&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.0690053
May 25 18:06:56.019684 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0597c328-43fa-4c3e-b457-30b44329870e req-edcf118b-19ed-4f5d-be3e-7ef640256d56 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:06:56.021154 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-0597c328-43fa-4c3e-b457-30b44329870e req-edcf118b-19ed-4f5d-be3e-7ef640256d56 service neutron] 10.222.0.125 "GET /v2.0/ports?tenant_id=6964ff917bfd44b1b1eca0a430c6cf1a&device_id=76bacbde-212b-4bd5-b147-4cf3c743d2d6 HTTP/1.1" status: 200  len: 1099 time: 0.0812109
May 25 18:06:56.169431 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0597c328-43fa-4c3e-b457-30b44329870e req-121ec899-0ac7-45e8-8661-412596e07b29 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:06:56.170783 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-0597c328-43fa-4c3e-b457-30b44329870e req-121ec899-0ac7-45e8-8661-412596e07b29 service neutron] 10.222.0.125 "GET /v2.0/networks?id=66e6b1a7-3352-49c8-951e-25e4133a13bb HTTP/1.1" status: 200  len: 914 time: 0.1278067
May 25 18:06:56.286459 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-0597c328-43fa-4c3e-b457-30b44329870e req-f9a8d3a5-bc42-4a55-b4b9-53d406aff75f service neutron] 10.222.0.125 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=f7d352f2-c558-4275-816b-84b53eee03cb HTTP/1.1" status: 200  len: 1001 time: 0.1063004
May 25 18:06:56.371342 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0597c328-43fa-4c3e-b457-30b44329870e req-2767740d-efcb-42c7-9168-735a4b8b08b0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:06:56.373044 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-0597c328-43fa-4c3e-b457-30b44329870e req-2767740d-efcb-42c7-9168-735a4b8b08b0 service neutron] 10.222.0.125 "GET /v2.0/subnets?id=7e40c2eb-fb3c-4338-9398-6fcd43705fa8 HTTP/1.1" status: 200  len: 851 time: 0.0788932
May 25 18:06:56.448964 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0597c328-43fa-4c3e-b457-30b44329870e req-ddd856e3-f012-49e7-b912-019b58530ced service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:06:56.450356 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-0597c328-43fa-4c3e-b457-30b44329870e req-ddd856e3-f012-49e7-b912-019b58530ced service neutron] 10.222.0.125 "GET /v2.0/ports?network_id=66e6b1a7-3352-49c8-951e-25e4133a13bb&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0690849
May 25 18:06:56.694470 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-0597c328-43fa-4c3e-b457-30b44329870e req-be9a1152-400a-4251-a815-a61bc980c7be service neutron] 10.222.0.125 "GET /v2.0/networks/66e6b1a7-3352-49c8-951e-25e4133a13bb?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2347934
May 25 18:06:56.829091 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-0597c328-43fa-4c3e-b457-30b44329870e req-3c6a2f90-418c-437f-a63a-16b44191f8c0 service neutron] 10.222.0.125 "GET /v2.0/networks/66e6b1a7-3352-49c8-951e-25e4133a13bb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1269917
May 25 18:07:11.782398 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:07:17.752612 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.agents_db [None req-14fae233-15dc-4576-836b-621c5f95b584 None None] Agent healthcheck: found 6 active agents {{(pid=99029) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 18:07:18.169191 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-d4fab2e7-60d8-4bf0-bac0-81d69e9c5a95 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:07:20.684162 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-8f927024-f1df-4738-ae2b-365015b5e254 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:07:20.912152 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:07:21.798454 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-7e261f94-b84f-443e-be49-3bc1ac903b55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:07:23.386954 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-6df2b2a7-a54e-4d57-9be3-033078b9d5b3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:07:41.774185 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:07:48.168476 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-67e716ec-632c-4182-aab4-4d750199b6a5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:07:50.659548 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-625011b3-4e33-4c96-b122-e6911c92ef24 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:07:50.854094 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:07:51.837021 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-7e261f94-b84f-443e-be49-3bc1ac903b55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:07:53.385327 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-6df2b2a7-a54e-4d57-9be3-033078b9d5b3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:07:54.751613 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.agents_db [None req-14fae233-15dc-4576-836b-621c5f95b584 None None] Agent healthcheck: found 6 active agents {{(pid=99029) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 18:07:56.976806 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-45bb8aa3-a8c3-4f35-bd21-171aed70dcc9 req-580d420b-7ccd-4837-88c3-faa330bcc056 service neutron] 10.222.0.125 "GET /v2.0/ports?device_id=76bacbde-212b-4bd5-b147-4cf3c743d2d6&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.1638806
May 25 18:07:57.117670 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45bb8aa3-a8c3-4f35-bd21-171aed70dcc9 req-fe4a6bc4-6a93-4604-ae72-be61164f6ab1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:07:57.119026 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-45bb8aa3-a8c3-4f35-bd21-171aed70dcc9 req-fe4a6bc4-6a93-4604-ae72-be61164f6ab1 service neutron] 10.222.0.125 "GET /v2.0/ports?tenant_id=6964ff917bfd44b1b1eca0a430c6cf1a&device_id=76bacbde-212b-4bd5-b147-4cf3c743d2d6 HTTP/1.1" status: 200  len: 1099 time: 0.0699115
May 25 18:07:57.265022 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45bb8aa3-a8c3-4f35-bd21-171aed70dcc9 req-e345f3a6-5c96-43da-928f-8a4ab559b3c2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:07:57.266637 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-45bb8aa3-a8c3-4f35-bd21-171aed70dcc9 req-e345f3a6-5c96-43da-928f-8a4ab559b3c2 service neutron] 10.222.0.125 "GET /v2.0/networks?id=66e6b1a7-3352-49c8-951e-25e4133a13bb HTTP/1.1" status: 200  len: 914 time: 0.1267579
May 25 18:07:57.372426 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-45bb8aa3-a8c3-4f35-bd21-171aed70dcc9 req-4aff2874-0f2b-404b-a643-37e63f9c68d4 service neutron] 10.222.0.125 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=f7d352f2-c558-4275-816b-84b53eee03cb HTTP/1.1" status: 200  len: 1001 time: 0.0967309
May 25 18:07:57.432211 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45bb8aa3-a8c3-4f35-bd21-171aed70dcc9 req-3772660c-b4b1-48a9-a1c7-9be28057275e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:07:57.433604 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-45bb8aa3-a8c3-4f35-bd21-171aed70dcc9 req-3772660c-b4b1-48a9-a1c7-9be28057275e service neutron] 10.222.0.125 "GET /v2.0/subnets?id=7e40c2eb-fb3c-4338-9398-6fcd43705fa8 HTTP/1.1" status: 200  len: 851 time: 0.0564389
May 25 18:07:57.511042 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45bb8aa3-a8c3-4f35-bd21-171aed70dcc9 req-e46891ae-2289-448f-a0f7-e2c68c52d8af service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:07:57.512492 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-45bb8aa3-a8c3-4f35-bd21-171aed70dcc9 req-e46891ae-2289-448f-a0f7-e2c68c52d8af service neutron] 10.222.0.125 "GET /v2.0/ports?network_id=66e6b1a7-3352-49c8-951e-25e4133a13bb&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0709927
May 25 18:07:57.644458 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-45bb8aa3-a8c3-4f35-bd21-171aed70dcc9 req-080c3e1f-fe93-4334-9a2f-821e8ac52575 service neutron] 10.222.0.125 "GET /v2.0/networks/66e6b1a7-3352-49c8-951e-25e4133a13bb?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1234636
May 25 18:07:57.777723 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-45bb8aa3-a8c3-4f35-bd21-171aed70dcc9 req-7949217e-d446-4d3a-acb6-4fef753acc91 service neutron] 10.222.0.125 "GET /v2.0/networks/66e6b1a7-3352-49c8-951e-25e4133a13bb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1244113
May 25 18:08:11.784915 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:08:18.184367 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-49248223-e738-40e8-b1d4-f04bc9c4643a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:08:20.692594 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-6bceb3b8-5462-480e-a432-bdc375781822 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:08:20.915889 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:08:21.818311 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-7e261f94-b84f-443e-be49-3bc1ac903b55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:08:23.400880 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-6df2b2a7-a54e-4d57-9be3-033078b9d5b3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:08:31.752204 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.agents_db [None req-14fae233-15dc-4576-836b-621c5f95b584 None None] Agent healthcheck: found 6 active agents {{(pid=99029) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 18:08:41.795182 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:08:48.166030 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-301bd0db-c363-458b-a7b4-db775e9f7102 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:08:50.657304 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-59098e2a-6f94-42f9-a74f-8ba0a0ec10a1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:08:50.845758 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:08:51.805953 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-7e261f94-b84f-443e-be49-3bc1ac903b55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:08:53.388739 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-6df2b2a7-a54e-4d57-9be3-033078b9d5b3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:08:56.868713 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-a3c51979-691b-48d5-abdd-fa2fefb83311 req-5988de26-4f82-4dfd-b08a-8df959bf0d21 service neutron] 10.222.0.125 "GET /v2.0/ports?device_id=76bacbde-212b-4bd5-b147-4cf3c743d2d6&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.0760651
May 25 18:08:57.009674 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3c51979-691b-48d5-abdd-fa2fefb83311 req-bea777e3-25fd-42ae-ba49-1094279d0696 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:08:57.011112 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-a3c51979-691b-48d5-abdd-fa2fefb83311 req-bea777e3-25fd-42ae-ba49-1094279d0696 service neutron] 10.222.0.125 "GET /v2.0/ports?tenant_id=6964ff917bfd44b1b1eca0a430c6cf1a&device_id=76bacbde-212b-4bd5-b147-4cf3c743d2d6 HTTP/1.1" status: 200  len: 1099 time: 0.0744073
May 25 18:08:57.159134 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3c51979-691b-48d5-abdd-fa2fefb83311 req-ec00c4d0-0cb8-43db-9206-ea8299537daa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:08:57.160750 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-a3c51979-691b-48d5-abdd-fa2fefb83311 req-ec00c4d0-0cb8-43db-9206-ea8299537daa service neutron] 10.222.0.125 "GET /v2.0/networks?id=66e6b1a7-3352-49c8-951e-25e4133a13bb HTTP/1.1" status: 200  len: 914 time: 0.1278644
May 25 18:08:57.268823 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-a3c51979-691b-48d5-abdd-fa2fefb83311 req-5b1e746d-cdf3-4666-a49c-a05a86ec88a1 service neutron] 10.222.0.125 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=f7d352f2-c558-4275-816b-84b53eee03cb HTTP/1.1" status: 200  len: 1001 time: 0.0990233
May 25 18:08:57.332261 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3c51979-691b-48d5-abdd-fa2fefb83311 req-28c3ee80-8400-4837-bd68-08e3eaf73209 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:08:57.333683 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-a3c51979-691b-48d5-abdd-fa2fefb83311 req-28c3ee80-8400-4837-bd68-08e3eaf73209 service neutron] 10.222.0.125 "GET /v2.0/subnets?id=7e40c2eb-fb3c-4338-9398-6fcd43705fa8 HTTP/1.1" status: 200  len: 851 time: 0.0565658
May 25 18:08:57.408859 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3c51979-691b-48d5-abdd-fa2fefb83311 req-f962de83-7297-4106-8f3b-3b59fed999be service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:08:57.410335 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-a3c51979-691b-48d5-abdd-fa2fefb83311 req-f962de83-7297-4106-8f3b-3b59fed999be service neutron] 10.222.0.125 "GET /v2.0/ports?network_id=66e6b1a7-3352-49c8-951e-25e4133a13bb&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0678747
May 25 18:08:57.636270 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-a3c51979-691b-48d5-abdd-fa2fefb83311 req-00a0277e-a0ce-481c-b199-de9b13499ad1 service neutron] 10.222.0.125 "GET /v2.0/networks/66e6b1a7-3352-49c8-951e-25e4133a13bb?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2169688
May 25 18:08:57.768266 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-a3c51979-691b-48d5-abdd-fa2fefb83311 req-e7599732-cfb9-4fea-9d7a-e493d447c4f8 service neutron] 10.222.0.125 "GET /v2.0/networks/66e6b1a7-3352-49c8-951e-25e4133a13bb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1232872
May 25 18:09:07.964766 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [req-d2f9c9e8-4005-40f5-977b-95eea7e11bd8 req-8a6347eb-b69e-41d6-82ed-44c3ad376be8 service neutron] (99026) timed out ('10.222.0.125', 55512) {{(pid=99026) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:830}}
May 25 18:09:08.751294 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.agents_db [None req-14fae233-15dc-4576-836b-621c5f95b584 None None] Agent healthcheck: found 6 active agents {{(pid=99029) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 18:09:11.804832 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:09:18.171312 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-cfaa7606-48d5-4df3-9eb4-3c3b2915296c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:09:20.696709 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-08883838-15d2-48ac-b424-2cb76a2f8a28 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:09:20.880182 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:09:21.809680 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-7e261f94-b84f-443e-be49-3bc1ac903b55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:09:23.376357 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-6df2b2a7-a54e-4d57-9be3-033078b9d5b3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:09:41.827926 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:09:45.750815 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.agents_db [None req-14fae233-15dc-4576-836b-621c5f95b584 None None] Agent healthcheck: found 6 active agents {{(pid=99029) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 18:09:48.197481 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-032d1988-32ee-4d70-adcc-18d0a9e7b79c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:09:50.655783 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-ef5eef3d-5881-4cdc-b5c7-6fdc5a486678 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:09:50.855879 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:09:51.808545 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-7e261f94-b84f-443e-be49-3bc1ac903b55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:09:51.986777 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 52950) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 18:09:52.246129 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.plugin [None req-45117606-46e7-4779-96fc-6f7a261240db tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Deleting port 7bb3085a-746f-49b0-9d92-0da7a072165f {{(pid=99027) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 18:09:52.246464 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-45117606-46e7-4779-96fc-6f7a261240db tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781841220419'] for port, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:09:52.364861 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-45117606-46e7-4779-96fc-6f7a261240db tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-418810'] for port, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:09:52.365285 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-45117606-46e7-4779-96fc-6f7a261240db tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:09:52.485600 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.plugin [None req-45117606-46e7-4779-96fc-6f7a261240db tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Calling delete_port for 7bb3085a-746f-49b0-9d92-0da7a072165f owned by network:floatingip {{(pid=99027) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 18:09:52.650346 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-45117606-46e7-4779-96fc-6f7a261240db tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781841222566', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781840788188', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15468986'] for port, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:09:52.654679 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-6a7e178b-6307-4d3f-b25e-3758b77ef718 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:09:52.697883 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45117606-46e7-4779-96fc-6f7a261240db tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Pushing event deleted for resources: {'Port': ['ID=7bb3085a-746f-49b0-9d92-0da7a072165f,revision_number=None']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:09:52.736644 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45117606-46e7-4779-96fc-6f7a261240db tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:09:52.737017 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45117606-46e7-4779-96fc-6f7a261240db tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:09:52.738124 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45117606-46e7-4779-96fc-6f7a261240db tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:09:52.738567 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45117606-46e7-4779-96fc-6f7a261240db tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:09:52.738928 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45117606-46e7-4779-96fc-6f7a261240db tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:09:52.739286 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45117606-46e7-4779-96fc-6f7a261240db tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:09:52.739642 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45117606-46e7-4779-96fc-6f7a261240db tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:09:52.739995 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45117606-46e7-4779-96fc-6f7a261240db tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:09:52.740346 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45117606-46e7-4779-96fc-6f7a261240db tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:09:52.740694 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45117606-46e7-4779-96fc-6f7a261240db tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:09:52.741040 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45117606-46e7-4779-96fc-6f7a261240db tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:09:52.741411 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45117606-46e7-4779-96fc-6f7a261240db tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99027) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:09:52.771234 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-45117606-46e7-4779-96fc-6f7a261240db tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.117s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:09:52.799835 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-45117606-46e7-4779-96fc-6f7a261240db tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Notify callbacks [] for floatingip, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:09:52.800381 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.db.l3_db [None req-45117606-46e7-4779-96fc-6f7a261240db tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Floating IP d0a59b91-a74b-4c9c-b6f5-55dd359c83c2 disassociated (deleted). External IP: 172.27.3.53, port: f7d352f2-c558-4275-816b-84b53eee03cb.
May 25 18:09:53.235975 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-45117606-46e7-4779-96fc-6f7a261240db tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Router e2284a8f-630f-40d9-8cdd-17a1bb5a3448 has already been hosted by L3 agent eaeb6875-c4ed-43b6-8658-aa4e52324fdf {{(pid=99027) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 25 18:09:53.420048 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-45117606-46e7-4779-96fc-6f7a261240db tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Notify agent at l3_agent.dv-cinder-789564-2-iscsi the message routers_updated {{(pid=99027) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 25 18:09:53.420320 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-6df2b2a7-a54e-4d57-9be3-033078b9d5b3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:09:53.429698 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0ec112b9-c876-4efb-8387-85a7db9a294a None None] Sync routers for ids ['e2284a8f-630f-40d9-8cdd-17a1bb5a3448'] in dv-cinder-789564-2-iscsi {{(pid=99028) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 25 18:09:53.438392 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0ec112b9-c876-4efb-8387-85a7db9a294a None None] Routers {'e2284a8f-630f-40d9-8cdd-17a1bb5a3448'} bound to L3 agent in host dv-cinder-789564-2-iscsi {{(pid=99028) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 18:09:53.439170 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-0ec112b9-c876-4efb-8387-85a7db9a294a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcaeacad7c0>, 'dv-cinder-789564-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-25T17:34:21Z,description=<?>,heartbeat_timestamp=2021-05-25T18:09:51Z,host='dv-cinder-789564-2-iscsi',id=eaeb6875-c4ed-43b6-8658-aa4e52324fdf,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T17:34:21Z,topic='l3_agent')) {'router_ids': ['e2284a8f-630f-40d9-8cdd-17a1bb5a3448'], 'active': True} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 18:09:53.494541 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-45117606-46e7-4779-96fc-6f7a261240db tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-239387'] for floatingip, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:09:53.549249 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-45117606-46e7-4779-96fc-6f7a261240db tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] 10.222.0.122 "DELETE /v2.0/floatingips/d0a59b91-a74b-4c9c-b6f5-55dd359c83c2 HTTP/1.1" status: 204  len: 168 time: 1.5607510
May 25 18:09:53.550457 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '76bacbde-212b-4bd5-b147-4cf3c743d2d6', 'tag': 'f7d352f2-c558-4275-816b-84b53eee03cb'}] {{(pid=99027) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 18:09:53.617465 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvr_db [None req-0ec112b9-c876-4efb-8387-85a7db9a294a None None] Set router e2284a8f-630f-40d9-8cdd-17a1bb5a3448 gateway port host: dv-cinder-789564-2-iscsi {{(pid=99028) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 18:09:53.729071 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '76bacbde-212b-4bd5-b147-4cf3c743d2d6', 'tag': 'f7d352f2-c558-4275-816b-84b53eee03cb', 'status': 'completed', 'code': 200}
May 25 18:09:53.833937 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6bfb8dd0-5c86-4038-ba4b-2ee7e09b9898 req-4ac72bb6-7e90-48d6-9d48-95c2c8c80245 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:09:53.835381 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-6bfb8dd0-5c86-4038-ba4b-2ee7e09b9898 req-4ac72bb6-7e90-48d6-9d48-95c2c8c80245 service neutron] 10.222.0.125 "GET /v2.0/ports?tenant_id=6964ff917bfd44b1b1eca0a430c6cf1a&device_id=76bacbde-212b-4bd5-b147-4cf3c743d2d6 HTTP/1.1" status: 200  len: 1099 time: 0.0721397
May 25 18:09:53.956418 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-0ec112b9-c876-4efb-8387-85a7db9a294a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcaeacad7c0>, [{'id': 'e2284a8f-630f-40d9-8cdd-17a1bb5a3448', 'name': 'tempest-TestVolumeBootPattern-1659174020-router', 'tenant_id': '6964ff917bfd44b1b1eca0a430c6cf1a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.104'}], 'enable_snat': True}, 'gw_port_id': 'c14ee1b8-5c0b-41af-875f-c2f8d16e0c25', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T18:05:20Z', 'updated_at': '2021-05-25T18:05:24Z', 'revision_number': 4, 'project_id': '6964ff917bfd44b1b1eca0a430c6cf1a', 'gw_port': {'id': 'c14ee1b8-5c0b-41af-875f-c2f8d16e0c25', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:1c:b0:0f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e2284a8f-630f-40d9-8cdd-17a1bb5a3448', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.104', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T18:05:21Z', 'updated_at': '2021-05-25T18:05:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi', '_interfaces': [{'id': '6239732d-4c0c-4187-b7e6-292b3569ab65', 'name': '', 'network_id': '66e6b1a7-3352-49c8-951e-25e4133a13bb', 'tenant_id': '6964ff917bfd44b1b1eca0a430c6cf1a', 'mac_address': 'fa:16:3e:16:61:66', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e2284a8f-630f-40d9-8cdd-17a1bb5a3448', 'device_owner': 'network:router_interface', 'standard_attr_id': 657, 'fixed_ips': [{'subnet_id': '7e40c2eb-fb3c-4338-9398-6fcd43705fa8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T18:05:24Z', 'updated_at': '2021-05-25T18:05:30Z', 'revision_number': 5, 'project_id': '6964ff917bfd44b1b1eca0a430c6cf1a', 'subnets': [{'id': '7e40c2eb-fb3c-4338-9398-6fcd43705fa8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-789564-2-iscsi', False) {} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 18:09:53.960530 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0ec112b9-c876-4efb-8387-85a7db9a294a None None] Checking router: e2284a8f-630f-40d9-8cdd-17a1bb5a3448 for host: dv-cinder-789564-2-iscsi {{(pid=99028) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 25 18:09:53.970105 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0ec112b9-c876-4efb-8387-85a7db9a294a None None] Routers {'e2284a8f-630f-40d9-8cdd-17a1bb5a3448'} bound to L3 agent in host dv-cinder-789564-2-iscsi {{(pid=99028) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 18:09:53.970775 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-0ec112b9-c876-4efb-8387-85a7db9a294a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcaeacad7c0>, 'dv-cinder-789564-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-25T17:34:21Z,description=<?>,heartbeat_timestamp=2021-05-25T18:09:51Z,host='dv-cinder-789564-2-iscsi',id=eaeb6875-c4ed-43b6-8658-aa4e52324fdf,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T17:34:21Z,topic='l3_agent')) {'router_ids': ['e2284a8f-630f-40d9-8cdd-17a1bb5a3448'], 'active': True} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 18:09:53.983583 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6bfb8dd0-5c86-4038-ba4b-2ee7e09b9898 req-526e6cc8-2241-4eca-934c-e4ad57dd3c71 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:09:53.985035 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-6bfb8dd0-5c86-4038-ba4b-2ee7e09b9898 req-526e6cc8-2241-4eca-934c-e4ad57dd3c71 service neutron] 10.222.0.125 "GET /v2.0/networks?id=66e6b1a7-3352-49c8-951e-25e4133a13bb HTTP/1.1" status: 200  len: 914 time: 0.1452475
May 25 18:09:54.060999 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-6bfb8dd0-5c86-4038-ba4b-2ee7e09b9898 req-8727675f-7bab-4f03-bbb4-9d599dfcbd9f service neutron] 10.222.0.125 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=f7d352f2-c558-4275-816b-84b53eee03cb HTTP/1.1" status: 200  len: 217 time: 0.0695386
May 25 18:09:54.158829 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvr_db [None req-0ec112b9-c876-4efb-8387-85a7db9a294a None None] Set router e2284a8f-630f-40d9-8cdd-17a1bb5a3448 gateway port host: dv-cinder-789564-2-iscsi {{(pid=99028) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 18:09:54.175817 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6bfb8dd0-5c86-4038-ba4b-2ee7e09b9898 req-8cde4d4f-7dbc-40d2-b7f5-f22922cae8f4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:09:54.177288 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-6bfb8dd0-5c86-4038-ba4b-2ee7e09b9898 req-8cde4d4f-7dbc-40d2-b7f5-f22922cae8f4 service neutron] 10.222.0.125 "GET /v2.0/subnets?id=7e40c2eb-fb3c-4338-9398-6fcd43705fa8 HTTP/1.1" status: 200  len: 851 time: 0.1110694
May 25 18:09:54.252332 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29520b55-cf45-4521-9a51-82fba91be8d7 req-bee186ac-3a39-4714-aaff-45728991f2db tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:09:54.253148 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-29520b55-cf45-4521-9a51-82fba91be8d7 req-bee186ac-3a39-4714-aaff-45728991f2db tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Synchronizing usage tracker for tenant:6964ff917bfd44b1b1eca0a430c6cf1a on resource:port {{(pid=99027) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 25 18:09:54.279373 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6bfb8dd0-5c86-4038-ba4b-2ee7e09b9898 req-95820cdd-3820-49f6-be7c-d234eb4ba7f5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:09:54.280854 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-6bfb8dd0-5c86-4038-ba4b-2ee7e09b9898 req-95820cdd-3820-49f6-be7c-d234eb4ba7f5 service neutron] 10.222.0.125 "GET /v2.0/ports?network_id=66e6b1a7-3352-49c8-951e-25e4133a13bb&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0979249
May 25 18:09:54.371041 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.quota.resource [req-29520b55-cf45-4521-9a51-82fba91be8d7 req-bee186ac-3a39-4714-aaff-45728991f2db tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Unset dirty status for tenant:6964ff917bfd44b1b1eca0a430c6cf1a on resource:port {{(pid=99027) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 25 18:09:54.372088 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-29520b55-cf45-4521-9a51-82fba91be8d7 req-bee186ac-3a39-4714-aaff-45728991f2db tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] 10.222.0.122 "GET /v2.0/ports?device_id=76bacbde-212b-4bd5-b147-4cf3c743d2d6 HTTP/1.1" status: 200  len: 946 time: 0.3290658
May 25 18:09:54.457438 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-29520b55-cf45-4521-9a51-82fba91be8d7 req-dd89acfe-618b-4dfb-a5dc-d633167d968b tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] 10.222.0.122 "GET /v2.0/security-groups?id=ae00d844-d334-4393-8fc2-9764c8279060&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0759683
May 25 18:09:54.466380 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-6bfb8dd0-5c86-4038-ba4b-2ee7e09b9898 req-485efab7-c60a-4082-9d7b-30f7b35ec183 service neutron] 10.222.0.125 "GET /v2.0/networks/66e6b1a7-3352-49c8-951e-25e4133a13bb?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1801538
May 25 18:09:54.479386 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-0ec112b9-c876-4efb-8387-85a7db9a294a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcaeacad7c0>, [{'id': 'e2284a8f-630f-40d9-8cdd-17a1bb5a3448', 'name': 'tempest-TestVolumeBootPattern-1659174020-router', 'tenant_id': '6964ff917bfd44b1b1eca0a430c6cf1a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.104'}], 'enable_snat': True}, 'gw_port_id': 'c14ee1b8-5c0b-41af-875f-c2f8d16e0c25', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T18:05:20Z', 'updated_at': '2021-05-25T18:05:24Z', 'revision_number': 4, 'project_id': '6964ff917bfd44b1b1eca0a430c6cf1a', 'gw_port': {'id': 'c14ee1b8-5c0b-41af-875f-c2f8d16e0c25', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:1c:b0:0f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e2284a8f-630f-40d9-8cdd-17a1bb5a3448', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.104', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T18:05:21Z', 'updated_at': '2021-05-25T18:05:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi', '_interfaces': [{'id': '6239732d-4c0c-4187-b7e6-292b3569ab65', 'name': '', 'network_id': '66e6b1a7-3352-49c8-951e-25e4133a13bb', 'tenant_id': '6964ff917bfd44b1b1eca0a430c6cf1a', 'mac_address': 'fa:16:3e:16:61:66', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e2284a8f-630f-40d9-8cdd-17a1bb5a3448', 'device_owner': 'network:router_interface', 'standard_attr_id': 657, 'fixed_ips': [{'subnet_id': '7e40c2eb-fb3c-4338-9398-6fcd43705fa8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T18:05:24Z', 'updated_at': '2021-05-25T18:05:30Z', 'revision_number': 5, 'project_id': '6964ff917bfd44b1b1eca0a430c6cf1a', 'subnets': [{'id': '7e40c2eb-fb3c-4338-9398-6fcd43705fa8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-789564-2-iscsi', False) {} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 18:09:54.483301 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0ec112b9-c876-4efb-8387-85a7db9a294a None None] The sync data for ids ['e2284a8f-630f-40d9-8cdd-17a1bb5a3448'] in dv-cinder-789564-2-iscsi is: [{'id': 'e2284a8f-630f-40d9-8cdd-17a1bb5a3448', 'name': 'tempest-TestVolumeBootPattern-1659174020-router', 'tenant_id': '6964ff917bfd44b1b1eca0a430c6cf1a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.104'}], 'enable_snat': True}, 'gw_port_id': 'c14ee1b8-5c0b-41af-875f-c2f8d16e0c25', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T18:05:20Z', 'updated_at': '2021-05-25T18:05:24Z', 'revision_number': 4, 'project_id': '6964ff917bfd44b1b1eca0a430c6cf1a', 'gw_port': {'id': 'c14ee1b8-5c0b-41af-875f-c2f8d16e0c25', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:1c:b0:0f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e2284a8f-630f-40d9-8cdd-17a1bb5a3448', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.104', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T18:05:21Z', 'updated_at': '2021-05-25T18:05:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi', '_interfaces': [{'id': '6239732d-4c0c-4187-b7e6-292b3569ab65', 'name': '', 'network_id': '66e6b1a7-3352-49c8-951e-25e4133a13bb', 'tenant_id': '6964ff917bfd44b1b1eca0a430c6cf1a', 'mac_address': 'fa:16:3e:16:61:66', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e2284a8f-630f-40d9-8cdd-17a1bb5a3448', 'device_owner': 'network:router_interface', 'standard_attr_id': 657, 'fixed_ips': [{'subnet_id': '7e40c2eb-fb3c-4338-9398-6fcd43705fa8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T18:05:24Z', 'updated_at': '2021-05-25T18:05:30Z', 'revision_number': 5, 'project_id': '6964ff917bfd44b1b1eca0a430c6cf1a', 'subnets': [{'id': '7e40c2eb-fb3c-4338-9398-6fcd43705fa8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=99028) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 25 18:09:54.603145 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-6bfb8dd0-5c86-4038-ba4b-2ee7e09b9898 req-0957ec0f-ce42-4634-9a45-91d7566a3607 service neutron] 10.222.0.125 "GET /v2.0/networks/66e6b1a7-3352-49c8-951e-25e4133a13bb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1304584
May 25 18:09:54.694099 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-91dcaa38-85f9-4e00-90e9-83b2f6b858a6 None None] New status for floating IP d0a59b91-a74b-4c9c-b6f5-55dd359c83c2: DOWN {{(pid=99029) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 25 18:09:55.447489 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-972b7530-55d0-4962-aac6-fddb86d45630 req-e54416da-32df-4c55-890a-3d8703f80651 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99027) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:09:55.448899 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-972b7530-55d0-4962-aac6-fddb86d45630 req-e54416da-32df-4c55-890a-3d8703f80651 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] 10.222.0.125 "GET /v2.0/ports?device_id=76bacbde-212b-4bd5-b147-4cf3c743d2d6 HTTP/1.1" status: 200  len: 946 time: 0.0796688
May 25 18:09:55.586977 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.plugin [req-972b7530-55d0-4962-aac6-fddb86d45630 req-19e70e36-1f0e-40c7-8c9d-a5ceeab07385 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Deleting port f7d352f2-c558-4275-816b-84b53eee03cb {{(pid=99027) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 18:09:55.587322 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-972b7530-55d0-4962-aac6-fddb86d45630 req-19e70e36-1f0e-40c7-8c9d-a5ceeab07385 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781841220419'] for port, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:09:55.716219 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f30e8411-9227-48e3-9a5c-80c6c8d05a3e req-10f179eb-8f7a-41c5-9d78-f8c4de1aa8ea tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=99026) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 25 18:09:55.717817 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-f30e8411-9227-48e3-9a5c-80c6c8d05a3e req-10f179eb-8f7a-41c5-9d78-f8c4de1aa8ea tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] 10.222.0.122 "GET /v2.0/ports?device_id=76bacbde-212b-4bd5-b147-4cf3c743d2d6 HTTP/1.1" status: 200  len: 946 time: 0.1369245
May 25 18:09:55.723275 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.db [req-972b7530-55d0-4962-aac6-fddb86d45630 req-19e70e36-1f0e-40c7-8c9d-a5ceeab07385 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] For port f7d352f2-c558-4275-816b-84b53eee03cb, host hv-cinder-78956, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78956',level=0,port_id=f7d352f2-c558-4275-816b-84b53eee03cb,segment=NetworkSegment(2abbf128-e5e5-4349-af70-f8887ef58b0f),segment_id=2abbf128-e5e5-4349-af70-f8887ef58b0f)] {{(pid=99027) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 18:09:55.723633 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-972b7530-55d0-4962-aac6-fddb86d45630 req-19e70e36-1f0e-40c7-8c9d-a5ceeab07385 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-418810'] for port, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:09:55.764345 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-f30e8411-9227-48e3-9a5c-80c6c8d05a3e req-642b05ac-b906-47ed-a6c2-7e6beb33062a tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] 10.222.0.122 "GET /v2.0/security-groups?id=ae00d844-d334-4393-8fc2-9764c8279060&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0402620
May 25 18:09:55.941606 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.plugin [req-972b7530-55d0-4962-aac6-fddb86d45630 req-19e70e36-1f0e-40c7-8c9d-a5ceeab07385 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Calling delete_port for f7d352f2-c558-4275-816b-84b53eee03cb owned by compute:nova {{(pid=99027) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 18:09:56.118507 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-972b7530-55d0-4962-aac6-fddb86d45630 req-19e70e36-1f0e-40c7-8c9d-a5ceeab07385 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781841222566', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781840788188', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15468986'] for port, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:09:56.124083 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-030ec2cb-cdc2-426b-8345-41ced92d40db tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:09:56.169521 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19e70e36-1f0e-40c7-8c9d-a5ceeab07385 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Pushing event deleted for resources: {'Port': ['ID=f7d352f2-c558-4275-816b-84b53eee03cb,revision_number=None']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:09:56.208903 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-19e70e36-1f0e-40c7-8c9d-a5ceeab07385 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:09:56.246330 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.l3_dvrscheduler_db [req-972b7530-55d0-4962-aac6-fddb86d45630 req-19e70e36-1f0e-40c7-8c9d-a5ceeab07385 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] No DVR routers for this DVR port f7d352f2-c558-4275-816b-84b53eee03cb on host hv-cinder-78956 {{(pid=99027) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 25 18:09:56.248864 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [req-972b7530-55d0-4962-aac6-fddb86d45630 req-19e70e36-1f0e-40c7-8c9d-a5ceeab07385 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-239387'] for port, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:09:56.251512 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '76bacbde-212b-4bd5-b147-4cf3c743d2d6', 'name': 'network-vif-deleted', 'tag': 'f7d352f2-c558-4275-816b-84b53eee03cb'}] {{(pid=99027) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 25 18:09:56.302211 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '76bacbde-212b-4bd5-b147-4cf3c743d2d6', 'name': 'network-vif-deleted', 'tag': 'f7d352f2-c558-4275-816b-84b53eee03cb', 'status': 'completed', 'code': 200}
May 25 18:09:56.319225 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [req-972b7530-55d0-4962-aac6-fddb86d45630 req-19e70e36-1f0e-40c7-8c9d-a5ceeab07385 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] 10.222.0.125 "DELETE /v2.0/ports/f7d352f2-c558-4275-816b-84b53eee03cb HTTP/1.1" status: 204  len: 173 time: 0.8634131
May 25 18:09:56.919597 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [req-def9c205-9420-4cd4-b91e-55f1b8d7f6e7 req-f7f81469-0f29-43c8-806f-219202900110 tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] 10.222.0.122 "GET /v2.0/ports?device_id=76bacbde-212b-4bd5-b147-4cf3c743d2d6 HTTP/1.1" status: 200  len: 210 time: 0.0439811
May 25 18:09:58.634390 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Device f7d352f2-c558-4275-816b-84b53eee03cb no longer exists at agent hyperv_hv-cinder-78956 {{(pid=99028) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 18:09:58.668805 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.plugin [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] No Port match for: f7d352f2-c558-4275-816b-84b53eee03cb {{(pid=99028) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 25 18:09:58.673792 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Device f7d352f2-c558-4275-816b-84b53eee03cb not bound to the agent host hv-cinder-78956 {{(pid=99028) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 25 18:09:59.368391 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 52982) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 18:09:59.435989 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-c38a508c-5b5c-41c7-885e-43ba798a718e tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Notify callbacks [] for security_group, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:09:59.466220 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-c38a508c-5b5c-41c7-885e-43ba798a718e tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Notify callbacks [] for security_group, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:09:59.598374 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-c38a508c-5b5c-41c7-885e-43ba798a718e tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:09:59.602181 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-ac090b0c-e997-4532-9828-6ae8de1c86ee admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:09:59.617683 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c38a508c-5b5c-41c7-885e-43ba798a718e tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=ae00d844-d334-4393-8fc2-9764c8279060,revision_number=None']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:09:59.620600 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-c38a508c-5b5c-41c7-885e-43ba798a718e tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:09:59.665982 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-c38a508c-5b5c-41c7-885e-43ba798a718e tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] Notify callbacks [] for security_group, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:09:59.667087 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-c38a508c-5b5c-41c7-885e-43ba798a718e tempest-TestVolumeBootPattern-1535959541 tempest-TestVolumeBootPattern-1535959541-project] 10.222.0.122 "DELETE /v2.0/security-groups/ae00d844-d334-4393-8fc2-9764c8279060 HTTP/1.1" status: 204  len: 168 time: 0.2977145
May 25 18:09:59.766752 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 52988) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 18:10:00.306089 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-490fa31f-7234-4a3f-a413-0061ee12fd87 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-420907'] for router_interface, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:10:00.716909 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.plugin [None req-490fa31f-7234-4a3f-a413-0061ee12fd87 admin admin] Deleting port 6239732d-4c0c-4187-b7e6-292b3569ab65 {{(pid=99026) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 18:10:00.717272 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-490fa31f-7234-4a3f-a413-0061ee12fd87 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781841220419'] for port, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:10:00.836856 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.db [None req-490fa31f-7234-4a3f-a413-0061ee12fd87 admin admin] For port 6239732d-4c0c-4187-b7e6-292b3569ab65, host dv-cinder-789564-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=6239732d-4c0c-4187-b7e6-292b3569ab65,segment=NetworkSegment(2abbf128-e5e5-4349-af70-f8887ef58b0f),segment_id=2abbf128-e5e5-4349-af70-f8887ef58b0f)] {{(pid=99026) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 18:10:00.837602 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-490fa31f-7234-4a3f-a413-0061ee12fd87 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-418810'] for port, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:10:01.052669 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.plugin [None req-490fa31f-7234-4a3f-a413-0061ee12fd87 admin admin] Calling delete_port for 6239732d-4c0c-4187-b7e6-292b3569ab65 owned by network:router_interface {{(pid=99026) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 18:10:01.484510 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-490fa31f-7234-4a3f-a413-0061ee12fd87 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781841222566', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781840788188', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15476536'] for port, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:10:01.489824 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-e86bca68-74f2-4100-990a-1c7c1cd7149f tempest-TestMinimumBasicScenario-595128876 tempest-TestMinimumBasicScenario-595128876-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:10:01.538001 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-490fa31f-7234-4a3f-a413-0061ee12fd87 admin admin] Pushing event deleted for resources: {'Port': ['ID=6239732d-4c0c-4187-b7e6-292b3569ab65,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:10:01.578869 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-490fa31f-7234-4a3f-a413-0061ee12fd87 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:10:01.580968 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-490fa31f-7234-4a3f-a413-0061ee12fd87 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:10:01.580968 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-490fa31f-7234-4a3f-a413-0061ee12fd87 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:10:01.580968 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-490fa31f-7234-4a3f-a413-0061ee12fd87 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:10:01.580968 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-490fa31f-7234-4a3f-a413-0061ee12fd87 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:10:01.580968 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-490fa31f-7234-4a3f-a413-0061ee12fd87 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:10:01.580968 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-490fa31f-7234-4a3f-a413-0061ee12fd87 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:10:01.581544 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-490fa31f-7234-4a3f-a413-0061ee12fd87 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:10:01.582303 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-490fa31f-7234-4a3f-a413-0061ee12fd87 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:10:01.582654 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-490fa31f-7234-4a3f-a413-0061ee12fd87 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:10:01.583043 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-490fa31f-7234-4a3f-a413-0061ee12fd87 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:10:01.583466 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-490fa31f-7234-4a3f-a413-0061ee12fd87 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99026) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:10:01.610813 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-490fa31f-7234-4a3f-a413-0061ee12fd87 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.121s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:10:01.812985 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-490fa31f-7234-4a3f-a413-0061ee12fd87 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-551393', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-420795'] for router_interface, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:10:02.168251 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-490fa31f-7234-4a3f-a413-0061ee12fd87 admin admin] Router e2284a8f-630f-40d9-8cdd-17a1bb5a3448 has already been hosted by L3 agent eaeb6875-c4ed-43b6-8658-aa4e52324fdf {{(pid=99026) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 25 18:10:02.349682 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-490fa31f-7234-4a3f-a413-0061ee12fd87 admin admin] Notify agent at l3_agent.dv-cinder-789564-2-iscsi the message routers_updated {{(pid=99026) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 25 18:10:02.357958 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-29b7b34b-2504-441c-ac46-299abaed55c1 None None] Sync routers for ids ['e2284a8f-630f-40d9-8cdd-17a1bb5a3448'] in dv-cinder-789564-2-iscsi {{(pid=99028) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 25 18:10:02.363929 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-490fa31f-7234-4a3f-a413-0061ee12fd87 admin admin] 10.222.0.122 "PUT /v2.0/routers/e2284a8f-630f-40d9-8cdd-17a1bb5a3448/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.5960977
May 25 18:10:02.366572 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 52992) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 18:10:02.368554 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvrscheduler_db [None req-29b7b34b-2504-441c-ac46-299abaed55c1 None None] Routers {'e2284a8f-630f-40d9-8cdd-17a1bb5a3448'} bound to L3 agent in host dv-cinder-789564-2-iscsi {{(pid=99028) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 18:10:02.369231 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-29b7b34b-2504-441c-ac46-299abaed55c1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcae6b705e0>, 'dv-cinder-789564-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-25T17:34:21Z,description=<?>,heartbeat_timestamp=2021-05-25T18:09:51Z,host='dv-cinder-789564-2-iscsi',id=eaeb6875-c4ed-43b6-8658-aa4e52324fdf,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T17:34:21Z,topic='l3_agent')) {'router_ids': ['e2284a8f-630f-40d9-8cdd-17a1bb5a3448'], 'active': True} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 18:10:02.594543 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvr_db [None req-29b7b34b-2504-441c-ac46-299abaed55c1 None None] Set router e2284a8f-630f-40d9-8cdd-17a1bb5a3448 gateway port host: dv-cinder-789564-2-iscsi {{(pid=99028) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 18:10:02.662749 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-948a2fa8-68db-4d16-af12-113aac1d9f76 admin admin] Notify callbacks [] for router, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:10:02.845297 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-948a2fa8-68db-4d16-af12-113aac1d9f76 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:10:02.882447 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-29b7b34b-2504-441c-ac46-299abaed55c1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcae6b705e0>, [{'id': 'e2284a8f-630f-40d9-8cdd-17a1bb5a3448', 'name': 'tempest-TestVolumeBootPattern-1659174020-router', 'tenant_id': '6964ff917bfd44b1b1eca0a430c6cf1a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.104'}], 'enable_snat': True}, 'gw_port_id': 'c14ee1b8-5c0b-41af-875f-c2f8d16e0c25', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T18:05:20Z', 'updated_at': '2021-05-25T18:10:01Z', 'revision_number': 5, 'project_id': '6964ff917bfd44b1b1eca0a430c6cf1a', 'gw_port': {'id': 'c14ee1b8-5c0b-41af-875f-c2f8d16e0c25', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:1c:b0:0f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e2284a8f-630f-40d9-8cdd-17a1bb5a3448', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.104', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T18:05:21Z', 'updated_at': '2021-05-25T18:05:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi'}], 'dv-cinder-789564-2-iscsi', False) {} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 18:10:02.886285 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-29b7b34b-2504-441c-ac46-299abaed55c1 None None] Checking router: e2284a8f-630f-40d9-8cdd-17a1bb5a3448 for host: dv-cinder-789564-2-iscsi {{(pid=99028) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 25 18:10:02.894734 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvrscheduler_db [None req-29b7b34b-2504-441c-ac46-299abaed55c1 None None] Routers {'e2284a8f-630f-40d9-8cdd-17a1bb5a3448'} bound to L3 agent in host dv-cinder-789564-2-iscsi {{(pid=99028) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 18:10:02.895360 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-29b7b34b-2504-441c-ac46-299abaed55c1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcae6b705e0>, 'dv-cinder-789564-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-25T17:34:21Z,description=<?>,heartbeat_timestamp=2021-05-25T18:09:51Z,host='dv-cinder-789564-2-iscsi',id=eaeb6875-c4ed-43b6-8658-aa4e52324fdf,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T17:34:21Z,topic='l3_agent')) {'router_ids': ['e2284a8f-630f-40d9-8cdd-17a1bb5a3448'], 'active': True} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 18:10:02.977259 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.plugin [None req-948a2fa8-68db-4d16-af12-113aac1d9f76 admin admin] Deleting port c14ee1b8-5c0b-41af-875f-c2f8d16e0c25 {{(pid=99026) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 18:10:02.977596 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-948a2fa8-68db-4d16-af12-113aac1d9f76 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781841220419'] for port, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:10:03.052734 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvr_db [None req-29b7b34b-2504-441c-ac46-299abaed55c1 None None] Set router e2284a8f-630f-40d9-8cdd-17a1bb5a3448 gateway port host: None {{(pid=99028) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 18:10:03.098262 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.db [None req-948a2fa8-68db-4d16-af12-113aac1d9f76 admin admin] For port c14ee1b8-5c0b-41af-875f-c2f8d16e0c25, host dv-cinder-789564-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=c14ee1b8-5c0b-41af-875f-c2f8d16e0c25,segment=NetworkSegment(471771f9-c462-4865-800d-0d5029e9eb3e),segment_id=471771f9-c462-4865-800d-0d5029e9eb3e)] {{(pid=99026) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 18:10:03.098605 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-948a2fa8-68db-4d16-af12-113aac1d9f76 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-418810'] for port, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:10:03.161410 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_hamode_db [None req-29b7b34b-2504-441c-ac46-299abaed55c1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcae6b705e0>, [{'id': 'e2284a8f-630f-40d9-8cdd-17a1bb5a3448', 'name': 'tempest-TestVolumeBootPattern-1659174020-router', 'tenant_id': '6964ff917bfd44b1b1eca0a430c6cf1a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T18:05:20Z', 'updated_at': '2021-05-25T18:10:02Z', 'revision_number': 6, 'project_id': '6964ff917bfd44b1b1eca0a430c6cf1a', 'gw_port_host': None}], 'dv-cinder-789564-2-iscsi', False) {} {{(pid=99028) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 18:10:03.165465 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-29b7b34b-2504-441c-ac46-299abaed55c1 None None] The sync data for ids ['e2284a8f-630f-40d9-8cdd-17a1bb5a3448'] in dv-cinder-789564-2-iscsi is: [{'id': 'e2284a8f-630f-40d9-8cdd-17a1bb5a3448', 'name': 'tempest-TestVolumeBootPattern-1659174020-router', 'tenant_id': '6964ff917bfd44b1b1eca0a430c6cf1a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T18:05:20Z', 'updated_at': '2021-05-25T18:10:02Z', 'revision_number': 6, 'project_id': '6964ff917bfd44b1b1eca0a430c6cf1a', 'gw_port_host': None}] {{(pid=99028) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 25 18:10:03.222740 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.plugin [None req-948a2fa8-68db-4d16-af12-113aac1d9f76 admin admin] Calling delete_port for c14ee1b8-5c0b-41af-875f-c2f8d16e0c25 owned by network:router_gateway {{(pid=99026) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 18:10:03.455540 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-948a2fa8-68db-4d16-af12-113aac1d9f76 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781841222566', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781840788188', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15476536'] for port, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:10:03.460432 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-923c356a-c3df-4dbf-ae26-3cb98c8ee9a5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:10:03.507996 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-948a2fa8-68db-4d16-af12-113aac1d9f76 admin admin] Pushing event deleted for resources: {'Port': ['ID=c14ee1b8-5c0b-41af-875f-c2f8d16e0c25,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:10:03.510616 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-948a2fa8-68db-4d16-af12-113aac1d9f76 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:10:03.614517 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-948a2fa8-68db-4d16-af12-113aac1d9f76 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-419894'] for router_gateway, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:10:03.782445 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-948a2fa8-68db-4d16-af12-113aac1d9f76 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-415163', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-6965'] for router, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:10:03.785062 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-948a2fa8-68db-4d16-af12-113aac1d9f76 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:10:03.850412 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-948a2fa8-68db-4d16-af12-113aac1d9f76 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-414855'] for router, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:10:03.850968 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-948a2fa8-68db-4d16-af12-113aac1d9f76 admin admin] Fanout notify agent at l3_agent the message router_deleted on router e2284a8f-630f-40d9-8cdd-17a1bb5a3448 {{(pid=99026) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
May 25 18:10:03.869211 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-948a2fa8-68db-4d16-af12-113aac1d9f76 admin admin] Notify callbacks [] for router, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:10:03.870532 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-948a2fa8-68db-4d16-af12-113aac1d9f76 admin admin] 10.222.0.122 "DELETE /v2.0/routers/e2284a8f-630f-40d9-8cdd-17a1bb5a3448 HTTP/1.1" status: 204  len: 168 time: 1.5030584
May 25 18:10:03.873609 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 52996) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 18:10:03.938816 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.db_base_plugin_v2 [None req-e989429b-9e66-4042-bafd-cff87a4a1bb7 admin admin] Deleting subnet 7e40c2eb-fb3c-4338-9398-6fcd43705fa8 {{(pid=99026) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 25 18:10:03.943585 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-e989429b-9e66-4042-bafd-cff87a4a1bb7 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:10:03.994014 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-e989429b-9e66-4042-bafd-cff87a4a1bb7 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-14735050'] for subnet, precommit_delete_associations {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:10:04.016101 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device c14ee1b8-5c0b-41af-875f-c2f8d16e0c25 no longer exists at agent ovs-agent-dv-cinder-789564-2-iscsi {{(pid=99028) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 18:10:04.054188 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.plugin [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] No Port match for: c14ee1b8-5c0b-41af-875f-c2f8d16e0c25 {{(pid=99028) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 25 18:10:04.054539 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device c14ee1b8-5c0b-41af-875f-c2f8d16e0c25 not bound to the agent host dv-cinder-789564-2-iscsi {{(pid=99028) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 25 18:10:04.055200 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device 6239732d-4c0c-4187-b7e6-292b3569ab65 no longer exists at agent ovs-agent-dv-cinder-789564-2-iscsi {{(pid=99028) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 18:10:04.093797 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.plugin [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] No Port match for: 6239732d-4c0c-4187-b7e6-292b3569ab65 {{(pid=99028) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 25 18:10:04.094152 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device 6239732d-4c0c-4187-b7e6-292b3569ab65 not bound to the agent host dv-cinder-789564-2-iscsi {{(pid=99028) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 25 18:10:04.179063 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-e989429b-9e66-4042-bafd-cff87a4a1bb7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1474503'] for subnet, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:10:04.511994 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-e989429b-9e66-4042-bafd-cff87a4a1bb7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1473138', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114466', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-15477963', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-14794250'] for subnet, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:10:04.515827 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-6d7b686e-5b75-43f9-b5e1-29d6ae30ac27 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:10:04.553124 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e989429b-9e66-4042-bafd-cff87a4a1bb7 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=7e40c2eb-fb3c-4338-9398-6fcd43705fa8,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:10:04.556669 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-e989429b-9e66-4042-bafd-cff87a4a1bb7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.041s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:10:04.559389 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-e989429b-9e66-4042-bafd-cff87a4a1bb7 admin admin] Notify callbacks [] for subnet, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:10:04.565281 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-e989429b-9e66-4042-bafd-cff87a4a1bb7 admin admin] 10.222.0.122 "DELETE /v2.0/subnets/7e40c2eb-fb3c-4338-9398-6fcd43705fa8 HTTP/1.1" status: 204  len: 168 time: 0.6906977
May 25 18:10:04.565518 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-98f0ff26-21cd-433e-802c-42c6cf4324bb None None] Network 66e6b1a7-3352-49c8-951e-25e4133a13bb requested from dv-cinder-789564-2-iscsi {{(pid=99028) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 18:10:04.568439 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 53000) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 18:10:04.673690 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-ad95ebf1-f849-44db-a8c3-afae9863cd46 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1492659'] for network, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:10:04.744624 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.plugin [None req-ad95ebf1-f849-44db-a8c3-afae9863cd46 admin admin] Deleting port ecd5b317-fc50-4dd7-97b3-ff9cfdd800e8 {{(pid=99026) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 18:10:04.745257 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-ad95ebf1-f849-44db-a8c3-afae9863cd46 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781841220419'] for port, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:10:04.818946 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-87749820-b498-41df-aa86-c93ff69649eb None None] DHCP port deletion for 66e6b1a7-3352-49c8-951e-25e4133a13bb request from dv-cinder-789564-2-iscsi {{(pid=99028) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
May 25 18:10:04.849987 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.db [None req-ad95ebf1-f849-44db-a8c3-afae9863cd46 admin admin] For port ecd5b317-fc50-4dd7-97b3-ff9cfdd800e8, host dv-cinder-789564-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=ecd5b317-fc50-4dd7-97b3-ff9cfdd800e8,segment=NetworkSegment(2abbf128-e5e5-4349-af70-f8887ef58b0f),segment_id=2abbf128-e5e5-4349-af70-f8887ef58b0f)] {{(pid=99026) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 18:10:04.850347 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-ad95ebf1-f849-44db-a8c3-afae9863cd46 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-418810'] for port, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:10:04.889634 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.plugin [None req-87749820-b498-41df-aa86-c93ff69649eb None None] Deleting port ecd5b317-fc50-4dd7-97b3-ff9cfdd800e8 {{(pid=99028) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 18:10:04.889999 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-87749820-b498-41df-aa86-c93ff69649eb None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781841220419'] for port, before_delete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:10:04.974544 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.plugin [None req-ad95ebf1-f849-44db-a8c3-afae9863cd46 admin admin] Calling delete_port for ecd5b317-fc50-4dd7-97b3-ff9cfdd800e8 owned by network:dhcp {{(pid=99026) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 18:10:04.987804 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-87749820-b498-41df-aa86-c93ff69649eb None None] For port ecd5b317-fc50-4dd7-97b3-ff9cfdd800e8, host dv-cinder-789564-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=ecd5b317-fc50-4dd7-97b3-ff9cfdd800e8,segment=NetworkSegment(2abbf128-e5e5-4349-af70-f8887ef58b0f),segment_id=2abbf128-e5e5-4349-af70-f8887ef58b0f)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 18:10:04.988205 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-87749820-b498-41df-aa86-c93ff69649eb None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-418810'] for port, precommit_delete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:10:05.134494 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-ad95ebf1-f849-44db-a8c3-afae9863cd46 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781841222566', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781840788188', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15476536'] for port, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:10:05.138373 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-b06d900d-b4a1-4b00-a5c2-dd35115aed39 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:10:05.147791 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.plugin [None req-87749820-b498-41df-aa86-c93ff69649eb None None] Calling delete_port for ecd5b317-fc50-4dd7-97b3-ff9cfdd800e8 owned by network:dhcp {{(pid=99028) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 18:10:05.185685 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad95ebf1-f849-44db-a8c3-afae9863cd46 admin admin] Pushing event deleted for resources: {'Port': ['ID=ecd5b317-fc50-4dd7-97b3-ff9cfdd800e8,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:10:05.189482 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-ad95ebf1-f849-44db-a8c3-afae9863cd46 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:10:05.193471 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ad95ebf1-f849-44db-a8c3-afae9863cd46 admin admin] No DVR routers for this DVR port ecd5b317-fc50-4dd7-97b3-ff9cfdd800e8 on host dv-cinder-789564-2-iscsi {{(pid=99026) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 25 18:10:05.193652 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-87749820-b498-41df-aa86-c93ff69649eb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781841222566', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781840788188'] for port, after_delete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:10:05.197403 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:10:05.240209 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87749820-b498-41df-aa86-c93ff69649eb None None] Pushing event deleted for resources: {'Port': ['ID=ecd5b317-fc50-4dd7-97b3-ff9cfdd800e8,revision_number=None']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:10:05.245143 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvrscheduler_db [None req-87749820-b498-41df-aa86-c93ff69649eb None None] No DVR routers for this DVR port ecd5b317-fc50-4dd7-97b3-ff9cfdd800e8 on host dv-cinder-789564-2-iscsi {{(pid=99028) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 25 18:10:05.251181 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-87749820-b498-41df-aa86-c93ff69649eb None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:10:05.251530 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-87749820-b498-41df-aa86-c93ff69649eb None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:10:05.251870 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-87749820-b498-41df-aa86-c93ff69649eb None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:10:05.252209 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-87749820-b498-41df-aa86-c93ff69649eb None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:10:05.252535 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-87749820-b498-41df-aa86-c93ff69649eb None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:10:05.252865 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-87749820-b498-41df-aa86-c93ff69649eb None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:10:05.253758 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-87749820-b498-41df-aa86-c93ff69649eb None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:10:05.254232 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-87749820-b498-41df-aa86-c93ff69649eb None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:10:05.254569 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-87749820-b498-41df-aa86-c93ff69649eb None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:10:05.255183 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-87749820-b498-41df-aa86-c93ff69649eb None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:10:05.255183 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-87749820-b498-41df-aa86-c93ff69649eb None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:10:05.255499 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-87749820-b498-41df-aa86-c93ff69649eb None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-789564-2-iscsi {{(pid=99028) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 25 18:10:05.258626 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-87749820-b498-41df-aa86-c93ff69649eb None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.061s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:10:05.316868 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-ad95ebf1-f849-44db-a8c3-afae9863cd46 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1470792', 'neutron.services.segments.db._delete_segments_for_network-8781841233116'] for network, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:10:05.329718 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.services.segments.db [None req-ad95ebf1-f849-44db-a8c3-afae9863cd46 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fcae6f307f0>,) {'filters': {'network_id': ['66e6b1a7-3352-49c8-951e-25e4133a13bb']}} {{(pid=99026) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 18:10:05.342372 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.services.segments.db [None req-ad95ebf1-f849-44db-a8c3-afae9863cd46 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fcae6f307f0>, '2abbf128-e5e5-4349-af70-f8887ef58b0f') {'for_net_delete': True} {{(pid=99026) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 18:10:05.342667 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.services.segments.db [None req-ad95ebf1-f849-44db-a8c3-afae9863cd46 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fcae6f307f0>, '2abbf128-e5e5-4349-af70-f8887ef58b0f') {} {{(pid=99026) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 18:10:05.358896 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-ad95ebf1-f849-44db-a8c3-afae9863cd46 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8781841242525', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-14735041'] for segment, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:10:05.375759 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-ad95ebf1-f849-44db-a8c3-afae9863cd46 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1469168'] for segment, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:10:05.382312 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-ad95ebf1-f849-44db-a8c3-afae9863cd46 admin admin] Releasing vlan 1307 on physical network physnet1 to pool {{(pid=99026) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 25 18:10:05.393276 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-ad95ebf1-f849-44db-a8c3-afae9863cd46 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1469168', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-15476589'] for segment, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:10:05.396188 dv-cinder-789564-2-iscsi neutron-server[99026]: Traceback (most recent call last):
May 25 18:10:05.396188 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 25 18:10:05.396188 dv-cinder-789564-2-iscsi neutron-server[99026]:     timer()
May 25 18:10:05.396188 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 25 18:10:05.396188 dv-cinder-789564-2-iscsi neutron-server[99026]:     cb(*args, **kw)
May 25 18:10:05.396188 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 25 18:10:05.396188 dv-cinder-789564-2-iscsi neutron-server[99026]:     return func(*args, **kwargs)
May 25 18:10:05.396188 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 25 18:10:05.396188 dv-cinder-789564-2-iscsi neutron-server[99026]:     self._notify()
May 25 18:10:05.396188 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 25 18:10:05.396188 dv-cinder-789564-2-iscsi neutron-server[99026]:     self.callback(batched_events)
May 25 18:10:05.396188 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 25 18:10:05.396188 dv-cinder-789564-2-iscsi neutron-server[99026]:     event.method(event)
May 25 18:10:05.396188 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 25 18:10:05.396188 dv-cinder-789564-2-iscsi neutron-server[99026]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 25 18:10:05.396188 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 25 18:10:05.396188 dv-cinder-789564-2-iscsi neutron-server[99026]:     aggregate_uuid = self.p_client.list_aggregates(
May 25 18:10:05.396188 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 25 18:10:05.396188 dv-cinder-789564-2-iscsi neutron-server[99026]:     return f(self, *a, **k)
May 25 18:10:05.396188 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 25 18:10:05.396188 dv-cinder-789564-2-iscsi neutron-server[99026]:     return self._get(url).json()
May 25 18:10:05.396188 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 25 18:10:05.396188 dv-cinder-789564-2-iscsi neutron-server[99026]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 25 18:10:05.396188 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 25 18:10:05.396188 dv-cinder-789564-2-iscsi neutron-server[99026]:     return self.request(url, 'GET', **kwargs)
May 25 18:10:05.396188 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 25 18:10:05.396188 dv-cinder-789564-2-iscsi neutron-server[99026]:     base_url = self.get_endpoint(auth, allow=allow,
May 25 18:10:05.396188 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 25 18:10:05.396188 dv-cinder-789564-2-iscsi neutron-server[99026]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 25 18:10:05.396188 dv-cinder-789564-2-iscsi neutron-server[99026]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 25 18:10:05.396188 dv-cinder-789564-2-iscsi neutron-server[99026]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 25 18:10:05.396188 dv-cinder-789564-2-iscsi neutron-server[99026]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 25 18:10:05.529438 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-ad95ebf1-f849-44db-a8c3-afae9863cd46 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1470785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-459299', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551400', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-419883'] for network, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:10:05.532909 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:10:05.552378 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-ad95ebf1-f849-44db-a8c3-afae9863cd46 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for network, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:10:05.561074 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad95ebf1-f849-44db-a8c3-afae9863cd46 admin admin] Pushing event deleted for resources: {'Network': ['ID=66e6b1a7-3352-49c8-951e-25e4133a13bb,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:10:05.568176 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-ad95ebf1-f849-44db-a8c3-afae9863cd46 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.035s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:10:05.631909 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-ad95ebf1-f849-44db-a8c3-afae9863cd46 admin admin] 10.222.0.122 "DELETE /v2.0/networks/66e6b1a7-3352-49c8-951e-25e4133a13bb HTTP/1.1" status: 204  len: 168 time: 1.0624571
May 25 18:10:05.634719 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 53004) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 18:10:06.014178 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device ecd5b317-fc50-4dd7-97b3-ff9cfdd800e8 no longer exists at agent ovs-agent-dv-cinder-789564-2-iscsi {{(pid=99028) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 18:10:06.048733 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.plugin [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] No Port match for: ecd5b317-fc50-4dd7-97b3-ff9cfdd800e8 {{(pid=99028) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 25 18:10:06.049110 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device ecd5b317-fc50-4dd7-97b3-ff9cfdd800e8 not bound to the agent host dv-cinder-789564-2-iscsi {{(pid=99028) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 25 18:10:06.295914 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-0ae296a0-72cd-4471-a9be-8b6eff1b3d54 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-420907'] for router_interface, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:10:06.712132 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.plugin [None req-0ae296a0-72cd-4471-a9be-8b6eff1b3d54 admin admin] Deleting port 6dc2d19d-c86b-486a-a83e-6387508db507 {{(pid=99026) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 18:10:06.712832 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-0ae296a0-72cd-4471-a9be-8b6eff1b3d54 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781841220419'] for port, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:10:06.835734 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.db [None req-0ae296a0-72cd-4471-a9be-8b6eff1b3d54 admin admin] For port 6dc2d19d-c86b-486a-a83e-6387508db507, host dv-cinder-789564-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=6dc2d19d-c86b-486a-a83e-6387508db507,segment=NetworkSegment(519aa405-52e1-4777-ad06-c8bf40b2bbf0),segment_id=519aa405-52e1-4777-ad06-c8bf40b2bbf0)] {{(pid=99026) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 18:10:06.836086 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-0ae296a0-72cd-4471-a9be-8b6eff1b3d54 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-418810'] for port, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:10:06.967523 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.plugin [None req-0ae296a0-72cd-4471-a9be-8b6eff1b3d54 admin admin] Calling delete_port for 6dc2d19d-c86b-486a-a83e-6387508db507 owned by network:router_interface {{(pid=99026) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 18:10:07.198561 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-0ae296a0-72cd-4471-a9be-8b6eff1b3d54 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781841222566', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781840788188', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15476536'] for port, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:10:07.202598 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-1698d07d-e63b-4b1b-90f3-e9630bbfdbe3 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:10:07.248379 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ae296a0-72cd-4471-a9be-8b6eff1b3d54 admin admin] Pushing event deleted for resources: {'Port': ['ID=6dc2d19d-c86b-486a-a83e-6387508db507,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:10:07.275739 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-0ae296a0-72cd-4471-a9be-8b6eff1b3d54 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:10:07.522891 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-0ae296a0-72cd-4471-a9be-8b6eff1b3d54 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-551393', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-420795'] for router_interface, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:10:07.986742 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0ae296a0-72cd-4471-a9be-8b6eff1b3d54 admin admin] Router 7254d5fe-a81c-4f09-89f1-982ac4492476 has already been hosted by L3 agent eaeb6875-c4ed-43b6-8658-aa4e52324fdf {{(pid=99026) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 25 18:10:08.162786 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0ae296a0-72cd-4471-a9be-8b6eff1b3d54 admin admin] Notify agent at l3_agent.dv-cinder-789564-2-iscsi the message routers_updated {{(pid=99026) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 25 18:10:08.171093 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b09d7c09-9ab5-49ce-a01f-7f10be17494c None None] Sync routers for ids ['7254d5fe-a81c-4f09-89f1-982ac4492476'] in dv-cinder-789564-2-iscsi {{(pid=99029) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 25 18:10:08.174018 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-0ae296a0-72cd-4471-a9be-8b6eff1b3d54 admin admin] 10.222.0.122 "PUT /v2.0/routers/7254d5fe-a81c-4f09-89f1-982ac4492476/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.5382378
May 25 18:10:08.176435 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 53008) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 18:10:08.184473 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b09d7c09-9ab5-49ce-a01f-7f10be17494c None None] Routers {'7254d5fe-a81c-4f09-89f1-982ac4492476'} bound to L3 agent in host dv-cinder-789564-2-iscsi {{(pid=99029) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 18:10:08.185112 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_hamode_db [None req-b09d7c09-9ab5-49ce-a01f-7f10be17494c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcae71028e0>, 'dv-cinder-789564-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-25T17:34:21Z,description=<?>,heartbeat_timestamp=2021-05-25T18:09:51Z,host='dv-cinder-789564-2-iscsi',id=eaeb6875-c4ed-43b6-8658-aa4e52324fdf,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T17:34:21Z,topic='l3_agent')) {'router_ids': ['7254d5fe-a81c-4f09-89f1-982ac4492476'], 'active': True} {{(pid=99029) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 18:10:08.363127 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-cd5d701d-09f8-4e24-9afd-64ec854bab7d admin admin] Notify callbacks [] for router, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:10:08.363462 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_dvr_db [None req-b09d7c09-9ab5-49ce-a01f-7f10be17494c None None] Set router 7254d5fe-a81c-4f09-89f1-982ac4492476 gateway port host: dv-cinder-789564-2-iscsi {{(pid=99029) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 18:10:08.535509 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-cd5d701d-09f8-4e24-9afd-64ec854bab7d admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:10:08.649983 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.plugin [None req-cd5d701d-09f8-4e24-9afd-64ec854bab7d admin admin] Deleting port 99329f25-e0c1-49ca-9a07-ab8ede691506 {{(pid=99026) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 18:10:08.650317 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-cd5d701d-09f8-4e24-9afd-64ec854bab7d admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781841220419'] for port, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:10:08.679448 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_hamode_db [None req-b09d7c09-9ab5-49ce-a01f-7f10be17494c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcae71028e0>, [{'id': '7254d5fe-a81c-4f09-89f1-982ac4492476', 'name': 'tempest-TestVolumeBootPattern-887772658-router', 'tenant_id': '86736d5088ad4061b747699be757d295', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'external_fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.224'}], 'enable_snat': True}, 'gw_port_id': '99329f25-e0c1-49ca-9a07-ab8ede691506', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T18:05:29Z', 'updated_at': '2021-05-25T18:10:07Z', 'revision_number': 5, 'project_id': '86736d5088ad4061b747699be757d295', 'gw_port': {'id': '99329f25-e0c1-49ca-9a07-ab8ede691506', 'name': '', 'network_id': 'eb7ec72b-a691-481b-8d7e-42c05e13a8cb', 'tenant_id': '', 'mac_address': 'fa:16:3e:5b:82:13', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7254d5fe-a81c-4f09-89f1-982ac4492476', 'device_owner': 'network:router_gateway', 'standard_attr_id': 668, 'fixed_ips': [{'subnet_id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'ip_address': '172.27.3.224', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-789564-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T18:05:30Z', 'updated_at': '2021-05-25T18:05:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd6898f5f-da0b-4428-97b4-4cbe3e83caaa', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-789564-2-iscsi'}], 'dv-cinder-789564-2-iscsi', False) {} {{(pid=99029) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 18:10:08.683209 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b09d7c09-9ab5-49ce-a01f-7f10be17494c None None] Checking router: 7254d5fe-a81c-4f09-89f1-982ac4492476 for host: dv-cinder-789564-2-iscsi {{(pid=99029) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 25 18:10:08.692264 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b09d7c09-9ab5-49ce-a01f-7f10be17494c None None] Routers {'7254d5fe-a81c-4f09-89f1-982ac4492476'} bound to L3 agent in host dv-cinder-789564-2-iscsi {{(pid=99029) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 25 18:10:08.692965 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_hamode_db [None req-b09d7c09-9ab5-49ce-a01f-7f10be17494c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcae71028e0>, 'dv-cinder-789564-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-25T17:34:21Z,description=<?>,heartbeat_timestamp=2021-05-25T18:09:51Z,host='dv-cinder-789564-2-iscsi',id=eaeb6875-c4ed-43b6-8658-aa4e52324fdf,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-25T17:34:21Z,topic='l3_agent')) {'router_ids': ['7254d5fe-a81c-4f09-89f1-982ac4492476'], 'active': True} {{(pid=99029) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 18:10:08.772884 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.db [None req-cd5d701d-09f8-4e24-9afd-64ec854bab7d admin admin] For port 99329f25-e0c1-49ca-9a07-ab8ede691506, host dv-cinder-789564-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=99329f25-e0c1-49ca-9a07-ab8ede691506,segment=NetworkSegment(471771f9-c462-4865-800d-0d5029e9eb3e),segment_id=471771f9-c462-4865-800d-0d5029e9eb3e)] {{(pid=99026) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 18:10:08.773281 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-cd5d701d-09f8-4e24-9afd-64ec854bab7d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-418810'] for port, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:10:08.837496 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_dvr_db [None req-b09d7c09-9ab5-49ce-a01f-7f10be17494c None None] Set router 7254d5fe-a81c-4f09-89f1-982ac4492476 gateway port host: None {{(pid=99029) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 25 18:10:08.897017 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.plugins.ml2.plugin [None req-cd5d701d-09f8-4e24-9afd-64ec854bab7d admin admin] Calling delete_port for 99329f25-e0c1-49ca-9a07-ab8ede691506 owned by network:router_gateway {{(pid=99026) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 18:10:08.941791 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.l3_hamode_db [None req-b09d7c09-9ab5-49ce-a01f-7f10be17494c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcae71028e0>, [{'id': '7254d5fe-a81c-4f09-89f1-982ac4492476', 'name': 'tempest-TestVolumeBootPattern-887772658-router', 'tenant_id': '86736d5088ad4061b747699be757d295', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T18:05:29Z', 'updated_at': '2021-05-25T18:10:08Z', 'revision_number': 6, 'project_id': '86736d5088ad4061b747699be757d295', 'gw_port_host': None}], 'dv-cinder-789564-2-iscsi', False) {} {{(pid=99029) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 18:10:08.945739 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b09d7c09-9ab5-49ce-a01f-7f10be17494c None None] The sync data for ids ['7254d5fe-a81c-4f09-89f1-982ac4492476'] in dv-cinder-789564-2-iscsi is: [{'id': '7254d5fe-a81c-4f09-89f1-982ac4492476', 'name': 'tempest-TestVolumeBootPattern-887772658-router', 'tenant_id': '86736d5088ad4061b747699be757d295', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T18:05:29Z', 'updated_at': '2021-05-25T18:10:08Z', 'revision_number': 6, 'project_id': '86736d5088ad4061b747699be757d295', 'gw_port_host': None}] {{(pid=99029) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 25 18:10:09.196826 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-cd5d701d-09f8-4e24-9afd-64ec854bab7d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781841222566', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781840788188', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15476536'] for port, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:10:09.201372 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-37b44996-52bb-4fad-b09f-5c0dc34761a4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:10:09.246817 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd5d701d-09f8-4e24-9afd-64ec854bab7d admin admin] Pushing event deleted for resources: {'Port': ['ID=99329f25-e0c1-49ca-9a07-ab8ede691506,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:10:09.249795 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-cd5d701d-09f8-4e24-9afd-64ec854bab7d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:10:09.344538 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-cd5d701d-09f8-4e24-9afd-64ec854bab7d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-419894'] for router_gateway, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:10:09.525461 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-cd5d701d-09f8-4e24-9afd-64ec854bab7d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-415163', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-6965'] for router, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:10:09.527630 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-cd5d701d-09f8-4e24-9afd-64ec854bab7d admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:10:09.625477 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-cd5d701d-09f8-4e24-9afd-64ec854bab7d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-414855'] for router, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:10:09.625945 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cd5d701d-09f8-4e24-9afd-64ec854bab7d admin admin] Fanout notify agent at l3_agent the message router_deleted on router 7254d5fe-a81c-4f09-89f1-982ac4492476 {{(pid=99026) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
May 25 18:10:09.638927 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-cd5d701d-09f8-4e24-9afd-64ec854bab7d admin admin] Notify callbacks [] for router, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:10:09.640046 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-cd5d701d-09f8-4e24-9afd-64ec854bab7d admin admin] 10.222.0.122 "DELETE /v2.0/routers/7254d5fe-a81c-4f09-89f1-982ac4492476 HTTP/1.1" status: 204  len: 168 time: 1.4626780
May 25 18:10:09.642567 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.wsgi [-] (99026) accepted ('10.222.0.122', 53012) {{(pid=99026) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 18:10:09.702327 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.db.db_base_plugin_v2 [None req-88df31e1-83a8-4d78-9386-5f4d7e085aaf admin admin] Deleting subnet 23442663-84d3-4654-aee4-80434487f265 {{(pid=99026) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 25 18:10:09.705252 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-88df31e1-83a8-4d78-9386-5f4d7e085aaf admin admin] Notify callbacks [] for subnet, before_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:10:09.758156 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-88df31e1-83a8-4d78-9386-5f4d7e085aaf admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-14735050'] for subnet, precommit_delete_associations {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:10:09.836225 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-88df31e1-83a8-4d78-9386-5f4d7e085aaf admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1474503'] for subnet, precommit_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:10:10.018623 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device 99329f25-e0c1-49ca-9a07-ab8ede691506 no longer exists at agent ovs-agent-dv-cinder-789564-2-iscsi {{(pid=99028) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 18:10:10.056082 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.plugin [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] No Port match for: 99329f25-e0c1-49ca-9a07-ab8ede691506 {{(pid=99028) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 25 18:10:10.056424 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device 99329f25-e0c1-49ca-9a07-ab8ede691506 not bound to the agent host dv-cinder-789564-2-iscsi {{(pid=99028) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 25 18:10:10.056837 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device 6dc2d19d-c86b-486a-a83e-6387508db507 no longer exists at agent ovs-agent-dv-cinder-789564-2-iscsi {{(pid=99028) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 18:10:10.090166 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.plugin [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] No Port match for: 6dc2d19d-c86b-486a-a83e-6387508db507 {{(pid=99028) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 25 18:10:10.090771 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device 6dc2d19d-c86b-486a-a83e-6387508db507 not bound to the agent host dv-cinder-789564-2-iscsi {{(pid=99028) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 25 18:10:10.187014 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-88df31e1-83a8-4d78-9386-5f4d7e085aaf admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1473138', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114466', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-15477963', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-14794250'] for subnet, after_delete {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:10:10.191302 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-0baddebb-fa6c-42a6-be10-9d7f4172a1ec admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:10:10.223105 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88df31e1-83a8-4d78-9386-5f4d7e085aaf admin admin] Pushing event deleted for resources: {'Subnet': ['ID=23442663-84d3-4654-aee4-80434487f265,revision_number=None']} {{(pid=99026) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:10:10.226664 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG oslo_concurrency.lockutils [None req-88df31e1-83a8-4d78-9386-5f4d7e085aaf admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.036s {{(pid=99026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:10:10.228922 dv-cinder-789564-2-iscsi neutron-server[99026]: DEBUG neutron_lib.callbacks.manager [None req-88df31e1-83a8-4d78-9386-5f4d7e085aaf admin admin] Notify callbacks [] for subnet, before_response {{(pid=99026) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:10:10.234754 dv-cinder-789564-2-iscsi neutron-server[99026]: INFO neutron.wsgi [None req-88df31e1-83a8-4d78-9386-5f4d7e085aaf admin admin] 10.222.0.122 "DELETE /v2.0/subnets/23442663-84d3-4654-aee4-80434487f265 HTTP/1.1" status: 204  len: 168 time: 0.5912240
May 25 18:10:10.235309 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-07dd0bb0-eba6-4a0b-84c1-24941cabfc43 None None] Network d0c065bb-fb8d-40d4-a3f3-66b00161a624 requested from dv-cinder-789564-2-iscsi {{(pid=99028) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 25 18:10:10.237833 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 53016) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 18:10:10.351353 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-b74cfa34-70fa-46cb-861e-db6463ef9916 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1492659'] for network, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:10:10.427605 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.plugin [None req-b74cfa34-70fa-46cb-861e-db6463ef9916 admin admin] Deleting port 0559b054-25c6-47a3-ba20-d541ac352b02 {{(pid=99027) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 18:10:10.427979 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-b74cfa34-70fa-46cb-861e-db6463ef9916 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781841220419'] for port, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:10:10.480648 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2d4b8b7c-b1a5-4627-bbe8-e42fde81ca82 None None] DHCP port deletion for d0c065bb-fb8d-40d4-a3f3-66b00161a624 request from dv-cinder-789564-2-iscsi {{(pid=99028) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
May 25 18:10:10.528957 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.db [None req-b74cfa34-70fa-46cb-861e-db6463ef9916 admin admin] For port 0559b054-25c6-47a3-ba20-d541ac352b02, host dv-cinder-789564-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=0559b054-25c6-47a3-ba20-d541ac352b02,segment=NetworkSegment(519aa405-52e1-4777-ad06-c8bf40b2bbf0),segment_id=519aa405-52e1-4777-ad06-c8bf40b2bbf0)] {{(pid=99027) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 18:10:10.529341 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-b74cfa34-70fa-46cb-861e-db6463ef9916 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-418810'] for port, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:10:10.548203 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.plugin [None req-2d4b8b7c-b1a5-4627-bbe8-e42fde81ca82 None None] Deleting port 0559b054-25c6-47a3-ba20-d541ac352b02 {{(pid=99028) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 25 18:10:10.548579 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-2d4b8b7c-b1a5-4627-bbe8-e42fde81ca82 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781841220419'] for port, before_delete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:10:10.647184 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.db [None req-2d4b8b7c-b1a5-4627-bbe8-e42fde81ca82 None None] For port 0559b054-25c6-47a3-ba20-d541ac352b02, host dv-cinder-789564-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-789564-2-iscsi',level=0,port_id=0559b054-25c6-47a3-ba20-d541ac352b02,segment=NetworkSegment(519aa405-52e1-4777-ad06-c8bf40b2bbf0),segment_id=519aa405-52e1-4777-ad06-c8bf40b2bbf0)] {{(pid=99028) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 25 18:10:10.647485 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-2d4b8b7c-b1a5-4627-bbe8-e42fde81ca82 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-418810'] for port, precommit_delete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:10:10.658934 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.plugin [None req-b74cfa34-70fa-46cb-861e-db6463ef9916 admin admin] Calling delete_port for 0559b054-25c6-47a3-ba20-d541ac352b02 owned by network:dhcp {{(pid=99027) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 18:10:10.770016 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.plugin [None req-2d4b8b7c-b1a5-4627-bbe8-e42fde81ca82 None None] Calling delete_port for 0559b054-25c6-47a3-ba20-d541ac352b02 owned by network:dhcp {{(pid=99028) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 25 18:10:10.774355 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-b74cfa34-70fa-46cb-861e-db6463ef9916 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781841222566', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781840788188', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15468986'] for port, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:10:10.779203 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-72f30d11-db2b-4fc0-a58f-ed209d4bab7c service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:10:10.813926 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-2d4b8b7c-b1a5-4627-bbe8-e42fde81ca82 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1458908', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-114512', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781841222566', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781840788188'] for port, after_delete {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:10:10.817271 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-3befc076-42aa-4033-a2bc-93df038d707d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:10:10.821105 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b74cfa34-70fa-46cb-861e-db6463ef9916 admin admin] Pushing event deleted for resources: {'Port': ['ID=0559b054-25c6-47a3-ba20-d541ac352b02,revision_number=None']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:10:10.824212 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-b74cfa34-70fa-46cb-861e-db6463ef9916 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:10:10.824993 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b74cfa34-70fa-46cb-861e-db6463ef9916 admin admin] No DVR routers for this DVR port 0559b054-25c6-47a3-ba20-d541ac352b02 on host dv-cinder-789564-2-iscsi {{(pid=99027) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 25 18:10:10.863817 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d4b8b7c-b1a5-4627-bbe8-e42fde81ca82 None None] Pushing event deleted for resources: {'Port': ['ID=0559b054-25c6-47a3-ba20-d541ac352b02,revision_number=None']} {{(pid=99028) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:10:10.867313 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG oslo_concurrency.lockutils [None req-2d4b8b7c-b1a5-4627-bbe8-e42fde81ca82 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=99028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:10:10.869550 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2d4b8b7c-b1a5-4627-bbe8-e42fde81ca82 None None] No DVR routers for this DVR port 0559b054-25c6-47a3-ba20-d541ac352b02 on host dv-cinder-789564-2-iscsi {{(pid=99028) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 25 18:10:10.941289 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-b74cfa34-70fa-46cb-861e-db6463ef9916 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1470792', 'neutron.services.segments.db._delete_segments_for_network-8781841233116'] for network, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:10:10.954311 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.services.segments.db [None req-b74cfa34-70fa-46cb-861e-db6463ef9916 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fcae775a0d0>,) {'filters': {'network_id': ['d0c065bb-fb8d-40d4-a3f3-66b00161a624']}} {{(pid=99027) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 18:10:10.966560 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.services.segments.db [None req-b74cfa34-70fa-46cb-861e-db6463ef9916 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fcae775a0d0>, '519aa405-52e1-4777-ad06-c8bf40b2bbf0') {'for_net_delete': True} {{(pid=99027) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 18:10:10.966852 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.services.segments.db [None req-b74cfa34-70fa-46cb-861e-db6463ef9916 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fcae775a0d0>, '519aa405-52e1-4777-ad06-c8bf40b2bbf0') {} {{(pid=99027) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 25 18:10:10.979073 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-b74cfa34-70fa-46cb-861e-db6463ef9916 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8781841242525', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-15628874'] for segment, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:10:10.998699 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-b74cfa34-70fa-46cb-861e-db6463ef9916 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1469168'] for segment, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:10:11.004765 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-b74cfa34-70fa-46cb-861e-db6463ef9916 admin admin] Releasing vlan 1319 on physical network physnet1 to pool {{(pid=99027) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 25 18:10:11.009547 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-b74cfa34-70fa-46cb-861e-db6463ef9916 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1469168', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-15469039'] for segment, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:10:11.018152 dv-cinder-789564-2-iscsi neutron-server[99027]: Traceback (most recent call last):
May 25 18:10:11.018152 dv-cinder-789564-2-iscsi neutron-server[99027]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 25 18:10:11.018152 dv-cinder-789564-2-iscsi neutron-server[99027]:     timer()
May 25 18:10:11.018152 dv-cinder-789564-2-iscsi neutron-server[99027]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 25 18:10:11.018152 dv-cinder-789564-2-iscsi neutron-server[99027]:     cb(*args, **kw)
May 25 18:10:11.018152 dv-cinder-789564-2-iscsi neutron-server[99027]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 25 18:10:11.018152 dv-cinder-789564-2-iscsi neutron-server[99027]:     return func(*args, **kwargs)
May 25 18:10:11.018152 dv-cinder-789564-2-iscsi neutron-server[99027]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 25 18:10:11.018152 dv-cinder-789564-2-iscsi neutron-server[99027]:     self._notify()
May 25 18:10:11.018152 dv-cinder-789564-2-iscsi neutron-server[99027]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 25 18:10:11.018152 dv-cinder-789564-2-iscsi neutron-server[99027]:     self.callback(batched_events)
May 25 18:10:11.018152 dv-cinder-789564-2-iscsi neutron-server[99027]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 25 18:10:11.018152 dv-cinder-789564-2-iscsi neutron-server[99027]:     event.method(event)
May 25 18:10:11.018152 dv-cinder-789564-2-iscsi neutron-server[99027]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 25 18:10:11.018152 dv-cinder-789564-2-iscsi neutron-server[99027]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 25 18:10:11.018152 dv-cinder-789564-2-iscsi neutron-server[99027]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 25 18:10:11.018152 dv-cinder-789564-2-iscsi neutron-server[99027]:     aggregate_uuid = self.p_client.list_aggregates(
May 25 18:10:11.018152 dv-cinder-789564-2-iscsi neutron-server[99027]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 25 18:10:11.018152 dv-cinder-789564-2-iscsi neutron-server[99027]:     return f(self, *a, **k)
May 25 18:10:11.018152 dv-cinder-789564-2-iscsi neutron-server[99027]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 25 18:10:11.018152 dv-cinder-789564-2-iscsi neutron-server[99027]:     return self._get(url).json()
May 25 18:10:11.018152 dv-cinder-789564-2-iscsi neutron-server[99027]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 25 18:10:11.018152 dv-cinder-789564-2-iscsi neutron-server[99027]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 25 18:10:11.018152 dv-cinder-789564-2-iscsi neutron-server[99027]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 25 18:10:11.018152 dv-cinder-789564-2-iscsi neutron-server[99027]:     return self.request(url, 'GET', **kwargs)
May 25 18:10:11.018152 dv-cinder-789564-2-iscsi neutron-server[99027]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 25 18:10:11.018152 dv-cinder-789564-2-iscsi neutron-server[99027]:     base_url = self.get_endpoint(auth, allow=allow,
May 25 18:10:11.018152 dv-cinder-789564-2-iscsi neutron-server[99027]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 25 18:10:11.018152 dv-cinder-789564-2-iscsi neutron-server[99027]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 25 18:10:11.018152 dv-cinder-789564-2-iscsi neutron-server[99027]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 25 18:10:11.018152 dv-cinder-789564-2-iscsi neutron-server[99027]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 25 18:10:11.018152 dv-cinder-789564-2-iscsi neutron-server[99027]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 25 18:10:11.140989 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-b74cfa34-70fa-46cb-861e-db6463ef9916 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1470785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-459299', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551400', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-419883'] for network, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:10:11.145284 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-325cb4fc-115a-4fad-8671-c8bddf4a2d48 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:10:11.158203 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-b74cfa34-70fa-46cb-861e-db6463ef9916 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for network, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:10:11.169173 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b74cfa34-70fa-46cb-861e-db6463ef9916 admin admin] Pushing event deleted for resources: {'Network': ['ID=d0c065bb-fb8d-40d4-a3f3-66b00161a624,revision_number=None']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:10:11.171978 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-b74cfa34-70fa-46cb-861e-db6463ef9916 admin admin] 10.222.0.122 "DELETE /v2.0/networks/d0c065bb-fb8d-40d4-a3f3-66b00161a624 HTTP/1.1" status: 204  len: 168 time: 0.9330113
May 25 18:10:11.172932 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-b74cfa34-70fa-46cb-861e-db6463ef9916 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:10:11.509931 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 53022) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 18:10:11.564848 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-e26fd0e6-e560-4595-93e1-9348b06f5393 admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=6964ff917bfd44b1b1eca0a430c6cf1a&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0537453
May 25 18:10:11.567932 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 53026) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 18:10:11.624615 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-f23a083e-ee33-496b-8c7c-5823b565e3ee admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:10:11.649935 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-f23a083e-ee33-496b-8c7c-5823b565e3ee admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:10:11.762792 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-f23a083e-ee33-496b-8c7c-5823b565e3ee admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:10:11.767419 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-8aa05d80-2b99-4b84-9032-6c5f89094b25 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:10:11.781167 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f23a083e-ee33-496b-8c7c-5823b565e3ee admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d58a7933-8361-40fa-9837-e332b7361c61,revision_number=None']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:10:11.786215 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-f23a083e-ee33-496b-8c7c-5823b565e3ee admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:10:11.789565 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-f23a083e-ee33-496b-8c7c-5823b565e3ee admin admin] Notify callbacks [] for security_group, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:10:11.790674 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-f23a083e-ee33-496b-8c7c-5823b565e3ee admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/d58a7933-8361-40fa-9837-e332b7361c61 HTTP/1.1" status: 204  len: 168 time: 0.2218778
May 25 18:10:11.819446 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:10:12.016849 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device 0559b054-25c6-47a3-ba20-d541ac352b02 no longer exists at agent ovs-agent-dv-cinder-789564-2-iscsi {{(pid=99028) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 25 18:10:12.053441 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.plugin [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] No Port match for: 0559b054-25c6-47a3-ba20-d541ac352b02 {{(pid=99028) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 25 18:10:12.053790 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron.plugins.ml2.rpc [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Device 0559b054-25c6-47a3-ba20-d541ac352b02 not bound to the agent host dv-cinder-789564-2-iscsi {{(pid=99028) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 25 18:10:12.580964 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 53034) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 18:10:12.626195 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-59fae654-a3d8-492f-8240-5cc4a13d8b25 admin admin] 10.222.0.122 "GET /v2.0/security-groups?tenant_id=86736d5088ad4061b747699be757d295&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0476785
May 25 18:10:12.629243 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.wsgi [-] (99027) accepted ('10.222.0.122', 53038) {{(pid=99027) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 25 18:10:12.703334 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-a8384219-d38a-452f-8385-f1a9ade1dc7c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:10:12.730951 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-a8384219-d38a-452f-8385-f1a9ade1dc7c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:10:12.860669 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-a8384219-d38a-452f-8385-f1a9ade1dc7c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-459331'] for security_group, after_delete {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:10:12.864838 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-325cb4fc-115a-4fad-8671-c8bddf4a2d48 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 25 18:10:12.875856 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8384219-d38a-452f-8385-f1a9ade1dc7c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b6b54980-b5d5-413d-a564-a7238139e824,revision_number=None']} {{(pid=99027) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 25 18:10:12.880340 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG oslo_concurrency.lockutils [None req-a8384219-d38a-452f-8385-f1a9ade1dc7c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=99027) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 25 18:10:12.883559 dv-cinder-789564-2-iscsi neutron-server[99027]: DEBUG neutron_lib.callbacks.manager [None req-a8384219-d38a-452f-8385-f1a9ade1dc7c admin admin] Notify callbacks [] for security_group, before_response {{(pid=99027) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:10:12.884662 dv-cinder-789564-2-iscsi neutron-server[99027]: INFO neutron.wsgi [None req-a8384219-d38a-452f-8385-f1a9ade1dc7c admin admin] 10.222.0.122 "DELETE /v2.0/security-groups/b6b54980-b5d5-413d-a564-a7238139e824 HTTP/1.1" status: 204  len: 168 time: 0.2546697
May 25 18:10:18.214896 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-e6d98939-c94e-4921-b73c-1a535ff73df7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:10:20.660343 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-31715303-1428-4094-b8e4-7b6052abaf5e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:10:20.904958 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:10:21.832083 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-7e261f94-b84f-443e-be49-3bc1ac903b55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:10:22.749465 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.agents_db [None req-14fae233-15dc-4576-836b-621c5f95b584 None None] Agent healthcheck: found 6 active agents {{(pid=99029) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 18:10:23.408839 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-6df2b2a7-a54e-4d57-9be3-033078b9d5b3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:10:41.860212 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:10:48.191694 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-d7a56899-3170-4022-8c53-2a18afbc8bb1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:10:50.694467 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-f1e5d05f-118e-46be-ac04-946ca953edc3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:10:50.871249 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:10:51.814332 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-7e261f94-b84f-443e-be49-3bc1ac903b55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:10:53.550092 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-6df2b2a7-a54e-4d57-9be3-033078b9d5b3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:10:59.748347 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.agents_db [None req-14fae233-15dc-4576-836b-621c5f95b584 None None] Agent healthcheck: found 6 active agents {{(pid=99029) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 18:11:11.836946 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:11:18.173335 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-ed9df25f-22ef-46c1-a474-9e14b7e473ff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:11:20.669024 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-2a8fc7a9-5328-4171-863c-f5bfff1a2d1d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:11:20.876099 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:11:21.847432 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-7e261f94-b84f-443e-be49-3bc1ac903b55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:11:23.413031 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-6df2b2a7-a54e-4d57-9be3-033078b9d5b3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:11:36.750767 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.agents_db [None req-14fae233-15dc-4576-836b-621c5f95b584 None None] Agent healthcheck: found 6 active agents {{(pid=99029) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 18:11:41.978724 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:11:48.166801 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4842de47-cf80-438d-ab98-8f0decdb62fe None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:11:50.698284 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-885ee94f-9218-4800-a672-9ed5710ab613 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:11:50.902258 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:11:51.823738 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-7e261f94-b84f-443e-be49-3bc1ac903b55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:11:53.406832 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-6df2b2a7-a54e-4d57-9be3-033078b9d5b3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:12:11.868820 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:12:13.749517 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.agents_db [None req-14fae233-15dc-4576-836b-621c5f95b584 None None] Agent healthcheck: found 6 active agents {{(pid=99029) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 18:12:18.223401 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-2ed128b2-6fab-4c05-8be1-e070626d6d00 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:12:20.725991 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-fc4f59d1-d514-4e3d-bacf-d725be65e924 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:12:20.914846 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:12:21.844741 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-7e261f94-b84f-443e-be49-3bc1ac903b55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:12:23.434499 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-6df2b2a7-a54e-4d57-9be3-033078b9d5b3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:12:41.896925 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-83f57973-7e10-4a1a-9960-5bb05f54d7bc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:12:48.182568 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-cd8be425-ed34-456b-ac8d-f242916f47a6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:12:50.677883 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-faa17635-4a8b-4ab9-bad1-f9d76379f603 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:12:50.748096 dv-cinder-789564-2-iscsi neutron-server[99029]: DEBUG neutron.db.agents_db [None req-14fae233-15dc-4576-836b-621c5f95b584 None None] Agent healthcheck: found 6 active agents {{(pid=99029) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 25 18:12:50.959752 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-4db49840-63f3-4010-87c9-7b23f6891438 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:12:51.820653 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-7e261f94-b84f-443e-be49-3bc1ac903b55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 25 18:12:53.422573 dv-cinder-789564-2-iscsi neutron-server[99028]: DEBUG neutron_lib.callbacks.manager [None req-6df2b2a7-a54e-4d57-9be3-033078b9d5b3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781841233134', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1444998'] for agent, after_update {{(pid=99028) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}